Real-Time Deep-Learned Reconstruction for a Scanning Intraoperative Probe

TY - JOUR

T1 - Real-Time Deep-Learned Reconstruction for a Scanning Intraoperative Probe

AU - Moo, Joshua

AU - Marsden, Paul

AU - Vyas, Kunal

AU - Reader, Andrew

PY - 2022/9/27

Y1 - 2022/9/27

N2 - Accurate delineation of the boundary between cancerous and healthy tissue during cancer resection surgeries is important to ensure complete removal of cancerous cells while preserving healthy tissue. Labelling cancer cells with radiotracers, and then using a probe during surgery to detect the radiotracer distribution, is a potential solution for accurate tumour localisation and hence better surgical outcomes. This work explores the feasibility of using deep learning to reconstruct a radiotracer distribution from data acquired by an intraoperative probe. The probe’s sensor array outputs (SAOs), obtained by scanning the probe over a region of interest, are supplied to the deep network, which then outputs a reconstructed radiotracer distribution for the region of interest. This initial work demonstrates that the deep network used here, a convolutional encoder decoder (CED), can successfully reconstruct simulated 2D radiotracer distributions from synthesised input data. However, the network was unable to generalise reliably when tested with count levels not present in the training set. Therefore the network must be trained with desired count levels or else should include estimation of epistemic uncertainty to avoid misleading outcomes. We also show that test-time augmentation can improve reconstructed image quality, and hence can also be used to reduce the amount of training data required.

AB - Accurate delineation of the boundary between cancerous and healthy tissue during cancer resection surgeries is important to ensure complete removal of cancerous cells while preserving healthy tissue. Labelling cancer cells with radiotracers, and then using a probe during surgery to detect the radiotracer distribution, is a potential solution for accurate tumour localisation and hence better surgical outcomes. This work explores the feasibility of using deep learning to reconstruct a radiotracer distribution from data acquired by an intraoperative probe. The probe’s sensor array outputs (SAOs), obtained by scanning the probe over a region of interest, are supplied to the deep network, which then outputs a reconstructed radiotracer distribution for the region of interest. This initial work demonstrates that the deep network used here, a convolutional encoder decoder (CED), can successfully reconstruct simulated 2D radiotracer distributions from synthesised input data. However, the network was unable to generalise reliably when tested with count levels not present in the training set. Therefore the network must be trained with desired count levels or else should include estimation of epistemic uncertainty to avoid misleading outcomes. We also show that test-time augmentation can improve reconstructed image quality, and hence can also be used to reduce the amount of training data required.

UR - http://www.scopus.com/inward/record.url?scp=85139468071&partnerID=8YFLogxK

U2 - 10.1109/TRPMS.2022.3209014

DO - 10.1109/TRPMS.2022.3209014

M3 - Article

SN - 2469-7303

SP - 1

JO - Transactions on Radiation and Plasma Medical Sciences

JF - Transactions on Radiation and Plasma Medical Sciences

ER -