TY - CHAP
T1 - Towards in-utero Navigational Assistance
T2 - 2023 International Symposium on Medical Robotics, ISMR 2023
AU - Ahmad, Mirza Awais
AU - Ourak, Mouloud
AU - Vercauteren, Tom
AU - Deprest, Jan
AU - Poorten, Emmanuel Vander
N1 - Funding Information:
This work was supported by Erasmus Mundus FetalMed PhD Program. (Corresponding author: Mirza Awais Ahmad.) 1The Laboratory of Robot-Assisted Surgery, Department of Mechanical Engineering, KU Leuven, Leuven 3000, Belgium (e-mail:, [email protected]; [email protected]; [email protected]).
Publisher Copyright:
© 2023 IEEE.
PY - 2023
Y1 - 2023
N2 - Fetoscopic laser coagulation (FLC) is the most prevalent therapy for treating twin-to-twin transfusion syndrome (TTTS). A rigid or flexible fetoscope is inserted into the uterine cavity through a small incision in this minimally invasive technique. The procedure consists of surveying the placental surface, identifying anastomosing vessels, and coagulation. This paper presents a multi-task neural network model to segment the vasculature from the fetoscopic images and estimate the relative orientation and distance of the placental surface to assist the surgeons. This work also presents a method to use virtual reality (VR) to generate datasets for training and testing. A silicon-based placenta phantom was created in a planar form of 29 × 29 cm with realistic vasculature. A scanned image of this phantom was manually segmented as the ground truth. Both the color image of the placenta and segmented ground truth were placed in the VR simulator. The virtual camera is moved by pre-defined camera motions, which then renders fetoscopic placenta images and their corresponding segmented ground truth without the need for manual segmentation. The network achieved a dice coefficient of 0.8 on the segmentation task and 87% accuracy on the regression task. The network's capacity to identify vessels was also evaluated using actual images from a flexible fetoscope's chip-on-tip camera.
AB - Fetoscopic laser coagulation (FLC) is the most prevalent therapy for treating twin-to-twin transfusion syndrome (TTTS). A rigid or flexible fetoscope is inserted into the uterine cavity through a small incision in this minimally invasive technique. The procedure consists of surveying the placental surface, identifying anastomosing vessels, and coagulation. This paper presents a multi-task neural network model to segment the vasculature from the fetoscopic images and estimate the relative orientation and distance of the placental surface to assist the surgeons. This work also presents a method to use virtual reality (VR) to generate datasets for training and testing. A silicon-based placenta phantom was created in a planar form of 29 × 29 cm with realistic vasculature. A scanned image of this phantom was manually segmented as the ground truth. Both the color image of the placenta and segmented ground truth were placed in the VR simulator. The virtual camera is moved by pre-defined camera motions, which then renders fetoscopic placenta images and their corresponding segmented ground truth without the need for manual segmentation. The network achieved a dice coefficient of 0.8 on the segmentation task and 87% accuracy on the regression task. The network's capacity to identify vessels was also evaluated using actual images from a flexible fetoscope's chip-on-tip camera.
UR - http://www.scopus.com/inward/record.url?scp=85161820440&partnerID=8YFLogxK
U2 - 10.1109/ISMR57123.2023.10130205
DO - 10.1109/ISMR57123.2023.10130205
M3 - Conference paper
AN - SCOPUS:85161820440
T3 - 2023 International Symposium on Medical Robotics, ISMR 2023
BT - 2023 International Symposium on Medical Robotics, ISMR 2023
PB - Institute of Electrical and Electronics Engineers Inc.
Y2 - 19 April 2023 through 21 April 2023
ER -