Combining Multimodal Information for Metal Artefact Reduction: An Unsupervised Deep Learning Framework

Marta B.M. Ranzini, Irme Groothuis, Kerstin Klaser, M. Jorge Cardoso, Johann Henckel, Sebastien Ourselin, Alister Hart, Marc Modat

Research output: Chapter in Book/Report/Conference proceedingConference paperpeer-review

8 Citations (Scopus)

Abstract

Metal artefact reduction (MAR) techniques aim at removing metal-induced noise from clinical images. In Computed Tomography (CT), supervised deep learning approaches have been shown effective but limited in generalisability, as they mostly rely on synthetic data. In Magnetic Resonance Imaging (MRI) instead, no method has yet been introduced to correct the susceptibility artefact, still present even in MAR-specific acquisitions. In this work, we hypothesise that a multimodal approach to MAR would improve both CT and MRI. Given their different artefact appearance, their complementary information can compensate for the corrupted signal in either modality. We thus propose an unsupervised deep learning method for multimodal MAR. We introduce the use of Locally Normalised Cross Correlation as a loss term to encourage the fusion of multimodal information. Experiments show that our approach favours a smoother correction in the CT, while promoting signal recovery in the MRI.

Original languageEnglish
Title of host publicationISBI 2020 - 2020 IEEE International Symposium on Biomedical Imaging
PublisherIEEE Computer Society
Pages600-604
Number of pages5
ISBN (Electronic)9781538693308
DOIs
Publication statusPublished - Apr 2020
Event17th IEEE International Symposium on Biomedical Imaging, ISBI 2020 - Iowa City, United States
Duration: 3 Apr 20207 Apr 2020

Publication series

NameProceedings - International Symposium on Biomedical Imaging
Volume2020-April
ISSN (Print)1945-7928
ISSN (Electronic)1945-8452

Conference

Conference17th IEEE International Symposium on Biomedical Imaging, ISBI 2020
Country/TerritoryUnited States
CityIowa City
Period3/04/20207/04/2020

Keywords

  • CT
  • Deep Learning
  • Metal Artefact Reduction
  • MR
  • Unsupervised Learning

Fingerprint

Dive into the research topics of 'Combining Multimodal Information for Metal Artefact Reduction: An Unsupervised Deep Learning Framework'. Together they form a unique fingerprint.

Cite this