TY - JOUR
T1 - Towards assisted electrocardiogram interpretation using an AI-enabled Augmented Reality headset
AU - Lampreave, P.
AU - Jimenez-Perez, G.
AU - Sanz, I.
AU - Gomez, A.
AU - Camara, O.
PY - 2020
Y1 - 2020
N2 - The interpretation of electrocardiograms (ECGs) is key for the diagnosis and monitoring of cardiovascular health. Despite the progressive digital transformation in healthcare, it is still common for clinicians to analyse ECG printed on paper. Although some systems provide signal processing-based ECG classification, clinicians often find it unreliable. Artificial Intelligence (AI) techniques are becoming state-of-the-art for ECG processing but the lack of digitised ECG has hampered the clinical translation of these techniques. Concurrently, we are living a rise in augmented reality (AR) technologies, with an increasing availability of devices. In this work, we present an automatic digitisation and assisted interpretation of ECG based on an AI-enabled Augmented Reality headset. The AR headset is used to acquire an image of the printed ECG, from which the digitised ECG signal is extracted. Afterwards, the digitised ECG is introduced into a Deep Learning (DL) algorithm pre-trained on a public database of 12-lead ECG recordings. The output of the DL algorithm classifies the ECG signal onto different cardiomyopathy categories, which is then visualized back in the AR headset. Preliminary classification results on simulated ECG images (96.5% of accuracy) confirm the potential of the developed approach to contribute on the digital transformation of ECG processing.
AB - The interpretation of electrocardiograms (ECGs) is key for the diagnosis and monitoring of cardiovascular health. Despite the progressive digital transformation in healthcare, it is still common for clinicians to analyse ECG printed on paper. Although some systems provide signal processing-based ECG classification, clinicians often find it unreliable. Artificial Intelligence (AI) techniques are becoming state-of-the-art for ECG processing but the lack of digitised ECG has hampered the clinical translation of these techniques. Concurrently, we are living a rise in augmented reality (AR) technologies, with an increasing availability of devices. In this work, we present an automatic digitisation and assisted interpretation of ECG based on an AI-enabled Augmented Reality headset. The AR headset is used to acquire an image of the printed ECG, from which the digitised ECG signal is extracted. Afterwards, the digitised ECG is introduced into a Deep Learning (DL) algorithm pre-trained on a public database of 12-lead ECG recordings. The output of the DL algorithm classifies the ECG signal onto different cardiomyopathy categories, which is then visualized back in the AR headset. Preliminary classification results on simulated ECG images (96.5% of accuracy) confirm the potential of the developed approach to contribute on the digital transformation of ECG processing.
KW - augmented reality
KW - deep learning
KW - Electrocardiogram
KW - medical data digitisation
UR - http://www.scopus.com/inward/record.url?scp=85094219168&partnerID=8YFLogxK
U2 - 10.1080/21681163.2020.1835544
DO - 10.1080/21681163.2020.1835544
M3 - Article
AN - SCOPUS:85094219168
SN - 2168-1163
JO - Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization
JF - Computer Methods in Biomechanics and Biomedical Engineering: Imaging and Visualization
ER -