Cardiac disease evaluation depends on multiple diagnostic modalities: electrocardiogram (ECG) to diagnose abnormal heart rhythms, and imaging modalities such as Magnetic Resonance Imaging (MRI), Computed Tomography (CT) and echocardiography to detect signs of structural abnormalities. Each of these modalities brings complementary information for a better diagnosis of cardiac dysfunction. However, training a machine learning (ML) model with data from multiple modalities is a challenging task, as it increases the dimension space, while keeping constant the number of samples. In fact, as the dimension of the input space increases, the volume of data required for accurate generalisation grows exponentially. In this work, we address this issue, for the application of Ventricular Arrhythmia (VA) prediction, based on the combined clinical and CT imaging features, where we constrained the learning process on medical images (CT) based on the prior knowledge acquired from clinical data. The VA classifier is fed with features extracted from a 3D myocardium thickness map (TM) of the left ventricle. The TM is generated by our pipeline from the imaging input and a Graph Convolutional Network is used as the feature extractor of the 3D TM. We introduce a novel Sequential Fusion method and evaluate its performance against traditional Early Fusion techniques and single-modality models. The crossvalidation results show that the Sequential Fusion model achieved the highest average scores of 80.7% $\pm$ 4.4 Sensitivity and 73.1% $\pm$ 6.0 F1 score, outperforming the Early Fusion model at 65.0% $\pm$ 8.9 Sensitivity and 63.1% $\pm$ 6.3 F1 score. Both fusion models achieved better scores than the single-modality models, where the average Sensitivity and F1 score are 62.8% $\pm$ 10.1; 52.1% $\pm$ 6.5 for the clinical data modality and 62.9% $\pm$ 6.3; 60.7% $\pm$ 5.3 for the medical images modality.
TinyML Design Contest for Life-Threatening Ventricular Arrhythmia Detection
University of Notre Dame(圣母大学);South Central Minzu University(中南民族大学);Guangdong Cardiovascular Institute(广东省心血管病研究所);Guangdong Provincial People’s Hospital (Guangdong Academy of Medical Sciences)(广东省人民医院(广东省医学科学院));Southern Medical University(南方医科大学);Singular Medical Co., Ltd(奇点医疗有限公司)
Classification of Arrhythmia by Using Deep Learning with 2-D ECG Spectral Image Representation
University of Engineering and Technology Taxila(塔克西拉工程技术大学);University of Central Florida(中佛罗里达大学);Hankuk University of Foreign Studies(韩国外国语大学);Xiamen University Malaysia(厦门大学马来西亚分校)
Multiclass Arrhythmia Classification using Smartwatch Photoplethysmography Signals Collected in Real-life Settings
University of Connecticut(康涅狄格大学);Morehouse School of Medicine(莫尔豪斯医学院);The Warren Alpert Medical School of Brown University(布朗大学沃伦·阿尔珀特医学院);University of Massachusetts Chan Medical School(马萨诸塞大学陈医学院)
ArrhythmiaVision: Resource-Conscious Deep Learning Models with Visual Explanations for ECG Arrhythmia Classification
Dipartimento di Informatica, Università di Verona, Verona, Italy(信息学院,威尼斯大学,威尼斯,意大利);Department of Computer Science, School of Mathematics and Computer Science, Institute of Business Administration, Karachi, Pakistan(计算机科学系,数学与计算机科学学院,商学院,卡拉奇,巴基斯坦);Faculty of Information Technology, Salim Habib University, Karachi, Pakistan(信息技术学院,萨利姆·哈比大学,卡拉奇,巴基斯坦)
MEETI: A Multimodal ECG Dataset from MIMIC-IV-ECG with Signals, Images, Features and Interpretations
HeartVoice Medical Technology(HeartVoice医疗科技);Saw Swee Hock School of Public Health and Institute of Data Science(Saw Swee Hock公共卫生学院和数据科学研究所);National University of Singapore(新加坡国立大学);Department of Cardiology, Peking University People’s Hospital(北京大学人民医院心内科);College of Integrative Chinese and Western Medicine, Anhui University of Chinese Medicine(安徽中医药大学整合中西医学学院);National Institute of Health Data Science, Peking University(北京大学国家健康数据科学研究院);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)