Cardiac Magnetic Resonance (CMR) imaging is a vital non-invasive tool for diagnosing heart diseases and evaluating cardiac health. However, the limited availability of large-scale, high-quality CMR datasets poses a major challenge to the effective application of artificial intelligence (AI) in this domain. Even the amount of unlabeled data and the health status it covers are difficult to meet the needs of model pretraining, which hinders the performance of AI models on downstream tasks. In this study, we present Cardiac Phenotype-Guided CMR Generation (CPGG), a novel approach for generating diverse CMR data that covers a wide spectrum of cardiac health status. The CPGG framework consists of two stages: in the first stage, a generative model is trained using cardiac phenotypes derived from CMR data; in the second stage, a masked autoregressive diffusion model, conditioned on these phenotypes, generates high-fidelity CMR cine sequences that capture both structural and functional features of the heart in a fine-grained manner. We synthesized a massive amount of CMR to expand the pretraining data. Experimental results show that CPGG generates high-quality synthetic CMR data, significantly improving performance on various downstream tasks, including diagnosis and cardiac phenotypes prediction. These gains are demonstrated across both public and private datasets, highlighting the effectiveness of our approach. Code is availabel at https://anonymous.4open.science/r/CPGG.
RePCM: Region-Specific and Phenotype-Adaptive Bi-Ventricular Cardiac Motion Synthesis
School of Biomedical Engineering, National University of Singapore, Singapore(新加坡国立大学生物医学工程学院);School of Automation, Southeast University, Nanjing, China(东南大学自动化学院);School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing, China(南京航空航天大学计算机科学与技术学院);School of Information Science and Engineering, Yunnan University, Kunming, China(云南大学信息科学与工程学院)
Opportunistic Cardiac Health Assessment: Estimating Phenotypes from Localizer MRI through Multi-Modal Representations
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital(人工智能在医疗与健康中的研究所,慕尼黑技术大学(TUM)和TUM大学医院);Department of Diagnostic and Interventional Neuroradiology, School of Medicine, TUM University Hospital(诊断与介入神经放射科,医学院,TUM大学医院);Department of Computing, Imperial College London(计算学院,伦敦帝国学院);Munich Center for Machine Learning (MCML), Germany(慕尼黑机器学习中心(MCML),德国)
Universal CT Representations from Anatomy to Disease Phenotype through Agglomerative Pretraining
Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology and Emory University(沃森·H·库勒生物医学工程系,佐治亚理工学院和埃默里大学);Department of Radiation Oncology and Winship Cancer Institute, Emory University(放射肿瘤学系和Winship癌症研究所,埃默里大学);Department of Electrical and Computer Engineering, Duke University(电气与计算机工程系,杜克大学);Department of Computer Science and Informatics, Emory University(计算机科学与信息学系,埃默里大学);Department of Materials Science & Engineering, Nuclear Engineering Program, University of Florida(材料科学与工程系、核工程项目,佛罗里达大学)
Metadata-Aware Adaptation of a Generative Foundation Model for Conditional CMR Synthesis
Facultat de Matemàtiques i Informàtica, Universitat de Barcelona(巴塞罗那大学数学与信息学院);NIHR Barts Biomedical Research Centre(英国国立卫生研究院巴特生物医学研究中心);St Bartholomew’s Hospital(圣巴塞洛缪医院);Institució Catalana de Recerca i Estudis Avançats (ICREA)(加泰罗尼亚高级研究学院)
Translating Electrocardiograms to Cardiac Magnetic Resonance Imaging Useful for Cardiac Assessment and Disease Screening: A Multi-Center Study
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);Department of Vascular Surgery, The First Affiliated Hospital of Zhejiang University School of Medicine(浙江大学医学院附属第一医院血管外科);Department of Cardiology, The First Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第一医院心内科);Department of Radiology, The First Affiliated Hospital, Zhejiang University School of Medicine(浙江大学医学院附属第一医院放射科);Department of Vascular Surgery, Quzhou People’s Hospital(衢州人民医院血管外科);Department of Cardiology, The Second Affiliated Hospital of Zhejiang University School of Medicine(浙江大学医学院附属第二医院心内科);China Ship Scientific Research Center(中国船舶科学研究院);Guangdong Transtek Medical Electronics Co., Ltd.(广东 Transtek 医疗电子有限公司)
Demographic-Aware Self-Supervised Anomaly Detection Pretraining for Equitable Rare Cardiac Diagnosis
Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);National University of Defense Technology(国防科技大学);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(瑞金医院,上海交通大学医学院);Renji Hospital, Shanghai Jiao Tong University School of Medicine(仁济医院,上海交通大学医学院)
ECG-LLM: Foundation Model for ECG-Based Cardiac Reasoning
Technical University of Munich (TUM)(慕尼黑工业大学);TUM University Hospital(慕尼黑工业大学附属医院);Imperial College London(帝国理工学院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心)
Unlocking the diagnostic potential of electrocardiograms through information transfer from cardiac magnetic resonance imaging
School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院);University of Zurich(苏黎世大学);School of Medicine, Klinikum Rechts der Isar, Technical University of Munich(慕尼黑工业大学雷赫特-伊萨尔医院医学院);Imperial College London(伦敦帝国学院);Munich Center for Machine Learning(慕尼黑机器学习中心)
A Latent ODE Approach to Spatiotemporal Modeling of Cine Cardiac MRI
Swiss Data Science Center, EPFL and ETH Zürich(瑞士数据科学中心,EPFL 和 ETH 苏黎世);Diagnostic and Interventional Radiology, University Hospital Zürich(诊断与介入放射学,苏黎世大学医院);Institute for Biomedical Engineering, University and ETH Zürich(生物医学工程研究所,苏黎世大学和 ETH 苏黎世);Biomedical Informatics Group, ETH Zürich(生物医学信息学小组,ETH 苏黎世);Division of Preventive Medicine, Brigham and Women’s Hospital / Harvard Medical School(预防医学部,布莱根妇女医院/哈佛医学院)
Dual-Phase Cross-Modal Contrastive Learning for CMR-Guided ECG Representations for Cardiovascular Disease Assessment
Amsterdam University Medical Center(阿姆斯特丹大学医学中心);University of Amsterdam(阿姆斯特丹大学);ETH Zurich(苏黎世联邦理工学院);Department of Radiology and Nuclear Medicine, Amsterdam University Medical Center(放射医学与核医学系,阿姆斯特丹大学医学中心);Department of Radiology, Mayo Clinic, Rochester(放射医学系,梅奥诊所,罗切斯特)
Towards Cardiac MRI Foundation Models: Comprehensive Visual-Tabular Representations for Whole-Heart Assessment and Beyond
School of Computation, Information and Technology, Technical University of Munich(慕尼黑工业大学计算、信息与技术学院);School of Medicine, Klinikum Rechts der Isar, Technical University of Munich(慕尼黑工业大学伊萨尔河畔右岸医院医学院);Data Science Institute, Imperial College London(帝国理工学院数据科学研究所);Department of Computing, Imperial College London(帝国理工学院计算系);Department of Computer Science, University of Sheffield(谢菲尔德大学计算机科学系);Department of Quantitative Biomedicine, University of Zurich(苏黎世大学定量生物医学系)
Imperial College London(帝国理工学院);MRC London Clinical Sciences Centre(MRC伦敦临床科学中心);National Heart & Lung Institute(国家心肺研究所);Duke-NUS Graduate Medical School(杜克-新加坡国立大学研究生医学院)
Alterations in the geometry and function of the heart define well-established causes of cardiovascular disease. However, current approaches to the diagnosis of cardiovascular diseases often rely on subjective human assessment as well as manual analysis of medical images. Both factors limit the sensitivity in quantifying complex structural and functional phenotypes. Deep learning approaches have recently achieved success for tasks such as classification or segmentation of medical images, but lack interpretability in the feature extraction and decision processes, limiting their value in clinical…
School of Computation, Information and Technology(计算信息学院);Technical University of Munich(慕尼黑技术大学);School of Medicine, Klinikum Rechts der Isar(医学院);Department of Computer Science(计算机科学系);University of Sheffield(谢菲尔德大学);Department of Quantitative Biomedicine(定量生物医学系);University of Zurich(苏黎世大学);Department of Computing(计算系);Imperial College London(伦敦帝国理工学院);Department of Engineering Science(工程科学系);University of Oxford(牛津大学)
Shanghai Jiao Tong University(上海交通大学);Shanghai AI Laboratory(上海人工智能实验室);Ruijin Hospital, Shanghai Jiao Tong University School of Medicine(上海交通大学医学院附属瑞金医院)
Global and Local Contrastive Learning for Joint Representations from Cardiac MRI and ECG
Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany(人工智能在医疗与医学中的研究中心,技术大学慕尼黑(TUM)及慕尼黑技术大学医院);School of Medicine, Klinikum rechts der Isar, TUM, Germany(医学院,右岸克里克医院,TUM,德国);Department of Computing, Imperial College London, UK(计算学院,伦敦帝国学院,英国);Munich Center for Machine Learning (MCML), Munich, Germany(慕尼黑机器学习中心(MCML),慕尼黑,德国)
Training deep learning models on cardiac magnetic resonance imaging (CMR) can be a challenge due to the small amount of expert generated labels and inherent complexity of data source. Self-supervised contrastive learning (SSCL) has recently been shown to boost performance in several medical imaging tasks. However, it is unclear how much the pre-trained representation reflects the primary organ of interest compared to spurious surrounding tissue. In this work, we evaluate the optimal method of incorporating prior knowledge of anatomy into a SSCL training paradigm. Specifically, we evaluate usin…
Budapest University of Technology and Economics(布达佩斯技术与经济大学)
Supervised machine learning provides state-of-the-art solutions to a wide range of computer vision problems. However, the need for copious labelled training data limits the capabilities of these algorithms in scenarios where such input is scarce or expensive. Self-supervised learning offers a way to lower the need for manually annotated data by pretraining models for a specific domain on unlabelled data. In this approach, labelled data are solely required to fine-tune models for downstream tasks. Medical image segmentation is a field where labelling data requires expert knowledge and collectin…
Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学)
Contrastive learning has proven useful in many applications where access to labelled data is limited. The lack of annotated data is particularly problematic in medical image segmentation as it is difficult to have clinical experts manually annotate large volumes of data such as cardiac structures in ultrasound images of the heart. In this paper, We propose a self supervised contrastive learning method to segment the left ventricle from echocardiography when limited annotated images exist. Furthermore, we study the effect of contrastive pretraining on two well-known segmentation networks, UNet …
Reconstruction of Patient-Specific Confounders in AI-based Radiologic Image Interpretation using Generative Pretraining
Else Kroener Fresenius Center for Digital Health (EKFZ)(埃尔泽·克勒纳·菲森纽斯数字健康中心(EKFZ));Technical University Dresden(德累斯顿工业大学);University Hospital Aachen(亚琛大学医院);UC Berkeley(加州大学伯克利分校);University Hospital Zurich(苏黎世大学医院);University of Zurich(苏黎世大学);Center for Artificial Intelligence in Medicine and Imaging (AIMI)(医学与成像人工智能中心(AIMI));Stanford University(斯坦福大学);University Hospital Dresden(德累斯顿大学医院);National Center for Tumor Diseases (NCT)(国家肿瘤疾病中心(NCT))
Transformer-based cardiac substructure segmentation from contrast and non-contrast computed tomography for radiotherapy planning
Memorial Sloan Kettering Cancer Center(纪念斯隆·凯特琳癌症中心);Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg(弗莱堡大学医学院大学医学中心);German Cancer Consortium (DKTK)(德国癌症联盟(DKTK))
CORA: Generalizable coronary artery disease assessment and risk stratification from coronary CT angiography using pathology-centric representation learning
Department of Radiology, Northwestern University(西北大学放射学系);Department of Biomedical Engineering, Northwestern University(西北大学生物医学工程系);Department of Cardiology, Northwestern University(西北大学心脏病学系);Department of Preventive Medicine, Northwestern University(西北大学预防医学系)
Self-Supervised Learning for Medical Image Data with Anatomy-Oriented Imaging Planes
School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院);Jarvis Research Center, Tencent YouTu Lab(腾讯优图实验室贾维斯研究中心)