Predicting post-operative right ventricular failure using video-based deep learning
Stanford University（斯坦福大学）；Houston Methodist DeBakey Heart Centre（休斯顿卫理公会德贝基心脏中心）；Spectrum Health Grand Rapids（大急流城Spectrum Health）；Columbia University（哥伦比亚大学）
Rohan Shad, Nicolas Quach, Robyn Fong, Patpilai Kasinpila, Cayley Bowles, Miguel Castro, Ashrith Guha, Eddie Suarez, Stefan Jovinge, Sangjin Lee, Theodore Boeve… 展开作者
Rohan Shad, Nicolas Quach, Robyn Fong, Patpilai Kasinpila, Cayley Bowles, Miguel Castro, Ashrith Guha, Eddie Suarez, Stefan Jovinge, Sangjin Lee, Theodore Boeve, Myriam Amsallem, Xiu Tang, Francois Haddad, Yasuhiro Shudo, Y. Joseph Woo, Jeffrey Teuteberg, John P. Cunningham, Curt P. Langlotz, William Hiesinger
Non-invasive and cost effective in nature, the echocardiogram allows for a comprehensive assessment of the cardiac musculature and valves. Despite progressive improvements over the decades, the rich temporally resolved data in echocardiography videos remain underutilized. Human reads of echocardiograms reduce the complex patterns of cardiac wall motion, to a small list of measurements of heart function. Furthermore, all modern echocardiography artificial intelligence (AI) systems are similarly limited by design - automating measurements of the same reductionist metrics rather than utilizing the wealth of data embedded within each echo study. This underutilization is most evident in situations where clinical decision making is guided by subjective assessments of disease acuity, and tools that predict disease onset within clinically actionable timeframes are unavailable. Predicting the likelihood of developing post-operative right ventricular failure (RV failure) in the setting of mechanical circulatory support is one such clinical example. To address this, we developed a novel video AI system trained to predict post-operative right ventricular failure (RV failure), using the full spatiotemporal density of information from pre-operative echocardiography scans. We achieve an AUC of 0.729, specificity of 52% at 80% sensitivity and 46% sensitivity at 80% specificity. Furthermore, we show that our ML system significantly outperforms a team of human experts tasked with predicting RV failure on independent clinical evaluation. Finally, the methods we describe are generalizable to any cardiac clinical decision support application where treatment or patient selection is guided by qualitative echocardiography assessments.
With the advent of Cardiac Cine Magnetic Resonance (CMR) Imaging, there has been a paradigm shift in medical technology, thanks to its capability of imaging different structures within the heart without ionizing radiation. However, it is very challenging to conduct pre-operative planning of minimally invasive cardiac procedures without accurate segmentation and identification of the left ventricle (LV), right ventricle (RV) blood-pool, and LV-myocardium. Manual segmentation of those structures, nevertheless, is time-consuming and often prone to error and biased outcomes. Hence, automatic and c…
From Pre- to Intra-operative MRI: Predicting Brain Shift in Temporal Lobe Resection for Epilepsy Surgery
Surgical and Interventional Engineering（外科与介入工程）；King’s College London（伦敦国王学院）；National Hospital for Neurology and Neurosurgery（神经外科医院）；NHS（国家健康服务）；Neurosurgery, King’s College Hospital（神经外科，伦敦国王学院医院）；Fondazione IRCCS Ca’ Granda（IRCCS Ca’ Granda基金会）；Ospedale Maggiore di Milano（米兰大医院）
The Hamlyn Centre for Robotic Surgery, Imperial College London（帝国理工学院哈姆林机器人外科中心）；Department of Computing, Imperial College London（帝国理工学院计算机系）；Cardiovascular Biomedical Research Unit, Royal Brompton Hospital（皇家布朗普顿医院心血管生物医学研究中心）
Purpose: Advancements in MRI Tissue Phase Velocity Mapping (TPM) allow for the acquisition of higher quality velocity cardiac images providing better assessment of regional myocardial deformation for accurate disease diagnosis, pre-operative planning and post-operative patient surveillance. Translation of TPM velocities from the scanner's reference coordinate system to the regional cardiac coordinate system requires decoupling of translational motion and motion due to myocardial deformation. Despite existing techniques for respiratory motion compensation in TPM, there is still a remaining tran…
Department of Health Technology, Technical University of Denmark（丹麦技术大学健康技术系）；Department of Oncology, The Finsen Center, Rigshospitalet（哥本哈根大学医院芬森中心肿瘤学系）；Department of Clinical Physiology, Nuclear Medicine and PET, Center of Diagnostic Investigation, Rigshospitalet（哥本哈根大学医院诊断研究中心临床生理学、核医学与正电子发射断层扫描科）；Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School（哈佛医学院麻省总医院Athinoula A. Martinos生物医学成像中心）
Survival prediction models can potentially be used to guide treatment of glioblastoma patients. However, currently available MR imaging biomarkers holding prognostic information are often challenging to interpret, have difficulties generalizing across data acquisitions, or are only applicable to pre-operative MR data. In this paper we aim to address these issues by introducing novel imaging features that can be automatically computed from MR images and fed into machine learning models to predict patient survival. The features we propose have a direct biological interpretation: They measure the…
Deep Learning-based Alignment Measurement in Knee Radiographs
Division of Informatics, Imaging and Data Sciences, The University of Manchester（信息学与数据科学系，曼彻斯特大学）；Northern Care Alliance NHS Foundation Trust（北护理联盟国家健康服务信托基金）；Department of Trauma and Orthopaedics, Stockport NHS Foundation Trust（创伤与骨科部门，史托波特国家健康服务信托基金）；School of Health and Society, University of Salford（健康与社会学院，萨尔福德大学）；School of Biological Sciences, The University of Manchester（生物科学学院，曼彻斯特大学）；Research Unit of Health Sciences and Technology, University of Oulu（健康科学与技术研究单位，奥卢大学）
Predicting Pulmonary Hypertension in Newborns: A Multi-view VAE Approach
Department of Computer Science ETH Zurich（计算机科学系，苏黎世联邦理工学院）；Department of Neonatology, University Children’s Hospital Regensburg (KUNO)（儿科部，雷根萨大学儿童医院（KUNO））；Hospital St. Hedwig of the Order of St. John（圣约翰修会圣海德维格医院）；University of Regensburg（雷根萨大学）
OsteoFlow: Lyapunov-Guided Flow Distillation for Predicting Bone Remodeling after Mandibular Reconstruction
Department of Electrical and Computer Engineering, University of British Columbia, Canada（电气与计算机工程系，不列颠哥伦比亚大学，加拿大）；Department of Mechanical Engineering, University of British Columbia, Canada（机械工程系，不列颠哥伦比亚大学，加拿大）；Department of Surgery, University of British Columbia, Canada（外科系，不列颠哥伦比亚大学，加拿大）；Sunnybrook Research Institute, University of Toronto, Canada（阳光医院研究学院，多伦多大学，加拿大）
The Chinese University of Hong Kong（香港中文大学）；T Stone Robotics Institute（T Stone机器人研究所）
Predicting future frames for robotic surgical video is an interesting, important yet extremely challenging problem, given that the operative tasks may have complex dynamics. Existing approaches on future prediction of natural videos were based on either deterministic models or stochastic models, including deep recurrent neural networks, optical flow, and latent space modeling. However, the potential in predicting meaningful movements of robots with dual arms in surgical scenarios has not been tapped so far, which is typically more challenging than forecasting independent motions of one arm rob…
A Clinically Validated Foundation Model for Comprehensive Lung Pathology Interpretation
Department of Pathology, Nanfang Hospital, Southern Medical University, Guangzhou, China（南方医科大学南芳医院病理科，广州，中国）；Department of Pathology, School of Basic Medical Sciences, Southern Medical University, Guangzhou, China（南方医科大学基础医学学院病理科，广州，中国）；Department of Computer Science and Engineering, Hong Kong University of Science and Technology, Hong Kong, China（香港科技大学计算机科学与工程系，香港，中国）；Guangdong Provincial Key Laboratory of Molecular Tumor Pathology, Guangzhou, China（广东省分子肿瘤病理重点实验室，广州，中国）；Department of Pathology, Shandong Provincial Qianfoshan Hospital, Jinan, Shandong, China（山东省青岛坊山医院病理科，济南，山东，中国）
Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）；Hasso Plattner Institute for Digital Health（哈索·普拉特纳数字健康研究所）；Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院）
Osteosarcoma is the most common primary bone cancer whose standard treatment includes pre-operative chemotherapy followed by resection. Chemotherapy response is used for predicting prognosis and further management of patients. Necrosis is routinely assessed post-chemotherapy from histology slides on resection specimens where necrosis ratio is defined as the ratio of necrotic tumor to overall tumor. Patients with necrosis ratio >=90% are known to have better outcome. Manual microscopic review of necrosis ratio from multiple glass slides is semi-quantitative and can have intra- and inter-observe…
The Hong Kong University of Science and Technology（香港科技大学）；The Hong Kong University of Science and Technology Shenzhen Research Institute（香港科技大学深圳研究院）
Left-ventricular ejection fraction (LVEF) is an important indicator of heart failure. Existing methods for LVEF estimation from video require large amounts of annotated data to achieve high performance, e.g. using 10,030 labeled echocardiogram videos to achieve mean absolute error (MAE) of 4.10. Labeling these videos is time-consuming however and limits potential downstream applications to other heart diseases. This paper presents the first semi-supervised approach for LVEF prediction. Unlike general video prediction tasks, LVEF prediction is specifically related to changes in the left ventric…
Echocardiography (echo) is an indispensable tool in a cardiologist's diagnostic armamentarium. To date, almost all echocardiographic parameters require time-consuming manual labeling and measurements by an experienced echocardiographer and exhibit significant variability, owing to the noisy and artifact-laden nature of echo images. For example, mitral inflow (MI) Doppler is used to assess left ventricular (LV) diastolic function, which is of paramount clinical importance to distinguish between different cardiac diseases. In the current work we present a fully automated workflow which leverages…
