As the demand for more descriptive machine learning models grows within medical imaging, bottlenecks due to data paucity will exacerbate. Thus, collecting enough large-scale data will require automated tools to harvest data/label pairs from messy and real-world datasets, such as hospital PACS. This is the focus of our work, where we present a principled data curation tool to extract multi-phase CT liver studies and identify each scan's phase from a real-world and heterogenous hospital PACS dataset. Emulating a typical deployment scenario, we first obtain a set of noisy labels from our institutional partners that are text mined using simple rules from DICOM tags. We train a deep learning system, using a customized and streamlined 3D SE architecture, to identify non-contrast, arterial, venous, and delay phase dynamic CT liver scans, filtering out anything else, including other types of liver contrast studies. To exploit as much training data as possible, we also introduce an aggregated cross entropy loss that can learn from scans only identified as "contrast". Extensive experiments on a dataset of 43K scans of 7680 patient imaging studies demonstrate that our 3DSE architecture, armed with our aggregated loss, can achieve a mean F1 of 0.977 and can correctly harvest up to 92.7% of studies, which significantly outperforms the text-mined and standard-loss approach, and also outperforms other, and more complex, model architectures.
LIDIA: Precise Liver Tumor Diagnosis on Multi-Phase Contrast-Enhanced CT via Iterative Fusion and Asymmetric Contrastive Learning
College of Computer Science, Sichuan University（四川大学计算机学院）；DAMO Academy, Alibaba Group（阿里巴巴集团达摩院）；Hupan Lab（湖畔实验室）；Shengjing Hospital of China Medical University（中国医科大学附属盛京医院）；First Affiliated Hospital of Zhejiang University（浙江大学附属第一医院）
Liver Fibrosis Quantification and Analysis: The LiQA Dataset and Baseline Method
School of Data Science, Fudan University（复旦大学数据科学学院）；Institute of Medical Robotics, Shanghai Jiao Tong University（上海交通大学医疗机器人研究院）；Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University（复旦大学脑启发智能科学技术研究院）；Department of Radiology, Shanghai Public Health Clinical Center（上海公共卫生临床中心放射科）；Department of Computer Science, Information Technology University（信息技术大学计算机科学系）；Department of Computer Science, Lahore University of Management Sciences（拉合尔管理科学大学计算机科学系）
AMPLIFAI: A Multiphase CT Dataset for Benchmarking Clinical Reasoning in LI-RADS Assessment of Liver Lesions
University of Maryland, College Park（马里兰大学帕克分校）；University of Maryland School of Medicine（马里兰大学医学院）；University of Maryland Institute for Health Computing（马里兰大学健康计算研究所）；University of Maryland Medical System（马里兰大学医学系统）
Yale University（耶鲁大学）；Yale School of Medicine（耶鲁大学医学院）；University of Science and Technology of China（中国科学技术大学）；Suzhou Institute for Advanced Research, University of Science and Technology of China（中国科学技术大学苏州高等研究院）；Chinese Academy of Sciences（中国科学院）
Multimodal image registration has many applications in diagnostic medical imaging and image-guided interventions, such as Transcatheter Arterial Chemoembolization (TACE) of liver cancer guided by intraprocedural CBCT and pre-operative MR. The ability to register peri-procedurally acquired diagnostic images into the intraprocedural environment can potentially improve the intra-procedural tumor targeting, which will significantly improve therapeutic outcomes. However, the intra-procedural CBCT often suffers from suboptimal image quality due to lack of signal calibration for Hounsfield unit, limi…
Landmark-Free Preoperative-to-Intraoperative Registration in Laparoscopic Liver Resection
Center of Smart Health, School of Nursing, The Hong Kong Polytechnic University（智能健康中心、护理学院、香港理工大学）；Department of Computer Science and Engineering（计算机科学与工程系）；Institute of Medical Intelligence and XR（医学智能与XR研究所）；The Chinese University of Hong Kong（香港中文大学）；Division of Hepatobiliopancreatic Surgery, Department of General Surgery（肝胆胰外科 division, 外科部）
PAII Inc.（PAII公司）；The University of Texas at Arlington（德克萨斯大学阿灵顿分校）；University at Buffalo（纽约州立大学布法罗分校）；Chang Gung Memorial Hospital（长庚纪念医院）；PingAn Technology（平安科技）
Mask-based annotation of medical images, especially for 3D data, is a bottleneck in developing reliable machine learning models. Using minimal-labor user interactions (UIs) to guide the annotation is promising, but challenges remain on best harmonizing the mask prediction with the UIs. To address this, we propose the user-guided domain adaptation (UGDA) framework, which uses prediction-based adversarial domain adaptation (PADA) to model the combined distribution of UIs and mask predictions. The UIs are then used as anchors to guide and align the mask prediction. Importantly, UGDA can both lear…
PLUS: Plug-and-Play Enhanced Liver Lesion Diagnosis Model on Non-Contrast CT Scans
School of Biomedical Engineering, Tsinghua University（清华大学生物医学工程学院）；DAMO Academy, Alibaba Group（阿里集团达摩院）；Hupan Lab（汇看实验室）；Department of Radiology, Shengjing Hospital of China Medical University（中国医科大学附属盛京医院放射科）；Department of Hepatobiliary and Pancreatic Surgery, First Affiliated Hospital of Zhejiang University（浙江大学医学院附属第一医院肝胆外科）
Inria（法国国家信息与自动化研究所）；University of Strasbourg（斯特拉斯堡大学）；Technical University of Munich（慕尼黑技术大学）；University of Basel（巴塞尔大学）；Institute of Image-Guided Surgery（图像引导手术研究所）
Artificial Intelligence-Enhanced Couinaud Segmentation for Precision Liver Cancer Therapy
Stanford University（斯坦福大学）；University of Southern California（南加州大学）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Wake Forest University（维克森林大学）；Shandong Provincial Hospital Affiliated to Shandong First Medical University（山东第一医科大学附属山东省立医院）；Shandong First Medical University（山东第一医科大学）
Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Shenzhen Research Institute of Big Data（深圳市大数据研究院）
Accurate analysis of the fibrosis stage plays very important roles in follow-up of patients with chronic hepatitis B infection. In this paper, a deep learning framework is presented for automatically liver fibrosis prediction. On contrary of previous works, our approach can take use of the information provided by multiple ultrasound images. An indicator-guided learning mechanism is further proposed to ease the training of the proposed model. This follows the workflow of clinical diagnosis and make the prediction procedure interpretable. To support the training, a dataset is well-collected whic…
Center for Image Sciences, University Medical Center Utrecht, the Netherlands（荷兰乌得勒支大学医学中心影像科学中心）；Department of Radiology, University Medical Center Utrecht, the Netherlands（荷兰乌得勒支大学医学中心放射科）
Motion correction of dynamic contrast enhanced magnetic resonance images (DCE-MRI) is a challenging task, due to changes in image appearance. In this study a groupwise registration, using a principle component analysis (PCA) based metric,1 is evaluated for clinical DCE MRI of the liver. The groupwise registration transforms the images to a common space, rather than to a reference volume as conventional pairwise methods do, and computes the similarity metric on all volumes simultaneously. This groupwise registration method is compared to a pairwise approach using a mutual information metric. Cl…
How Far Has AI Come in Liver Fibrosis Staging? A Large-Scale Real-World Dataset and Benchmark
School of Data Science, Fudan University, Shanghai, China（复旦大学数据科学学院）；Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China（复旦大学上海公共卫生临床中心放射科）；Department of Electrical and Computer Engineering, Northwestern University, Evanston, USA（西北大学电气与计算机工程系）；Shanghai Key Laboratory of Flexible Medical Robotics, Tongren Hospital, Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China（上海柔性医疗机器人重点实验室）；School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China（上海交通大学生物医学工程学院）；School of Computer Science, University of Nottingham, Nottingham, UK（诺丁汉大学计算机科学学院）；Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China（上海交通大学生物医学工程学院医疗机器人研究所）；College of Computer Science and Technology, Huaqiao University, Xiamen, China（华侨大学计算机科学与技术学院）；School of Electronic Information (School of Artificial Intelligence), Northwest University, Xi'an, China（西北大学电子信息学院（人工智能学院））；Department of Mechanical Engineering, University College London, London, UK（伦敦大学学院机械工程系）；Institute of Neuroscience and Cardiovascular Research, University of Edinburgh, Edinburgh, UK（爱丁堡大学神经科学与心血管研究学院）；CAS Center for Excellence in Nanoscience, National Center for Nanoscience and Technology, Beijing, China（中国科学院纳米科学卓越中心）；School of Control Science and Engineering, Shandong University, Jinan, China（山东大学控制科学与工程学院）；School of Engineering, College of Engineering and Physical Sciences, University of Birmingham, Birmingham, UK（伯明翰大学工程学院）
Electron density maps must be accurately estimated to achieve valid dose calculation in MR-only radiotherapy. The goal of this study is to assess whether two deep learning models, the conditional generative adversarial network (cGAN) and the cycle-consistent generative adversarial network (cycleGAN), can generate accurate abdominal synthetic CT (sCT) images from 0.35T MR images for MR-only liver radiotherapy. A retrospective study was performed using CT images and 0.35T MR images of 12 patients with liver (n=8) and non-liver abdominal (n=4) cancer. CT images were deformably registered to the c…
Rutgers University（罗格斯大学）；Rutgers Robert Wood Johnson Medical School（罗格斯罗伯特·伍德·约翰逊医学院）
Non-alcoholic fatty liver disease (NAFLD) is one of the most common causes of chronic liver diseases (CLD) which can progress to liver cancer. The severity and treatment of NAFLD is determined by NAFLD Activity Scores (NAS)and liver fibrosis stage, which are usually obtained from liver biopsy. However, biopsy is invasive in nature and involves risk of procedural complications. Current methods to predict the fibrosis and NAS scores from noninvasive CT images rely heavily on either a large annotated dataset or transfer learning using pretrained networks. However, the availability of a large anno…
PAII Inc.（PAII公司）；The University of Texas at Arlington（德克萨斯大学阿灵顿分校）；Chang Gung Memorial Hospital（长庚纪念医院）；PingAn Technology（平安科技）
In medical imaging, organ/pathology segmentation models trained on current publicly available and fully-annotated datasets usually do not well-represent the heterogeneous modalities, phases, pathologies, and clinical scenarios encountered in real environments. On the other hand, there are tremendous amounts of unlabelled patient imaging scans stored by many modern clinical centers. In this work, we present a novel segmentation strategy, co-heterogenous and adaptive segmentation (CHASe), which only requires a small labeled cohort of single phase imaging data to adapt to any unlabeled cohort of …
Finding Reproducible and Prognostic Radiomic Features in Variable Slice Thickness Contrast Enhanced CT of Colorectal Liver Metastases
Islamic Azad University（伊斯兰阿扎德大学）；Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）；The University of Texas MD Anderson Cancer Center（德克萨斯大学 MD 安德森癌症中心）
Computer Science Dept. Rutgers University（罗格斯大学计算机科学系）；Division of Gastroenterology and Hepatology Rutgers Robert Wood Johnson Medical School（罗格斯罗伯特·伍德·约翰逊医学院胃肠病学和肝病学分部）
Non-Alcoholic Fatty Liver Disease (NAFLD) is becoming increasingly prevalent in the world population. Without diagnosis at the right time, NAFLD can lead to non-alcoholic steatohepatitis (NASH) and subsequent liver damage. The diagnosis and treatment of NAFLD depend on the NAFLD activity score (NAS) and the liver fibrosis stage, which are usually evaluated from liver biopsies by pathologists. In this work, we propose a novel method to automatically predict NAS score and fibrosis stage from CT data that is non-invasive and inexpensive to obtain compared with liver biopsy. We also present a meth…
GE Healthcare（通用电气医疗集团）；Memorial Sloan Kettering Cancer Center（纪念斯隆-凯特琳癌症中心）；Laboratoire de Mathématiques et Modélisation d’Évry（埃夫里数学与建模实验室）；Université de Paris（巴黎大学）
Partial shapes correspondences is a problem that often occurs in computer vision (occlusion, evolution in time...). In medical imaging, data may come from different modalities and be acquired under different conditions which leads to variations in shapes and topologies. In this paper we use an asymmetric data dissimilarity term applicable to various geometric shapes like sets of curves or surfaces, assessing the embedding of a shape into another one without relying on correspondences. It is designed as a data attachment for the Large Deformation Diffeomorphic Metric Mapping (LDDMM) framework, …
The Chinese University of Hong Kong（香港中文大学）；Philip Healthcare（飞利浦医疗）；Illuminatio Medical Technology Limited（Illuminatio医疗科技有限公司）
$T_{1ρ}$ mapping is a promising quantitative MRI technique for the non-invasive assessment of tissue properties. Learning-based approaches can map $T_{1ρ}$ from a reduced number of $T_{1ρ}$ weighted images, but requires significant amounts of high quality training data. Moreover, existing methods do not provide the confidence level of the $T_{1ρ}$ estimation. To address these problems, we proposed a self-supervised learning neural network that learns a $T_{1ρ}$ mapping using the relaxation constraint in the learning process. Epistemic uncertainty and aleatoric uncertainty are modelled for the …
T-CACE: A Time-Conditioned Autoregressive Contrast Enhancement Multi-Task Framework for Contrast-Free Liver MRI Synthesis, Segmentation, and Diagnosis
Department of Computer Science, Toronto Metropolitan University（计算机科学系，多伦多 Metropolitan 大学）；School of Biomedical Engineering, Western University（生物医学工程学院，西部大学）
University of California San Diego（加利福尼亚大学圣地亚哥分校）；University of California San Diego School of Medicine（加利福尼亚大学圣地亚哥分校医学院）
Augmented Reality is used in Image Guided surgery (AR IG) to fuse surgical landmarks from preoperative images into a video overlay. Physical simulation is essential to maintaining accurate position of the landmarks as surgery progresses and ensuring patient safety by avoiding accidental damage to vessels etc. In liver procedures, AR IG simulation accuracy is hampered by an inability to model stiffness variations unique to the patients disease. We introduce a novel method to account for patient specific stiffness variation based on Magnetic Resonance Elastography (MRE) data. To the best of our …
Automated surgical planning with nnU-Net: delineation of the anatomy in hepatobiliary phase MRI
The Netherlands Cancer Institute – Antoni van Leeuwenhoek（荷兰癌症研究所 – 安东尼·范·列文虎克）；National Center for Tumor Diseases (NCT), NCT/UCC Dresden（国家肿瘤疾病中心（NCT），NCT/UCC 德累斯顿）；DKFZ（德国癌症研究中心）；Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology（德累斯顿工业大学医学院及卡尔·古斯塔夫·卡鲁斯大学医院）；The Centre for Tactile Internet with Human-in-the-Loop (CeTI), TUD Dresden University of Technology（德累斯顿工业大学触觉互联网与人机协同中心）；University of Twente（特文特大学）
University College London（伦敦大学学院）；Oxford University Clinical Research Unit Vietnam（越南牛津大学临床研究组）；Mahidol Oxford Tropical Medicine Research Unit（玛希隆牛津热带医学研究组）；King’s College London（伦敦国王学院）
We present a Machine Learning (ML) study case to illustrate the challenges of clinical translation for a real-time AI-empowered echocardiography system with data of ICU patients in LMICs. Such ML case study includes data preparation, curation and labelling from 2D Ultrasound videos of 31 ICU patients in LMICs and model selection, validation and deployment of three thinner neural networks to classify apical four-chamber view. Results of the ML heuristics showed the promising implementation, validation and application of thinner networks to classify 4CV with limited datasets. We conclude this wo…
