Multi-Modal Active Learning for Automatic Liver Fibrosis Diagnosis based on Ultrasound Shear Wave Elastography
Shenzhen Research Institute of Big Data, the Chinese University of Hong Kong（香港中文大学深圳大数据研究院）；Huazhong University of Science and Technology（华中科技大学）；Shenzhen Third People’s Hospital（深圳市第三人民医院）
Lufei Gao, Ruisong Zhou, Changfeng Dong, Cheng Feng, Zhen Li, Xiang Wan, Li Liu
With the development of radiomics, noninvasive diagnosis like ultrasound (US) imaging plays a very important role in automatic liver fibrosis diagnosis (ALFD). Due to the noisy data, expensive annotations of US images, the application of Artificial Intelligence (AI) assisting approaches encounters a bottleneck. Besides, the use of mono-modal US data limits the further improve of the classification results. In this work, we innovatively propose a multi-modal fusion network with active learning (MMFN-AL) for ALFD to exploit the information of multiple modalities, eliminate the noisy data and reduce the annotation cost. Four image modalities including US and three types of shear wave elastography (SWEs) are exploited. A new dataset containing these modalities from 214 candidates is well-collected and pre-processed, with the labels obtained from the liver biopsy results. Experimental results show that our proposed method outperforms the state-of-the-art performance using less than 30% data, and by using only around 80% data, the proposed fusion network achieves high AUC 89.27% and accuracy 70.59%.
Multi-modal Liver Segmentation and Fibrosis Staging Using Real-world MRI Images
Multiscale X-ray Imaging (MXI) Lab, Department of Mechanical Engineering, University College London（多尺度X射线成像实验室，机械工程系，伦敦大学学院）；Centre for Clinical Brain Sciences, University of Edinburgh（临床脑科学中心，爱丁堡大学）；MRC Weatherall Institute of Molecular Medicine, University of Oxford（MRC韦伯尔分子医学研究所，牛津大学）
Rutgers University（罗格斯大学）；Rutgers Robert Wood Johnson Medical School（罗格斯罗伯特·伍德·约翰逊医学院）
Non-alcoholic fatty liver disease (NAFLD) is one of the most common causes of chronic liver diseases (CLD) which can progress to liver cancer. The severity and treatment of NAFLD is determined by NAFLD Activity Scores (NAS)and liver fibrosis stage, which are usually obtained from liver biopsy. However, biopsy is invasive in nature and involves risk of procedural complications. Current methods to predict the fibrosis and NAS scores from noninvasive CT images rely heavily on either a large annotated dataset or transfer learning using pretrained networks. However, the availability of a large anno…
Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；Shenzhen Research Institute of Big Data（深圳市大数据研究院）
Accurate analysis of the fibrosis stage plays very important roles in follow-up of patients with chronic hepatitis B infection. In this paper, a deep learning framework is presented for automatically liver fibrosis prediction. On contrary of previous works, our approach can take use of the information provided by multiple ultrasound images. An indicator-guided learning mechanism is further proposed to ease the training of the proposed model. This follows the workflow of clinical diagnosis and make the prediction procedure interpretable. To support the training, a dataset is well-collected whic…
Computer Science Dept. Rutgers University（罗格斯大学计算机科学系）；Division of Gastroenterology and Hepatology Rutgers Robert Wood Johnson Medical School（罗格斯罗伯特·伍德·约翰逊医学院胃肠病学和肝病学分部）
Non-Alcoholic Fatty Liver Disease (NAFLD) is becoming increasingly prevalent in the world population. Without diagnosis at the right time, NAFLD can lead to non-alcoholic steatohepatitis (NASH) and subsequent liver damage. The diagnosis and treatment of NAFLD depend on the NAFLD activity score (NAS) and the liver fibrosis stage, which are usually evaluated from liver biopsies by pathologists. In this work, we propose a novel method to automatically predict NAS score and fibrosis stage from CT data that is non-invasive and inexpensive to obtain compared with liver biopsy. We also present a meth…
PAII Inc.（PAII公司）；Chang Gung Memorial Hospital（长庚纪念医院）；Vanderbilt University（范德堡大学）；PingAn Technology（平安科技）
Ultrasound (US) is a critical modality for diagnosing liver fibrosis. Unfortunately, assessment is very subjective, motivating automated approaches. We introduce a principled deep convolutional neural network (CNN) workflow that incorporates several innovations. First, to avoid overfitting on non-relevant image features, we force the network to focus on a clinical region of interest (ROI), encompassing the liver parenchyma and upper border. Second, we introduce global heteroimage fusion (GHIF), which allows the CNN to fuse features from any arbitrary number of images in a study, increasing its…
Liver Fibrosis Quantification and Analysis: The LiQA Dataset and Baseline Method
School of Data Science, Fudan University（复旦大学数据科学学院）；Institute of Medical Robotics, Shanghai Jiao Tong University（上海交通大学医疗机器人研究院）；Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University（复旦大学脑启发智能科学技术研究院）；Department of Radiology, Shanghai Public Health Clinical Center（上海公共卫生临床中心放射科）；Department of Computer Science, Information Technology University（信息技术大学计算机科学系）；Department of Computer Science, Lahore University of Management Sciences（拉合尔管理科学大学计算机科学系）
Semi-supervised Liver Segmentation and Patch-based Fibrosis Staging with Registration-aided Multi-parametric MRI
1 Intelligent Modelling \& Analysis Group (IMA), 2 Lab for Uncertainty in Data；Decision Making (LUCID), \ of Computer Science, University of Nottingham, UK 3 Nottingham Biomedical Research Centre (BRC), \ of Medicine, University of Nottingham, UK；Intelligent Modelling \& Analysis Group (IMA), School of Computer Science, University of Nottingham, UK Lab for Uncertainty in Data；Decision Making (LUCID), School of Computer Science, University of Nottingham, UK Nottingham Biomedical Research Centre (BRC), School of Medicine, University of Nottingham, UK
Non-invasive Liver Fibrosis Screening on CT Images using Radiomics
University of Toronto（多伦多大学）；The Hospital for Sick Children（病童医院）；Vector Institute（矢量研究所）；University Health Network（大学健康网络）；Princess Margaret Cancer Centre（玛格丽特公主癌症中心）；Techna Institute（Techna研究所）
MERIT: Multi-view evidential learning for reliable and interpretable liver fibrosis staging
School of Data Science, Fudan University（复旦大学数据科学学院）；Shanghai Public Health Clinical Center, Fudan University（复旦大学附属公共卫生临床中心）；University of Oxford（牛津大学）；National Institute of Health Data Science, Peking University（北京大学健康数据科学研究院）；Institute of Medical Technology, Peking University（北京大学医学技术研究院）；State Key Laboratory of General Artificial Intelligence, Peking University（北京大学通用人工智能国家重点实验室）
How Far Has AI Come in Liver Fibrosis Staging? A Large-Scale Real-World Dataset and Benchmark
School of Data Science, Fudan University, Shanghai, China（复旦大学数据科学学院）；Department of Radiology, Shanghai Public Health Clinical Center, Fudan University, Shanghai, China（复旦大学上海公共卫生临床中心放射科）；Department of Electrical and Computer Engineering, Northwestern University, Evanston, USA（西北大学电气与计算机工程系）；Shanghai Key Laboratory of Flexible Medical Robotics, Tongren Hospital, Institute of Medical Robotics, Shanghai Jiao Tong University, Shanghai, China（上海柔性医疗机器人重点实验室）；School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China（上海交通大学生物医学工程学院）；School of Computer Science, University of Nottingham, Nottingham, UK（诺丁汉大学计算机科学学院）；Institute of Medical Robotics, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China（上海交通大学生物医学工程学院医疗机器人研究所）；College of Computer Science and Technology, Huaqiao University, Xiamen, China（华侨大学计算机科学与技术学院）；School of Electronic Information (School of Artificial Intelligence), Northwest University, Xi'an, China（西北大学电子信息学院（人工智能学院））；Department of Mechanical Engineering, University College London, London, UK（伦敦大学学院机械工程系）；Institute of Neuroscience and Cardiovascular Research, University of Edinburgh, Edinburgh, UK（爱丁堡大学神经科学与心血管研究学院）；CAS Center for Excellence in Nanoscience, National Center for Nanoscience and Technology, Beijing, China（中国科学院纳米科学卓越中心）；School of Control Science and Engineering, Shandong University, Jinan, China（山东大学控制科学与工程学院）；School of Engineering, College of Engineering and Physical Sciences, University of Birmingham, Birmingham, UK（伯明翰大学工程学院）
Label-Efficient Cross-Modality Generalization for Liver Segmentation in Multi-Phase MRI
Ho Chi Minh University of Science（胡志明科技大学）；National Central University（国立中央大学）；Carnegie Mellon University（卡内基梅隆大学）；University of Houston（休斯顿大学）；Northwestern University（西北大学）
Università degli Studi di Genova（热那亚大学）；IRCCS San Martino Hospital（IRCCS圣马蒂诺医院）
Due to the need for quick and effective treatments for liver diseases, which are among the most common health problems in the world, staging fibrosis through non-invasive and economic methods has become of great importance. Taking inspiration from diagnostic laparoscopy, used in the past for hepatic diseases, in this paper ultrasound images of the liver are studied, focusing on a specific region of the organ where the Glisson's capsule is visible. In ultrasound images, the Glisson's capsule appears in the shape of a line which can be extracted via classical methods in literature. By making use…
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；University of Chinese Academy of Sciences（中国科学院大学）；Shandong University（山东大学）；Beijing University of Chinese Medicine（北京中医药大学）
University of California San Diego（加利福尼亚大学圣地亚哥分校）；University of California San Diego School of Medicine（加利福尼亚大学圣地亚哥分校医学院）
Augmented Reality is used in Image Guided surgery (AR IG) to fuse surgical landmarks from preoperative images into a video overlay. Physical simulation is essential to maintaining accurate position of the landmarks as surgery progresses and ensuring patient safety by avoiding accidental damage to vessels etc. In liver procedures, AR IG simulation accuracy is hampered by an inability to model stiffness variations unique to the patients disease. We introduce a novel method to account for patient specific stiffness variation based on Magnetic Resonance Elastography (MRE) data. To the best of our …
