The importance of radiomics features for predicting patient outcome is now well-established. Early study of prognostic features can lead to a more efficient treatment personalisation. For this reason new radiomics features obtained through mathematical morphology-based operations are proposed. Their study is conducted on an open database of patients suffering from Nonsmall Cells Lung Carcinoma (NSCLC). The tumor features are extracted from the CT images and analyzed via PCA and a Kaplan-Meier survival analysis in order to select the most relevant ones. Among the 1,589 studied features, 32 are found relevant to predict patient survival: 27 classical radiomics features and five MM features (including both granularity and morphological covariance features). These features will contribute towards the prognostic models, and eventually to clinical decision making and the course of treatment for patients.
Herein we propose a deep learning-based approach for the prediction of lung lesion response based on radiomic features extracted from clinical CT scans of patients in non-small cell lung cancer trials. The approach starts with the classification of lung lesions from the set of primary and metastatic lesions at various anatomic locations. Focusing on the lung lesions, we perform automatic segmentation to extract their 3D volumes. Radiomic features are then extracted from the lesion on the pre-treatment scan and the first follow-up scan to predict which lesions will shrink at least 30% in diamet…
University of Toronto（多伦多大学）；Lunenfeld-Tanenbaum Research Institute, Sinai Health System（西奈卫生系统卢嫩菲尔德-塔南鲍姆研究所）；McMaster University（麦克马斯特大学）；Hamilton Health Sciences（汉密尔顿健康科学中心）；Sunnybrook Health Sciences Centre（桑尼布鲁克健康科学中心）；Sunnybrook Research Institute（桑尼布鲁克研究所）
As an analytic pipeline for quantitative imaging feature extraction and analysis, radiomics has grown rapidly in the past a few years. Recent studies in radiomics aim to investigate the relationship between tumors imaging features and clinical outcomes. Open source radiomics feature banks enable the extraction and analysis of thousands of predefined features. On the other hand, recent advances in deep learning have shown significant potential in the quantitative medical imaging field, raising the research question of whether predefined radiomics features have predictive information in addition…
Bahria University（巴赫里亚大学）；National University of Science and Technology（国立科学技术大学）
Machine learning methods with quantitative imaging features integration have recently gained a lot of attention for lung nodule classification. However, there is a dearth of studies in the literature on effective features ranking methods for classification purpose. Moreover, optimal number of features required for the classification task also needs to be evaluated. In this study, we investigate the impact of supervised and unsupervised feature selection techniques on machine learning methods for nodule classification in Computed Tomography (CT) images. The research work explores the classifica…
Finding Reproducible and Prognostic Radiomic Features in Variable Slice Thickness Contrast Enhanced CT of Colorectal Liver Metastases
Islamic Azad University（伊斯兰阿扎德大学）；Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）；The University of Texas MD Anderson Cancer Center（德克萨斯大学 MD 安德森癌症中心）
Thomas Jefferson University Hospital（托马斯·杰斐逊大学医院）；Georgia Institute of Technology（佐治亚理工学院）；Memorial Sloan Kettering Cancer Center（纪念斯隆·凯特琳癌症中心）
Spiculations/lobulations, sharp/curved spikes on the surface of lung nodules, are good predictors of lung cancer malignancy and hence, are routinely assessed and reported by radiologists as part of the standardized Lung-RADS clinical scoring criteria. Given the 3D geometry of the nodule and 2D slice-by-slice assessment by radiologists, manual spiculation/lobulation annotation is a tedious task and thus no public datasets exist to date for probing the importance of these clinically-reported features in the SOTA malignancy prediction algorithms. As part of this paper, we release a large-scale Cl…
IEO European Institute of Oncology IRCCS（IEO欧洲肿瘤研究所IRCCS）；Technical University of Munich（慕尼黑工业大学）；University of Milan（米兰大学）；Istituto Imaging della Svizzera Italiana (IIMSI)（瑞士意大利语区成像研究所（IIMSI））；Università della Svizzera italiana（瑞士意大利语区大学）；Bern University Hospital（伯尔尼大学医院）；University of Bern（伯尔尼大学）
Lesion segmentation is a crucial step of the radiomic workflow. Manual segmentation requires long execution time and is prone to variability, impairing the realisation of radiomic studies and their robustness. In this study, a deep-learning automatic segmentation method was applied on computed tomography images of non-small-cell lung cancer patients. The use of manual vs automatic segmentation in the performance of survival radiomic models was assessed, as well. METHODS A total of 899 NSCLC patients were included (2 proprietary: A and B, 1 public datasets: C). Automatic segmentation of lung le…
Identifying image features that are robust with respect to segmentation variability and domain shift is a tough challenge in radiomics. So far, this problem has mainly been tackled in test-retest analyses. In this work we analyze radiomics feature stability based on probabilistic segmentations. Based on a public lung cancer dataset, we generate an arbitrary number of plausible segmentations using a Probabilistic U-Net. From these segmentations, we extract a high number of plausible feature vectors for each lung tumor and analyze feature variance with respect to the segmentations. Our results s…
Adaptive Fusion of Radiomics and Deep Features for Lung Adenocarcinoma Subtype Recognition
Renmin University of China（中国人民大学）；Capital Medical University（首都医科大学）；Beijing Chao-Yang Hospital（北京朝阳医院）；Beijing Institute of Respiratory Medicine（北京呼吸疾病研究所）
Maastricht University Medical Centre+（马斯特里赫特大学医学中心+）；GROW School for Oncology and Developmental Biology（GROW肿瘤学与发育生物学学院）
Early diagnosis of lung cancer is a key intervention for the treatment of lung cancer computer aided diagnosis (CAD) can play a crucial role. However, most published CAD methods treat lung cancer diagnosis as a lung nodule classification problem, which does not reflect clinical practice, where clinicians diagnose a patient based on a set of images of nodules, instead of one specific nodule. Besides, the low interpretability of the output provided by these methods presents an important barrier for their adoption. In this article, we treat lung cancer diagnosis as a multiple instance learning (M…
Incremental Value and Interpretability of Radiomics Features of Both Lung and Epicardial Adipose Tissue for Detecting the Severity of COVID-19 Infection
School of Computer and Communication Engineering, Zhengzhou University of Light Industry（郑州轻工业大学计算机与通信工程学院）；Universidade Federal Fluminense（弗鲁米嫩塞联邦大学）；DASA Complexo Hospitalar de Niterói（达萨尼泰罗伊医院综合体）；Michigan Technological University（密歇根理工大学）；Zhongshan Hospital, Fudan University（复旦大学附属中山医院）；Shanghai Institute of Cardiovascular Diseases（上海市心血管病研究所）；National Clinical Research Center for Interventional Medicine（国家介入医学临床研究中心）；Center for Biocomputing and Digital Health, Institute of Computing and Cybersystems, and Health Research Institute, Michigan Technological University（密歇根理工大学生物计算与数字健康中心、计算与网络系统研究所及健康研究所）
Magnetic resonance delta radiomics to track radiation response in lung tumors receiving stereotactic MRI-guided radiotherapy
Mass General Brigham（麻省总医院布里格姆医疗系统）；Harvard Medical School（哈佛医学院）；Dana-Farber Cancer Institute（丹娜-法伯癌症研究所）；Harvard T.H. Chan School of Public Health（哈佛大学陈曾熙公共卫生学院）；Maastricht University（马斯特里赫特大学）
University of Toronto（多伦多大学）；Lunenfeld-Tanenbaum Research Institute（卢嫩菲尔德-塔南鲍姆研究所）；Sinai Health System（西奈健康系统）；McMaster University（麦克马斯特大学）；Hamilton Health Sciences（汉密尔顿健康科学）；Juravinski Hospital and Cancer Centre（朱拉文斯基医院及癌症中心）；Sunnybrook Health Sciences Centre（桑尼布鲁克健康科学中心）；Sunnybrook Research Institute（桑尼布鲁克研究所）
Pancreatic Ductal Adenocarcinoma (PDAC) is one of the most aggressive cancers with an extremely poor prognosis. Radiomics has shown prognostic ability in multiple types of cancer including PDAC. However, the prognostic value of traditional radiomics pipelines, which are based on hand-crafted radiomic features alone is limited. Convolutional neural networks (CNNs) have been shown to outperform these feature-based models in computer vision tasks. However, training a CNN from scratch needs a large sample size which is not feasible in most medical imaging studies. As an alternative solution, CNN-b…
University of Maryland Baltimore County（马里兰大学巴尔的摩县分校）
We present a hybrid algorithm to estimate lung nodule malignancy that combines imaging biomarkers from Radiologist's annotation with image classification of CT scans. Our algorithm employs a 3D Convolutional Neural Network (CNN) as well as a Random Forest in order to combine CT imagery with biomarker annotation and volumetric radiomic features. We analyze and compare the performance of the algorithm using only imagery, only biomarkers, combined imagery + biomarkers, combined imagery + volumetric radiomic features and finally the combination of imagery + biomarkers + volumetric features in orde…
Southern Medical University（南方医科大学）；LaTIM（拉蒂姆实验室）；INSERM（法国国家健康与医学研究院）；Univ Brest（布雷斯特大学）；Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院北京协和医学院）
Automatic segmentation of head and neck cancer (HNC) tumors and lymph nodes plays a crucial role in the optimization treatment strategy and prognosis analysis. This study aims to employ nnU-Net for automatic segmentation and radiomics for recurrence-free survival (RFS) prediction using pretreatment PET/CT images in multi-center HNC cohort. A multi-center HNC dataset with 883 patients (524 patients for training, 359 for testing) was provided in HECKTOR 2022. A bounding box of the extended oropharyngeal region was retrieved for each patient with fixed size of 224 x 224 x 224 $mm^{3}$. Then 3D nn…
The University of Sydney（悉尼大学）；Shanghai Jiao Tong University（上海交通大学）
Outcome prediction is crucial for head and neck cancer patients as it can provide prognostic information for early treatment planning. Radiomics methods have been widely used for outcome prediction from medical images. However, these methods are limited by their reliance on intractable manual segmentation of tumor regions. Recently, deep learning methods have been proposed to perform end-to-end outcome prediction so as to remove the reliance on manual segmentation. Unfortunately, without segmentation masks, these methods will take the whole image as input, such that makes them difficult to foc…
Università degli Studi di Milano（米兰大学）；ASST Grande Ospedale Metropolitano Niguarda（ASST 大都会大医院尼瓜达）；INFN Sezione di Milano（意大利国家核物理研究院米兰分部）
Purpose: to optimize a pipeline of clinical data gathering and CT images processing implemented during the COVID-19 pandemic crisis and to develop artificial intelligence model for different of viral pneumonia. Methods: 1028 chest CT image of patients with positive swab were segmented automatically for lung extraction. A Gaussian model developed in Python language was applied to calculate quantitative metrics (QM) describing well-aerated and ill portions of the lungs from the histogram distribution of lung CT numbers in both lungs of each image and in four geometrical subdivision. Furthermore,…
University of Toronto（多伦多大学）；Princess Margaret Cancer Centre（玛格丽特公主癌症中心）；TECHNA Institute（TECHNA研究所）
Accurate prognosis for an individual patient is a key component of precision oncology. Recent advances in machine learning have enabled the development of models using a wider range of data, including imaging. Radiomics aims to extract quantitative predictive and prognostic biomarkers from routine medical imaging, but evidence for computed tomography radiomics for prognosis remains inconclusive. We have conducted an institutional machine learning challenge to develop an accurate model for overall survival prediction in head and neck cancer using clinical data etxracted from electronic medical …
Maastricht University Medical Centre+（马斯特里赫特大学医学中心+）
Radiomics is an active area of research focusing on high throughput feature extraction from medical images with a wide array of applications in clinical practice, such as clinical decision support in oncology. However, noise in low dose computed tomography (CT) scans can impair the accurate extraction of radiomic features. In this article, we investigate the possibility of using deep learning generative models to improve the performance of radiomics from low dose CTs. We used two datasets of low dose CT scans -NSCLC Radiogenomics and LIDC-IDRI - as test datasets for two tasks - pre-treatment s…
Fudan University Shanghai Cancer Center（复旦大学附属肿瘤医院）；Shanghai Medical College, Fudan University（复旦大学上海医学院）；Fudan University（复旦大学）；Shanghai Engineering Research Center of Molecular Imaging Probes（上海分子影像探针工程技术研究中心）；Key Laboratory of Nuclear Physics and Ion-beam Application (MOE), Fudan University（复旦大学核物理与离子束应用教育部重点实验室）；the University of Sydney（悉尼大学）；Shanghai Proton and Heavy Ion Center（上海市质子重离子医院）
Objective: Deep Learning-based Radiomics (DLR) has achieved great success in medical image analysis and has been considered a replacement for conventional radiomics that relies on handcrafted features. In this study, we aimed to explore the capability of DLR for the prediction of 5-year Progression-Free Survival (PFS) in Nasopharyngeal Carcinoma (NPC) using pretreatment PET/CT. Methods: A total of 257 patients (170/87 in internal/external cohorts) with advanced NPC (TNM stage III or IVa) were enrolled. We developed an end-to-end multi-modality DLR model, in which a 3D convolutional neural netw…
Northeastern University（东北大学）；Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education（教育部医学影像智能计算重点实验室）；Key Laboratory of Data Analytics and Optimization for Smart Industry, Northeastern University（东北大学流程工业综合自动化国家重点实验室）；the First Affiliated Hospital of China Medical University（中国医科大学附属第一医院）；Shenzhen College of Advanced Technology, University of the Chinese Academy of Sciences（中国科学院大学深圳先进技术学院）；Liaoning Cancer Hospital and Institute, Cancer Hospital of China Medical University（中国医科大学肿瘤医院辽宁省肿瘤医院）
The feature extraction methods of radiomics are mainly based on static tomographic images at a certain moment, while the occurrence and development of disease is a dynamic process that cannot be fully reflected by only static characteristics. This study proposes a new dynamic radiomics feature extraction workflow that uses time-dependent tomographic images of the same patient, focuses on the changes in image features over time, and then quantifies them as new dynamic features for diagnostic or prognostic evaluation. We first define the mathematical paradigm of dynamic radiomics and introduce t…
This paper proposes to use deep radiomic features (DRFs) from a convolutional neural network (CNN) to model fine-grained texture signatures in the radiomic analysis of recurrent glioblastoma (rGBM). We use DRFs to predict survival of rGBM patients with preoperative T1-weighted post-contrast MR images (n=100). DRFs are extracted from regions of interest labelled by a radiation oncologist and used to compare between short-term and long-term survival patient groups. Random forest (RF) classification is employed to predict survival outcome (i.e., short or long survival), as well as to identify hig…
Median Technologies（Median科技公司）；Univ. Artois（阿图瓦大学）
Pathologies systematically induce morphological changes, thus providing a major but yet insufficiently quantified source of observables for diagnosis. The study develops a predictive model of the pathological states based on morphological features (3D-morphomics) on Computed Tomography (CT) volumes. A complete workflow for mesh extraction and simplification of an organ's surface is developed, and coupled with an automatic extraction of morphological features given by the distribution of mean curvature and mesh energy. An XGBoost supervised classifier is then trained and tested on the 3D-morpho…
University of Technology Sydney（悉尼科技大学）；University of Sydney（悉尼大学）；Australian Artificial Intelligence Institute（澳大利亚人工智能研究所）
Lung cancer is the leading cause of cancer death worldwide. The critical reason for the deaths is delayed diagnosis and poor prognosis. With the accelerated development of deep learning techniques, it has been successfully applied extensively in many real-world applications, including health sectors such as medical image interpretation and disease diagnosis. By combining more modalities that being engaged in the processing of information, multimodal learning can extract better features and improve predictive ability. The conventional methods for lung cancer survival analysis normally utilize c…
Shanghai Jiao Tong University（上海交通大学）；Shanghai Institute for Advanced Communication and Data Science（上海先进通信与数据科学研究院）
Radiomics analysis has achieved great success in recent years. However, conventional Radiomics analysis suffers from insufficiently expressive hand-crafted features. Recently, emerging deep learning techniques, e.g., convolutional neural networks (CNNs), dominate recent research in Computer-Aided Diagnosis (CADx). Unfortunately, as black-box predictors, we argue that CNNs are "diagnosing" voxels (or pixels), rather than lesions; in other words, visual saliency from a trained CNN is not necessarily concentrated on the lesions. On the other hand, classification in clinical applications suffers f…
EMeRALDS: Electronic Medical Record Driven Automated Lung Nodule Detection and Classification in Thoracic CT Images
Faculty of Electrical and Electronics Engineering, University of Engineering（电气电子工程学院，工程大学）；Department of Engineering Sciences, University of Agder（工程科学系，阿格德大学）；Sheikh Zayed Institute for Pediatric Surgical Innovation, Children’s National Hospital（谢赫扎耶德小儿外科创新研究所，儿童医院）；School of Medicine and Health Sciences, George Washington University（医学与健康科学学院，乔治华盛顿大学）
Unraveling Radiomics Complexity: Strategies for Optimal Simplicity in Predictive Modeling
Université de Sherbrooke（谢布鲁克大学）；OncoRay – National Center for Radiation Research in Oncology, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Helmholtz-Zentrum Dresden-Rossendorf（德累斯顿工业大学卡尔·古斯塔夫·卡鲁斯医学院及大学医院OncoRay肿瘤放射研究国家中心，德累斯顿-罗森多夫亥姆霍兹研究中心）；Cedars-Sinai Medical Center（西达赛奈医疗中心）；University of California San Francisco（加利福尼亚大学旧金山分校）；Stanford University（斯坦福大学）
University of Iowa（爱荷华大学）；Stanford University（斯坦福大学）
Non-small-cell lung cancer (NSCLC) represents approximately 80-85% of lung cancer diagnoses and is the leading cause of cancer-related death worldwide. Recent studies indicate that image-based radiomics features from positron emission tomography-computed tomography (PET/CT) images have predictive power on NSCLC outcomes. To this end, easily calculated functional features such as the maximum and the mean of standard uptake value (SUV) and total lesion glycolysis (TLG) are most commonly used for NSCLC prognostication, but their prognostic value remains controversial. Meanwhile, convolutional neu…
University of Toronto（多伦多大学）；Lunenfeld-Tanenbaum Research Institute, Sinai Health System（西奈卫生系统卢嫩菲尔德-塔南鲍姆研究所）；McMaster University（麦克马斯特大学）；Hamilton Health Sciences（汉密尔顿健康科学中心）；Sunnybrook Health Sciences Centre（桑尼布鲁克健康科学中心）；Sunnybrook Research Institute（桑尼布鲁克研究所）
Cox proportional hazard model (CPH) is commonly used in clinical research for survival analysis. In quantitative medical imaging (radiomics) studies, CPH plays an important role in feature reduction and modeling. However, the underlying linear assumption of CPH model limits the prognostic performance. In addition, the multicollinearity of radiomic features and multiple testing problem further impedes the CPH models performance. In this work, using transfer learning, a convolutional neural network (CNN) based survival model was built and tested on preoperative CT images of resectable Pancreatic…
University of Sydney（悉尼大学）；Fudan University（复旦大学）；Fudan University Shanghai Cancer Center（复旦大学附属肿瘤医院）
Nasopharyngeal Carcinoma (NPC) is a malignant epithelial cancer arising from the nasopharynx. Survival prediction is a major concern for NPC patients, as it provides early prognostic information to plan treatments. Recently, deep survival models based on deep learning have demonstrated the potential to outperform traditional radiomics-based survival prediction models. Deep survival models usually use image patches covering the whole target regions (e.g., nasopharynx for NPC) or containing only segmented tumor regions as the input. However, the models using the whole target regions will also in…
The concept of tumor field effect implies that cancer is a systemic disease with its impact way beyond the visible tumor confines. For instance, in Glioblastoma (GBM), an aggressive brain tumor, the increase in intracranial pressure due to tumor burden often leads to brain herniation and poor outcomes. Our work is based on the rationale that highly aggressive tumors tend to grow uncontrollably, leading to pronounced biomechanical tissue deformations in the normal parenchyma, which when combined with local morphological differences in the tumor confines on MRI scans, will comprehensively captur…
The Ohio State University College of Medicine（俄亥俄州立大学医学院）
Consistency and duplicability in Computed Tomography (CT) output is essential to quantitative imaging for lung cancer detection and monitoring. This study of CT-detected lung nodules investigated the reproducibility of volume-, density-, and texture-based features (outcome variables) over routine ranges of radiation-dose, reconstruction kernel, and slice thickness. CT raw data of 23 nodules were reconstructed using 320 acquisition/reconstruction conditions (combinations of 4 doses, 10 kernels, and 8 thicknesses). Scans at 12.5%, 25%, and 50% of protocol dose were simulated; reduced-dose and fu…
Perelman School of Medicine, University of Pennsylvania（宾夕法尼亚大学佩雷尔曼医学院）
Purpose: To utilize high-resolution quantitative CT (QCT) imaging features for prediction of diagnosis and prognosis in fibrosing interstitial lung diseases (ILD). Approach: 40 ILD patients (20 usual interstitial pneumonia (UIP), 20 non-UIP pattern ILD) were classified by expert consensus of 2 radiologists and followed for 7 years. Clinical variables were recorded. Following segmentation of the lung field, a total of 26 texture features were extracted using a lattice-based approach (TM model). The TM model was compared with previously histogram-based model (HM) for their abilities to classify …
General Electric Healthcare（通用电气医疗集团）；University of Rouen（鲁昂大学）；Centre Henri Becquerel（亨利·贝克勒尔中心）
Background and Objectives: Predicting patient response to treatment and survival in oncology is a prominent way towards precision medicine. To that end, radiomics was proposed as a field of study where images are used instead of invasive methods. The first step in radiomic analysis is the segmentation of the lesion. However, this task is time consuming and can be physician subjective. Automated tools based on supervised deep learning have made great progress to assist physicians. However, they are data hungry, and annotated data remains a major issue in the medical field where only a small sub…
The performance of a computer-aided automated diagnosis system of lung cancer from Computed Tomography (CT) volumetric images greatly depends on the accurate detection and segmentation of tumor regions. In this paper, we present Recurrent 3D-DenseUNet, a novel deep learning based architecture for volumetric lung tumor segmentation from CT scans. The proposed architecture consists of a 3D encoder block that learns to extract fine-grained spatial and coarse-grained temporal features, a recurrent block of multiple Convolutional Long Short-Term Memory (ConvLSTM) layers to extract fine-grained spat…
Stony Brook University（石溪大学）；Newark Beth Israel Medical Center（纽瓦克贝斯以色列医疗中心）；University Hospitals Cleveland Medical Center（克利夫兰大学医院医疗中心）
Well-labeled datasets of chest radiographs (CXRs) are difficult to acquire due to the high cost of annotation. Thus, it is desirable to learn a robust and transferable representation in an unsupervised manner to benefit tasks that lack labeled data. Unlike natural images, medical images have their own domain prior; e.g., we observe that many pulmonary diseases, such as the COVID-19, manifest as changes in the lung tissue texture rather than the anatomical structure. Therefore, we hypothesize that studying only the texture without the influence of structure variations would be advantageous for …
Concordia University（康考迪亚大学）；Concordia Institute for Information Systems Engineering（康考迪亚信息系统工程研究所）；Sunnybrook Health Sciences Centre（桑尼布鲁克健康科学中心）；University of Toronto（多伦多大学）
The paper proposes a novel hybrid discovery Radiomics framework that simultaneously integrates temporal and spatial features extracted from non-thin chest Computed Tomography (CT) slices to predict Lung Adenocarcinoma (LUAC) malignancy with minimum expert involvement. Lung cancer is the leading cause of mortality from cancer worldwide and has various histologic types, among which LUAC has recently been the most prevalent. LUACs are classified as pre-invasive, minimally invasive, and invasive adenocarcinomas. Timely and accurate knowledge of the lung nodules malignancy leads to a proper treatme…
Concordia Institute for Information Systems Engineering, Concordia University（康考迪亚大学信息系统工程研究所）；Sunnybrook Health Sciences Centre, University of Toronto（多伦多大学桑尼布鲁克健康科学中心）；McGill University Health Center- Research Institute（麦吉尔大学健康中心研究所）；Babak Imaging Center（巴布克影像中心）；Department of Electrical and Computer Engineering, University of Toronto（多伦多大学电气与计算机工程系）
Lung diseases including infections such as Pneumonia, Tuberculosis, and novel Coronavirus (COVID-19), together with Lung Cancer are significantly widespread and are, typically, considered life threatening. In particular, lung cancer is among the most common and deadliest cancers with a low 5-year survival rate. Timely diagnosis of lung cancer is, therefore, of paramount importance as it can save countless lives. In this regard, deep learning radiomics solutions have the promise of extracting the most useful features on their own in an end-to-end fashion without having access to the annotated b…
We proposed a fully automatic workflow for glioblastoma (GBM) survival prediction using deep learning (DL) methods. 285 glioma (210 GBM, 75 low-grade glioma) patients were included. 163 of the GBM patients had overall survival (OS) data. Every patient had four pre-operative MR scans and manually drawn tumor contours. For automatic tumor segmentation, a 3D convolutional neural network (CNN) was trained and validated using 122 glioma patients. The trained model was applied to the remaining 163 GBM patients to generate tumor contours. The handcrafted and DL-based radiomic features were extracted …
Stony Brook University（石溪大学）；Newark Beth Israel Medical Center（纽瓦克贝丝以色列医疗中心）
COVID-19 image analysis has mostly focused on diagnostic tasks using single timepoint scans acquired upon disease presentation or admission. We present a deep learning-based approach to predict lung infiltrate progression from serial chest radiographs (CXRs) of COVID-19 patients. Our method first utilizes convolutional neural networks (CNNs) for feature extraction from patches within the concerned lung zone, and also from neighboring and remote boundary regions. The framework further incorporates a multi-scale Gated Recurrent Unit (GRU) with a correlation module for effective predictions. The …
University of Toronto（多伦多大学）；Sunnybrook Research Institute（森尼布鲁克研究所）
Cancer stage is a large determinant of patient prognosis and management in many cancer types, and is often assessed using medical imaging modalities, such as CT and MRI. These medical images contain rich information that can be explored to stratify patients within each stage group to further improve prognostic algorithms. Although the majority of cancer deaths result from metastatic and multifocal disease, building imaging biomarkers for patients with multiple tumors has been a challenging task due to the lack of annotated datasets and standard study framework. In this paper, we process two pu…
Guilin University of Electronic Technology（桂林电子科技大学）；McGill University（麦吉尔大学）；Lady Davis Institute for Medical Research（戴维斯夫人医学研究所）
Radiomics has shown a capability for different types of cancers such as glioma to predict the clinical outcome. It can have a non-invasive means of evaluating the immunotherapy response prior to treatment. However, the use of deep convolutional neural networks (CNNs)-based radiomics requires large training image sets. To avoid this problem, we investigate a new imaging features that model distribution with a Gaussian mixture model (GMM) of learned 3D CNN features. Using these deep radiomic features (DRFs), we aim to predict the immune marker status (low versus high) and overall survival for gl…
MMFusion: Multi-modality Diffusion Model for Lymph Node Metastasis Diagnosis in Esophageal Cancer
Shandong University（山东大学）；Hangzhou Dianzi University（杭州电子科技大学）；Communication University of Zhejiang（浙江传媒学院）；University of Leicester（莱斯特大学）；Sichuan Cancer Hospital and Institution（四川省肿瘤医院）；Sichuan Cancer Center（四川省癌症中心）；University of Electronic Science and Technology of China（电子科技大学）；Suzhou Research Institute of Shandong University（山东大学苏州研究院）
For most if not all cancers, prognosis is of significant importance, and extensive modeling research has been conducted. With the genetic nature of cancer, in the past two decades, multiple types of molecular data (such as gene expressions and DNA mutations) have been explored. More recently, histopathological imaging data, which is routinely collected in biopsy, has been shown as informative for modeling prognosis. In this study, using the TCGA LUAD and LUSC data as a showcase, we examine and compare modeling lung cancer overall survival using gene expressions versus histopathological imaging…
Biomedical Imaging Research Institute, Cedars-Sinai Medical Center（西达赛奈医学中心生物医学成像研究所）；Cedars-Sinai Medical Center（西达赛奈医学中心）；Semmelweis University（塞梅尔维斯大学）；Azienda Ospedaliero-Universitaria di Parma（帕尔马大学医院）；Monash Health（莫纳什医疗中心）；Centro Cardiologico Monzino IRCCS, University of Milan（米兰大学蒙齐诺心脏中心IRCCS）；Showa University School of Medicine（昭和大学医学院）
Quantitative lung measures derived from computed tomography (CT) have been demonstrated to improve prognostication in coronavirus disease (COVID-19) patients, but are not part of the clinical routine since required manual segmentation of lung lesions is prohibitively time-consuming. We propose a new fully automated deep learning framework for rapid quantification and differentiation between lung lesions in COVID-19 pneumonia from both contrast and non-contrast CT images using convolutional Long Short-Term Memory (ConvLSTM) networks. Utilizing the expert annotations, model training was performe…
Rensselaer Polytechnic Institute（伦斯勒理工学院）；Massachusetts General Hospital（麻省总医院）；Harvard Medical School（哈佛医学院）；Firoozgar Hospital（菲鲁兹加尔医院）；Iran University of Medical Sciences（伊朗医科大学）；Azienda Ospedaliero-universitaria di Cagliari（卡利亚里大学医院）
While image analysis of chest computed tomography (CT) for COVID-19 diagnosis has been intensively studied, little work has been performed for image-based patient outcome prediction. Management of high-risk patients with early intervention is a key to lower the fatality rate of COVID-19 pneumonia, as a majority of patients recover naturally. Therefore, an accurate prediction of disease progression with baseline imaging at the time of the initial presentation can help in patient management. In lieu of only size and volume information of pulmonary abnormalities and features through deep learning…
Hunting imaging biomarkers in pulmonary fibrosis: Benchmarks of the AIIB23 challenge
Imperial College London（帝国理工学院）；Royal Brompton Hospital（皇家布朗普顿医院）；University of Parma（帕尔马大学）；Shanghai MicroPort MedBot (Group) Co., Ltd.（上海微创医疗机器人（集团）股份有限公司）；Shanghai United Imaging Intelligence Co., Ltd.（上海联影智能医疗科技有限公司）；Shanghai Jiao Tong University（上海交通大学）；Fudan University（复旦大学）；Cambridge International Exam Centre in Shanghai Experimental School（上海实验学校剑桥国际考试中心）；InferVision Medical Technology Co., Ltd.（推想医疗科技股份有限公司）；Shanghai MediWorks Precision Instruments Co., Ltd（上海美沃克斯精密仪器有限公司）；Sanmed Biotech Ltd.（三曼生物科技有限公司）；University of Cambridge（剑桥大学）；University of Palermo（巴勒莫大学）；IRCCS Istituto delle Scienze Neurologiche di Bologna（IRCCS博洛尼亚神经科学研究所）；Istituto Italiano di Tecnologia（意大利技术研究院）；University of Oxford（牛津大学）；Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；INSA Rouen Normandie（鲁昂国立应用科学学院）；Univ Rouen Normandie（鲁昂诺曼底大学）；Université Le Havre Normandie（勒阿弗尔诺曼底大学）；Henri Becquerel Cancer Center（亨利·贝克勒尔癌症中心）；Wake Forest University School of Medicine（维克森林大学医学院）；University College London（伦敦大学学院）；King's College London（伦敦国王学院）
