Breast cancer was diagnosed for over 7.8 million women between 2015 to 2020. Grading plays a vital role in breast cancer treatment planning. However, the current tumor grading method involves extracting tissue from patients, leading to stress, discomfort, and high medical costs. A recent paper leveraging volumetric deep radiomic features from synthetic correlated diffusion imaging (CDI$^s$) for breast cancer grade prediction showed immense promise for noninvasive methods for grading. Motivated by the impact of CDI$^s$ optimization for prostate cancer delineation, this paper examines using optimized CDI$^s$ to improve breast cancer grade prediction. We fuse the optimized CDI$^s$ signal with diffusion-weighted imaging (DWI) to create a multiparametric MRI for each patient. Using a larger patient cohort and training across all the layers of a pretrained MONAI model, we achieve a leave-one-out cross-validation accuracy of 95.79%, over 8% higher compared to that previously reported.
A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI
The Hong Kong University of Science and Technology（香港科技大学）；PLA Middle Military Command General Hospital（中国人民解放军中部战区总医院）；The University of Hong Kong（香港大学）；The Chinese University of Hong Kong（香港中文大学）；Yunnan Cancer Hospital（云南省肿瘤医院）；th Medical Center of Chinese PLA General Hospital（中国人民解放军总医院第五医学中心）；Southern Medical University（南方医科大学）
The Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Sidney Kimmel Comprehensive Cancer Center（西德尼·基梅尔综合癌症中心）；The Johns Hopkins University（约翰霍普金斯大学）；University of Kentucky（肯塔基大学）；University of Wisconsin School of Medicine and Public Health（威斯康星大学医学与公共卫生学院）
A new paradigm is beginning to emerge in Radiology with the advent of increased computational capabilities and algorithms. This has led to the ability of real time learning by computer systems of different lesion types to help the radiologist in defining disease. For example, using a deep learning network, we developed and tested a multiparametric deep learning (MPDL) network for segmentation and classification using multiparametric magnetic resonance imaging (mpMRI) radiological images. The MPDL network was constructed from stacked sparse autoencoders with inputs from mpMRI. Evaluation of MPD…
University of Toronto（多伦多大学）；Sunnybrook Research Institute（桑尼布鲁克研究所）
High predictive performance and ease of use and interpretability are important requirements for the applicability of a computer-aided diagnosis (CAD) to human reading studies. We propose a CAD system specifically designed to be more comprehensible to the radiologist reviewing screening breast MRI studies. Multiparametric imaging features are combined to produce a CAD system for differentiating cancerous and non-cancerous lesions. The complete system uses a rule-extraction algorithm to present lesion classification results in an easy to understand graph visualization.
Eindhoven University of Technology（埃因霍温理工大学）；University Medical Center Utrecht（乌得勒支大学医学中心）；University Utrecht（乌得勒支大学）；Harvard Medical School（哈佛医学院）；Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）
Ductal carcinoma in situ (DCIS) is a non-invasive breast cancer that can progress into invasive ductal carcinoma (IDC). Studies suggest DCIS is often overtreated since a considerable part of DCIS lesions may never progress into IDC. Lower grade lesions have a lower progression speed and risk, possibly allowing treatment de-escalation. However, studies show significant inter-observer variation in DCIS grading. Automated image analysis may provide an objective solution to address high subjectivity of DCIS grading by pathologists. In this study, we developed a deep learning-based DCIS grading sys…
Studies estimate that there will be 266,120 new cases of invasive breast cancer and 40,920 breast cancer induced deaths in the year of 2018 alone. Despite the pervasiveness of this affliction, the current process to obtain an accurate breast cancer prognosis is tedious and time consuming, requiring a trained pathologist to manually examine histopathological images in order to identify the features that characterize various cancer severity levels. We propose MITOS-RCNN: a novel region based convolutional neural network (RCNN) geared for small object detection to accurately grade one of the thre…
The Johns Hopkins University School of Medicine（约翰斯·霍普金斯大学医学院）；The Johns Hopkins University（约翰斯·霍普金斯大学）；Kennedy-Krieger Institute（肯尼迪-克里格研究所）
Radiomics is an exciting new area of texture research for extracting quantitative and morphological characteristics of pathological tissue. However, to date, only single images have been used for texture analysis. We have extended radiomic texture methods to use multiparametric (mp) data to get more complete information from all the images. These mpRadiomic methods could potentially provide a platform for stratification of tumor grade as well as assessment of treatment response in brain tumors. In brain, multiparametric MRI (mpMRI) are based on contrast enhanced T1-weighted imaging (T1WI), T2W…
University of Rochester（罗切斯特大学）；University of Rochester Medical Center（罗切斯特大学医学中心）
The improved diagnostic accuracy of ultrasound breast examinations remains an important goal. In this study, we propose a biophysical feature based machine learning method for breast cancer detection to improve the performance beyond a benchmark deep learning algorithm and to furthermore provide a color overlay visual map of the probability of malignancy within a lesion. This overall framework is termed disease specific imaging. Previously, 150 breast lesions were segmented and classified utilizing a modified fully convolutional network and a modified GoogLeNet, respectively. In this study mul…
Histology method is vital in the diagnosis and prognosis of cancers and many other diseases. For the analysis of histopathological images, we need to detect and segment all gland structures. These images are very challenging, and the task of segmentation is even challenging for specialists. Segmentation of glands determines the grade of cancer such as colon, breast, and prostate. Given that deep neural networks have achieved high performance in medical images, we propose a method based on the LinkNet network for gland segmentation. We found the effects of using different loss functions. By usi…
Efficient Multi-scale Masked Autoencoders with Hybrid-Attention Mechanism for Breast Lesion Classification
Department of Electrical and Computer Engineering, University of Houston（电气与计算机工程系，德克萨斯大学）；Systems Medicine and Biomedical Engineering, Houston Methodist（系统医学与生物医学工程，休斯顿 Methodist）
University of Cambridge（剑桥大学）；MITERA Hospital（MITERA医院）；Ribera Salud Group（Ribera Salud集团）；Radboud University Medical Center（拉德堡德大学医学中心）；University Hospital RWTH Aachen（亚琛工业大学医院）；University Medical Center Utrecht（乌得勒支大学医学中心）；University Hospital Carl Gustav Carus（卡尔·古斯塔夫·卡鲁斯大学医院）；EKFZ Technical University Dresden（德累斯顿技术大学EKFZ）
Indiana University School of Medicine（印第安纳大学医学院）；Purdue University（普渡大学）；Dayton Children’s Hospital（代顿儿童医院）
Background and Purpose: Biopsy is the main determinants of glioma clinical management, but require invasive sampling that fail to detect relevant features because of tumor heterogeneity. The purpose of this study was to evaluate the accuracy of a voxel-wise, multiparametric MRI radiomic method to predict features and develop a minimally invasive method to objectively assess neoplasms. Methods: Multiparametric MRI were registered to T1-weighted gadolinium contrast-enhanced data using a 12 degree-of-freedom affine model. The retrospectively collected MRI data included T1-weighted, T1-weighted ga…
University of Memphis（孟菲斯大学）；Microsoft Research（微软研究院）；AutoML Image Lab（AutoML图像实验室）
Breast Cancer is the most prevalent cancer in the world. The World Health Organization reports that the disease still affects a significant portion of the developing world citing increased mortality rates in the majority of low to middle income countries. The most popular protocol pathologists use for diagnosing breast cancer is the Nottingham grading system which grades the proliferation of tumors based on 3 major criteria, the most important of them being mitotic cell count. The way in which pathologists evaluate mitotic cell count is to subjectively and qualitatively analyze cells present i…
Bridging the gap between Performance and Interpretability: An Explainable Disentangled Multimodal Framework for Cancer Survival Prediction
AI Technology for Life（人工智能技术与生命科学）；Department of Information and Computing Sciences（信息与计算科学系）；Department of Biology（生物学系）；Utrecht University（乌得勒支大学）；Department of Metabolic Diseases（代谢疾病部门）；Wilhelmina Children’s Hospital（维廉明娜儿童医院）；University Medical Center Utrecht（乌得勒支大学医学中心）；Regenerative Medicine Center Utrecht（乌得勒支再生医学中心）；Computational Pathology（计算病理学）；Department of Pathology（病理学系）；The Netherlands Cancer Institute（荷兰癌症研究所）；Visualization and Graphics（可视化与图形学）；The Netherlands Cancer Institute, Amsterdam（荷兰癌症研究所，阿姆斯特丹）
KOAL: Knowledge-Driven Prostate Cancer Grading with Ordinal-Aware Learning
School of Computer Science, Sichuan University（四川大学计算机学院）；China Mobile (Suzhou) Software Technology Company Limited（中国移动（苏州）软件技术有限公司）；Shanghai Changhai Hospital, Naval Medical University（上海长海医院，海军医学大学）；Renji Hospital, Shanghai Jiao Tong University School of Medicine（仁济医院，上海交通大学医学院）
Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）；University of Ulsan College of Medicine（蔚山大学医学院）；Asan Medical Center（峨山医学中心）；Ajou University School of Medicine（亚洲大学医学院）；Icahn School of Medicine at Mount Sinai（西奈山伊坎医学院）
Deep learning has been widely used to analyze digitized hematoxylin and eosin (H&E)-stained histopathology whole slide images. Automated cancer segmentation using deep learning can be used to diagnose malignancy and to find novel morphological patterns to predict molecular subtypes. To train pixel-wise cancer segmentation models, manual annotation from pathologists is generally a bottleneck due to its time-consuming nature. In this paper, we propose Deep Interactive Learning with a pretrained segmentation model from a different cancer type to reduce manual annotation time. Instead of annotatin…
Generally, human epidermal growth factor 2 (HER2) breast cancer is more aggressive than other kinds of breast cancer. Currently, HER2 breast cancer is detected using expensive medical tests are most expensive. Therefore, the aim of this study was to develop a computational model named convoHER2 for detecting HER2 breast cancer with image data using convolution neural network (CNN). Hematoxylin and eosin (H&E) and immunohistochemical (IHC) stained images has been used as raw data from the Bayesian information criterion (BIC) benchmark dataset. This dataset consists of 4873 images of H&E and IHC…
Digital pathology enables remote access or consults and powerful image analysis algorithms. However, the slide digitization process can create artifacts such as out-of-focus (OOF). OOF is often only detected upon careful review, potentially causing rescanning and workflow delays. Although scan-time operator screening for whole-slide OOF is feasible, manual screening for OOF affecting only parts of a slide is impractical. We developed a convolutional neural network (ConvFocus) to exhaustively localize and quantify the severity of OOF regions on digitized slides. ConvFocus was developed using ou…
Variational U-Net with Local Alignment for Joint Tumor Extraction and Registration (VALOR-Net) of Breast MRI Data Acquired at Two Different Field Strengths
University of Peshawar（白沙瓦大学）；Danube Private University（多瑙河私立大学）；University of Engineering & Technology, Peshawar（白沙瓦工程与技术大学）；Medical University of Vienna（维也纳医科大学）；Karl Landsteiner Society（卡尔·兰施泰纳学会）；University of Cambridge（剑桥大学）
A Multicentric Dataset for Training and Benchmarking Breast Cancer Segmentation in H&E Slides
Department of Pathology, Radboud University Medical Center（病理学系，拉德堡德大学医学中心）；Fondazione Bruno Kessler（布鲁诺·凯塞勒基金会）；Department of Cellular, Computational and Integrative Biology, University of Trento（细胞、计算与整合生物学系，特伦托大学）；Biopticka Laboratory Ltd.（Biopticka实验室有限公司）；Department of Pathology, Faculty of Medicine in Pilsen, Charles University（病理学系，皮尔森医学院，查尔斯大学）；University of Washington Medical Center（华盛顿大学医学中心）；Department of Surgical Pathology, Santa Chiara Hospital, APSS（外科病理学系，圣查理医院，APSS）；CISMed - Centre for Medical Sciences, University of Trento（CISMed医学研究中心，特伦托大学）；Pathology Unit, University and Hospital Trust of Verona（病理学部，韦罗纳大学与医院信托）；IRCCS Sacro Cuore Don Calabria Hospital（IRCCS圣心多玛利亚医院）
Background: Distinction of IDH mutant and wildtype GBMs is challenging on MRI, since conventional imaging shows considerable overlap. While few studies employed deep-learning in a mixed low/high grade glioma population, a GBM-specific model is still lacking in the literature. Our objective was to develop a deep-learning model for IDH prediction in GBM by using Convoluted Neural Networks (CNN) on multiparametric MRI. Methods: We included 100 adult patients with pathologically proven GBM and IDH testing. MRI data included: morphologic sequences, rCBV and ADC maps. Tumor area was obtained by a bo…
