Detection of masses and architectural distortions in digital breast tomosynthesis: a publicly available dataset of 5,060 patients and a deep learning model
Duke University（杜克大学）
Mateusz Buda, Ashirbani Saha, Ruth Walsh, Sujata Ghate, Nianyi Li, Albert Święcicki, Joseph Y. Lo, Maciej A. Mazurowski
Breast cancer screening is one of the most common radiological tasks with over 39 million exams performed each year. While breast cancer screening has been one of the most studied medical imaging applications of artificial intelligence, the development and evaluation of the algorithms are hindered due to the lack of well-annotated large-scale publicly available datasets. This is particularly an issue for digital breast tomosynthesis (DBT) which is a relatively new breast cancer screening modality. We have curated and made publicly available a large-scale dataset of digital breast tomosynthesis images. It contains 22,032 reconstructed DBT volumes belonging to 5,610 studies from 5,060 patients. This included four groups: (1) 5,129 normal studies, (2) 280 studies where additional imaging was needed but no biopsy was performed, (3) 112 benign biopsied studies, and (4) 89 studies with cancer. Our dataset included masses and architectural distortions which were annotated by two experienced radiologists. Additionally, we developed a single-phase deep learning detection model and tested it using our dataset to serve as a baseline for future research. Our model reached a sensitivity of 65% at 2 false positives per breast. Our large, diverse, and highly-curated dataset will facilitate development and evaluation of AI algorithms for breast cancer screening through providing data for training as well as common set of cases for model validation. The performance of the model developed in our study shows that the task remains challenging and will serve as a baseline for future model development.
University of São Paulo（圣保罗大学）；Rensselaer Polytechnic Institute（伦斯勒理工学院）；Fudan University（复旦大学）；Shanghai Center for Brain Science and Brain-inspired Technology（上海脑科学与类脑研究中心）
Digital breast tomosynthesis (DBT) exams should utilize the lowest possible radiation dose while maintaining sufficiently good image quality for accurate medical diagnosis. In this work, we propose a convolution neural network (CNN) to restore low-dose (LD) DBT projections to achieve an image quality equivalent to a standard full-dose (FD) acquisition. The proposed network architecture benefits from priors in terms of layers that were inspired by traditional model-based (MB) restoration methods, considering a model-based deep learning approach, where the network is trained to operate in the va…
DBT-DINO: Towards Foundation model based analysis of Digital Breast Tomosynthesis
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School（阿提诺拉·A·马丁诺生物医学影像中心、麻省总医院和哈佛医学院）；Department of Radiology, Charité - Universitätsmedizin Berlin（放射科、柏林夏里特大学医学院）；Mass General Brigham Data Science Office（麻省总医院数据科学办公室）；Department of Computer Science, Institute for Machine Learning, ETH Zürich（计算机科学系、机器学习研究所、苏黎世联邦理工学院）；Massachusetts General Hospital Cancer Center and Harvard Medical School（麻省总医院癌症中心和哈佛医学院）；Department of Radiology, Massachusetts General Hospital（放射科、麻省总医院）；Department of Radiology, University of Wisconsin School of Medicine and Public Health（放射科、威斯康星大学医学与公共卫生学院）
Universidad Técnica Particular de Loja（洛哈技术大学）；Universitat Politécnica de Valencia（瓦伦西亚理工大学）；University of Waterloo（滑铁卢大学）
Breast cancer is the most common invasive cancer in women, and the second main cause of death. Breast cancer screening is an efficient method to detect indeterminate breast lesions early. The common approaches of screening for women are tomosynthesis and mammography images. However, the traditional manual diagnosis requires an intense workload by pathologists, who are prone to diagnostic errors. Thus, the aim of this study is to build a deep convolutional neural network method for automatic detection, segmentation, and classification of breast lesions in mammography images. Based on deep learn…
DeepHealth, Inc.（深健公司）；Rhode Island Hospital（罗德岛医院）；Brown University（布朗大学）；Henan Provincial People’s Hospital（河南省人民医院）；Medford Radiology Group（梅德福放射学集团）；University of Massachusetts Medical School（马萨诸塞大学医学院）
Breast cancer remains a global challenge, causing over 1 million deaths globally in 2018. To achieve earlier breast cancer detection, screening x-ray mammography is recommended by health organizations worldwide and has been estimated to decrease breast cancer mortality by 20-40%. Nevertheless, significant false positive and false negative rates, as well as high interpretation costs, leave opportunities for improving quality and access. To address these limitations, there has been much recent interest in applying deep learning to mammography; however, obtaining large amounts of annotated data p…
Towards Early Detection: AI-Based Five-Year Forecasting of Breast Cancer Risk Using Digital Breast Tomosynthesis Imaging
Athinoula A. Martinos Center for Biomedical Imaging, Mass General Brigham and Harvard Medical School（Athinoula A. Martinos 生物医学成像中心，马萨诸塞总医院与哈佛医学院）；École Polytechnique Fédérale de Lausanne (EPFL)（洛桑联邦理工学院）；Charité – Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin（柏林夏里特医学院，自由大学和洪堡大学的成员）；Department of Radiology, University of Wisconsin School of Medicine and Public Health（威斯康星大学医学与公共卫生学院放射科）
Purpose: To develop and evaluate the accuracy of a multi-view deep learning approach to the analysis of high-resolution synthetic mammograms from digital breast tomosynthesis screening cases, and to assess the effect on accuracy of image resolution and training set size. Materials and Methods: In a retrospective study, 21,264 screening digital breast tomosynthesis (DBT) exams obtained at our institution were collected along with associated radiology reports. The 2D synthetic mammographic images from these exams, with varying resolutions and data set sizes, were used to train a multi-view deep …
Mammography-based screening has helped reduce the breast cancer mortality rate, but has also been associated with potential harms due to low specificity, leading to unnecessary exams or procedures, and low sensitivity. Digital breast tomosynthesis (DBT) improves on conventional mammography by increasing both sensitivity and specificity and is becoming common in clinical settings. However, deep learning (DL) models have been developed mainly on conventional 2D full-field digital mammography (FFDM) or scanned film images. Due to a lack of large annotated DBT datasets, it is difficult to train a …
Digital Breast Tomosynthesis is an X-ray imaging technique that allows a volumetric reconstruction of the breast, from a small number of low-dose two-dimensional projections. Although it is already used in clinical setting, enhancing the quality of the recovered images is still a subject of research. Aim of this paper is to propose, in a general optimization framework, very accurate iterative algorithms for Digital Breast Tomosynthesis image reconstruction, characterized by a convergent behaviour. They are able to detect the cancer object of interest, i.e. masses and microcalcifications, in th…
Automated methods for breast cancer detection have focused on 2D mammography and have largely ignored 3D digital breast tomosynthesis (DBT), which is frequently used in clinical practice. The two key challenges in developing automated methods for DBT classification are handling the variable number of slices and retaining slice-to-slice changes. We propose a novel deep 2D convolutional neural network (CNN) architecture for DBT classification that simultaneously overcomes both challenges. Our approach operates on the full volume, regardless of the number of slices, and allows the use of pre-trai…
Measurements of breast density have the potential to improve the efficiency and reduce the cost of screening mammography through personalized screening. Breast density has traditionally been evaluated from the dense area in a mammogram, but volumetric assessment methods, which measure the volumetric fraction of fibro-glandular tissue in the breast, are potentially more consistent and physically sound. The purpose of the present study is to evaluate a method for measuring the volumetric breast density using photon-counting spectral tomosynthesis. The performance of the method was evaluated usin…
Deep learning reconstruction of digital breast tomosynthesis images for accurate breast density and patient-specific radiation dose estimation
Radboud University Medical Center（拉德堡德大学医学中心）；Netherlands Cancer Institute（荷兰癌症研究所）；The University of Chicago（芝加哥大学）；University of Pennsylvania（宾夕法尼亚大学）；Lund University（隆德大学）；Vall d’Hebron Institute of Oncology（巴尔德希伯伦肿瘤研究所）；University of Barcelona（巴塞罗那大学）；Dutch Expert Centre for Screening (LRCB)（荷兰筛查专家中心）
Towards order of magnitude X-ray dose reduction in breast cancer imaging using phase contrast and deep denoising
The University of Melbourne（墨尔本大学）；The University of Sydney（悉尼大学）；Eastern Health（东部健康）；Monash Health（莫纳什健康）；Monash University（莫纳什大学）；Australian Synchrotron, ANSTO（澳大利亚同步辐射中心，ANSTO）；Commonwealth Scientific and Industrial Research Organisation（澳大利亚联邦科学与工业研究组织）
Purpose: The goal of this study is to develop a novel deep learning (DL) based reconstruction framework to improve the digital breast tomosynthesis (DBT) imaging performance. Methods: In this work, the DIR-DBTnet is developed for DBT image reconstruction by unrolling the standard iterative reconstruction algorithm within the deep learning framework. In particular, such network learns the regularizer and the iteration parameters automatically through network training with a large amount of simulated DBT data. Afterwards, both numerical and experimental data are used to evaluate its performance.…
Reconstruction of digital breast tomosynthesis is a challenging problem due to the limited angle data available in such systems. Due to memory limitations, deep learning-based methods can help improve these reconstructions, but can not (yet) attain sufficiently high resolution. In addition to this practical issue, questions remain on the possibility of such models introducing 'ghost' information from the training data that is not compatible with the projection data. To take advantage of some of the benefits of deep learning-based reconstructions while avoiding these limitations, we propose to …
Changes in Visual Attention Patterns for Detection Tasks due to Dependencies on Signal and Background Spatial Frequencies
Department of Biomedical Engineering, University of Houston（生物医学工程系，休斯顿大学）；Department of Physics, University of Houston（物理系，休斯顿大学）；Department of Electrical and Computer Engineering, University of Houston（电气与计算机工程系，休斯顿大学）
Breast density estimation is one of the key tasks in recognizing individuals predisposed to breast cancer. It is often challenging because of low contrast and fluctuations in mammograms' fatty tissue background. Most of the time, the breast density is estimated manually where a radiologist assigns one of the four density categories decided by the Breast Imaging and Reporting Data Systems (BI-RADS). There have been efforts in the direction of automating a breast density classification pipeline. Breast density estimation is one of the key tasks performed during a screening exam. Dense breasts ar…
University of Kentucky（肯塔基大学）；Miami University（迈阿密大学）
Breast cancer is the malignant tumor that causes the highest number of cancer deaths in females. Digital mammograms (DM or 2D mammogram) and digital breast tomosynthesis (DBT or 3D mammogram) are the two types of mammography imagery that are used in clinical practice for breast cancer detection and diagnosis. Radiologists usually read both imaging modalities in combination; however, existing computer-aided diagnosis tools are designed using only one imaging modality. Inspired by clinical practice, we propose an innovative convolutional neural network (CNN) architecture for breast cancer classi…
A Multi-Modal AI System for Screening Mammography: Integrating 2D and 3D Imaging to Improve Breast Cancer Detection in a Prospective Clinical Study
Vilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine（NYU Grossman医学院Vilcek研究生生物医学科学研究所）；NYU Grossman School of Medicine（NYU Grossman医学院）；Center for Data Science, New York University（纽约大学数据科学中心）；Emory University（埃默里大学）；Visage Imaging, Inc.（Visage成像公司）
Purpose: To develop a Breast Imaging Reporting and Data System (BI-RADS) breast density deep learning (DL) model in a multi-site setting for synthetic two-dimensional mammography (SM) images derived from digital breast tomosynthesis exams using full-field digital mammography (FFDM) images and limited SM data. Materials and Methods: A DL model was trained to predict BI-RADS breast density using FFDM images acquired from 2008 to 2017 (Site 1: 57492 patients, 187627 exams, 750752 images) for this retrospective study. The FFDM model was evaluated using SM datasets from two institutions (Site 1: 38…
A Spatially-Aware Multiple Instance Learning Framework for Digital Pathology
Department of Biomedical Engineering, Eindhoven University of Technology（生物医学工程系，埃因霍温理工大学）；Mathematics and Computer Science Department, Eindhoven University of Technology（数学与计算机科学系，埃因霍温理工大学）
Transformer-based cardiac substructure segmentation from contrast and non-contrast computed tomography for radiotherapy planning
Memorial Sloan Kettering Cancer Center（纪念斯隆·凯特琳癌症中心）；Medical Center-University of Freiburg, Faculty of Medicine, University of Freiburg（弗莱堡大学医学院大学医学中心）；German Cancer Consortium (DKTK)（德国癌症联盟（DKTK））
