Visualizing the Invisible: Enhancing Radiologist Performance in Breast Mammography via Task-Driven Chromatic Encoding
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究院，中国科学院）；Shenzhen University（深圳大学）；Shenzhen University of Advanced Technology（深圳大学先进技术学院）
Hui Ye, Shilong Yang, Chulong Zhang, Yexuan Xing, Juan Yu, Yaoqin Xie, Wei Zhang
Purpose:Mammography screening is less sensitive in dense breasts, where tissue overlap and subtle findings increase perceptual difficulty. We present MammoColor, an end-to-end framework with a Task-Driven Chromatic Encoding (TDCE) module that converts single-channel mammograms into TDCE-encoded views for visual augmentation. Materials and Methods:MammoColor couples a lightweight TDCE module with a BI-RADS triage classifier and was trained end-to-end on VinDr-Mammo. Performance was evaluated on an internal test set, two public datasets (CBIS-DDSM and INBreast), and three external clinical cohorts. We also conducted a multi-reader, multi-case (MRMC) observer study with a washout period, comparing (1) grayscale-only, (2) TDCE-only, and (3) side-by-side grayscale+TDCE. Results:On VinDr-Mammo, MammoColor improved AUC from 0.7669 to 0.8461 (P=0.004). Gains were larger in dense breasts (AUC 0.749 to 0.835). In the MRMC study, TDCE-encoded images improved specificity (0.90 to 0.96; P=0.052) with comparable sensitivity. Conclusion:TDCE provides a task-optimized chromatic representation that may improve perceptual salience and reduce false-positive recalls in mammography triage.
University Hospital of Zurich（苏黎世大学医院）；ETH Zurich（苏黎世联邦理工学院）；Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）
$\textbf{Purpose}$ To train a cycle-consistent generative adversarial network (CycleGAN) on mammographic data to inject or remove features of malignancy, and to determine whether these AI-mediated attacks can be detected by radiologists. $\textbf{Material and Methods}$ From the two publicly available datasets, BCDR and INbreast, we selected images from cancer patients and healthy controls. An internal dataset served as test data, withheld during training. We ran two experiments training CycleGAN on low and higher resolution images ($256 \times 256$ px and $512 \times 408$ px). Three radiologis…
School of Electrical Engineering, Tel-Aviv University（特拉维夫大学电气工程学院）；The Manuel and Raquel Klachky Chair of Image Processing, School of Electrical Engineering, Tel-Aviv University（特拉维夫大学电气工程学院 Manuel and Raquel Klachky 图像处理教授职位）；Diagnostic Imaging, Sheba Medical Center, affiliated to the Sackler School of Medicine, Tel-Aviv University（舍巴医疗中心诊断影像科，隶属于特拉维夫大学萨克勒医学院）
Mammography and ultrasound are extensively used by radiologists as complementary modalities to achieve better performance in breast cancer diagnosis. However, existing computer-aided diagnosis (CAD) systems for the breast are generally based on a single modality. In this work, we propose a deep-learning based method for classifying breast cancer lesions from their respective mammography and ultrasound images. We present various approaches and show a consistent improvement in performance when utilizing both modalities. The proposed approach is based on a GoogleNet architecture, fine-tuned for o…
From Density to Biopsy Decisions and Malignancy Prediction: A Benchmark Study of Multimodal Large Language Models Against Radiologists in Digital and Contrast-Enhanced Mammography
Danube Private University（多瑙河私立大学）；Urmia University of Medical Science（乌尔米耶医科大学）；Yeditepe University（耶迪特佩大学）；Kartal Dr. LÜtfi Kırdar City Hospital（卡尔塔尔·卢特菲·克尔达尔博士市立医院）；Iran University of Medical Sciences（伊朗医科大学）；University of Padova（帕多瓦大学）；Bahçeşehir University（巴赫切谢希尔大学）；Mooney's Bay Pain Clinic（穆尼湾疼痛诊所）；Arden University（雅顿大学）；University Hospital Cologne（科隆大学医院）；University of Southern Queensland（南昆士兰大学）；Austrian Center for Medical Innovation and Technology（奥地利医学创新与技术中心）
IMT School for Advanced Studies Lucca（卢卡IMT高等研究院）；Fondazione Gabriele Monasterio（加布里埃莱·莫纳斯特里奥基金会）；Azienda USL Toscana Nord Ovest (ATNO)（托斯卡纳西北部地方卫生局（ATNO））
Cluster of microcalcifications can be an early sign of breast cancer. In this paper we propose a novel approach based on convolutional neural networks for the detection and segmentation of microcalcification clusters. In this work we used 283 mammograms to train and validate our model, obtaining an accuracy of 98.22% in the detection of preliminary suspect regions and of 97.47% in the segmentation task. Our results show how deep learning could be an effective tool to effectively support radiologists during mammograms examination.
Cross-Modal Clinical Knowledge Integration for Mammography Report Generation
The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；Lingnan University（岭南大学）；The Third Affiliated Hospital of Kunming Medical University, Yunnan Cancer Hospital, Peking University Cancer Hospital Yunnan（昆明医科大学第三附属医院、云南癌症医院、北京大学肿瘤医院云南分院）；Guangzhou First People's Hospital, South China University of Technology（广州第一人民医院、华南理工大学）；The Third Affiliated Hospital, Sun Yat-Sen University（中山大学第三附属医院）；HKUST Shenzhen-Hong Kong Collaborative Innovation Research Institute（香港科技大学深圳-香港协同创新研究院）
OncoVision: Integrating Mammography and Clinical Data through Attention-Driven Multimodal AI for Enhanced Breast Cancer Diagnosis
North South University（北南大学）；Friedrich-Alexander University（弗里德里希-亚历山大大学）；Bangladesh Specialized Hospital（孟加拉国专科医院）；Popular Medical College（大众医学院）；Khwaja Yunus Ali Medical College & Hospital（赫瓦贾·尤努斯·阿里医学院及医院）；Bangladesh Medical University（孟加拉国医科大学）；University of Oxford（牛津大学）
MammoDG: Generalisable Deep Learning Breaks the Limits of Cross-Domain Multi-Center Breast Cancer Screening
University of Cambridge（剑桥大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong Polytechnic University（香港理工大学）；Barts Health NHS Trust（巴茨健康国民保健服务信托）；The Royal London Hospital（皇家伦敦医院）
Breast cancer has the highest incidence and second highest mortality rate for women in the US. Our study aims to utilize deep learning for benign/malignant classification of mammogram tumors using a subset of cases from the Digital Database of Screening Mammography (DDSM). Though it was a small dataset from the view of Deep Learning (about 1000 patients), we show that currently state of the art architectures of deep learning can find a robust signal, even when trained from scratch. Using convolutional neural networks (CNNs), we are able to achieve an accuracy of 85% and an ROC AUC of 0.91, whi…
Instituto Tecnológico y de Estudios Superiores de Monterrey（蒙特雷技术与高等教育学院）
Early tumor detection is key in reducing the number of breast cancer death and screening mammography is one of the most widely available and reliable method for early detection. However, it is difficult for the radiologist to process with the same attention each case, due the large amount of images to be read. Computer aided detection (CADe) systems improve tumor detection rate; but the current efficiency of these systems is not yet adequate and the correct interpretation of CADe outputs requires expert human intervention. Computer aided diagnosis systems (CADx) are being designed to improve c…
Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；Tianjin Medical University Cancer Institute and Hospital（天津医科大学肿瘤医院）
Deep learning object detection algorithm has been widely used in medical image analysis. Currently all the object detection tasks are based on the data annotated with object classes and their bounding boxes. On the other hand, medical images such as mammography usually contain normal regions or objects that are similar to the lesion region, and may be misclassified in the testing stage if they are not taken care of. In this paper, we address such problem by introducing a novel top likelihood loss together with a new sampling procedure to select and train the suspected target regions, as well a…
University of São Paulo（圣保罗大学）；Eco & Mama Diagnóstico Digital（Eco & Mama数字诊断公司）
Early detection of breast cancer can increase treatment efficiency. Architectural Distortion (AD) is a very subtle contraction of the breast tissue and may represent the earliest sign of cancer. Since it is very likely to be unnoticed by radiologists, several approaches have been proposed over the years but none using deep learning techniques. To train a Convolutional Neural Network (CNN), which is a deep neural architecture, is necessary a huge amount of data. To overcome this problem, this paper proposes a data augmentation approach applied to clinical image dataset to properly train a CNN. …
Full Field Digital Mammography Dataset from a Population Screening Program
Faculty of Medicine, Memorial University of Newfoundland（医学学院，纪念大学）；Department of Computer Science, Faculty of Science, Memorial University of Newfoundland（计算机科学系，科学学院，纪念大学）；Cancer Care, Newfoundland and Labrador Health Services（癌症护理，新斯科舍省健康服务）
Early detection of breast cancer through screening mammography yields a 20-35% increase in survival rate; however, there are not enough radiologists to serve the growing population of women seeking screening mammography. Although commercial computer aided detection (CADe) software has been available to radiologists for decades, it has failed to improve the interpretation of full-field digital mammography (FFDM) images due to its low sensitivity over the spectrum of findings. In this work, we leverage a large set of FFDM images with loose bounding boxes of mammographically significant findings …
National School of Medicine of Sfax（斯法克斯医学院）；CES-Computer, Electronic And Smart engineering systems design Laboratory（计算机、电子与智能工程系统设计实验室）；National School of Engineers of Sfax（斯法克斯工程师学院）
Breast cancer is considered as one of a major health problem that constitutes the strongest cause behind mortality among women in the world. So, in this decade, breast cancer is the second most common type of cancer, in term of appearance frequency, and the fifth most common cause of cancer related death. In order to reduce the workload on radiologists, a variety of CAD systems; Computer-Aided Diagnosis (CADi) and Computer-Aided Detection (CADe) have been proposed. In this paper, we interested on CADe tool to help radiologist to detect cancer. The proposed CADe is based on a three-step work fl…
ONsite Women’s Health（ONsite女性健康）；SSM Health（SSM健康）；Mallinckrodt Institute of Radiology, Washington University in St. Louis（圣路易斯华盛顿大学马林克罗特放射学研究所）
Screening mammography improves breast cancer outcomes by enabling early detection and treatment. However, false positive callbacks for additional imaging from screening exams cause unnecessary procedures, patient anxiety, and financial burden. This work demonstrates an AI algorithm that reduces false positives by identifying mammograms not suspicious for breast cancer. We trained the algorithm to determine the absence of cancer using 123,248 2D digital mammograms (6,161 cancers) and performed a retrospective study on 14,831 screening exams (1,026 cancers) from 15 US and 3 UK sites. Retrospecti…
MammoExpert: Benchmarking Chain-of-Thought Reasoning in Mammography Diagnosis
State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University（北京大学智能科学与技术学院通用人工智能国家重点实验室）；School of Computer Science and Engineer, Beijing University of Aeronautics and Astronautics（北京航空航天大学计算机科学与工程学院）；Center for Data Science, Peking University（北京大学数据科学中心）；Yizhun co. ltd（医准有限公司）；International School, Beijing University of Post and Telecommunications（北京邮电大学国际学院）；School of Public Health, University of Michigan, Ann Arbor（密歇根大学安娜堡分校公共卫生学院）；Future Technology College, Xi'an Jiaotong University（西安交通大学未来技术学院）；Peking University（北京大学）
Lovely Professional University（洛弗利专业大学）；Bangladesh University of Engineering and Technology（孟加拉国工程技术大学）；Maharaja Agrasen Institute of Technology（马哈拉贾·阿格拉森技术学院）；University of Economics Ho Chi Minh City（胡志明市经济大学）
Breast cancer is a common cancer for women. Early detection of breast cancer can considerably increase the survival rate of women. This paper mainly focuses on transfer learning process to detect breast cancer. Modified VGG (MVGG), residual network, mobile network is proposed and implemented in this paper. DDSM dataset is used in this paper. Experimental results show that our proposed hybrid transfers learning model (Fusion of MVGG16 and ImageNet) provides an accuracy of 88.3% where the number of epoch is 15. On the other hand, only modified VGG 16 architecture (MVGG 16) provides an accuracy 8…
Deep Learning-Based Breast Cancer Detection in Mammography: A Multi-Center Validation Study in Thai Population
Perceptra Co., Ltd（Perceptra公司）；Institute of Field Robotics（现场机器人研究所）；King Mongkut’s University of Technology Thonburi（技术师范大学）；Mahidol University（玛希多大学）；Siriraj Hospital（Siriraj医院）；Khonkaen University（孔卡恩大学）
Purpose: To develop a Breast Imaging Reporting and Data System (BI-RADS) breast density deep learning (DL) model in a multi-site setting for synthetic two-dimensional mammography (SM) images derived from digital breast tomosynthesis exams using full-field digital mammography (FFDM) images and limited SM data. Materials and Methods: A DL model was trained to predict BI-RADS breast density using FFDM images acquired from 2008 to 2017 (Site 1: 57492 patients, 187627 exams, 750752 images) for this retrospective study. The FFDM model was evaluated using SM datasets from two institutions (Site 1: 38…
A Multi-Modal AI System for Screening Mammography: Integrating 2D and 3D Imaging to Improve Breast Cancer Detection in a Prospective Clinical Study
Vilcek Institute of Graduate Biomedical Sciences, NYU Grossman School of Medicine（NYU Grossman医学院Vilcek研究生生物医学科学研究所）；NYU Grossman School of Medicine（NYU Grossman医学院）；Center for Data Science, New York University（纽约大学数据科学中心）；Emory University（埃默里大学）；Visage Imaging, Inc.（Visage成像公司）
University of California, Los Angeles（加利福尼亚大学洛杉矶分校）；University of Cambridge（剑桥大学）
With an aging and growing population, the number of women requiring either screening or symptomatic mammograms is increasing. To reduce the number of mammograms that need to be read by a radiologist while keeping the diagnostic accuracy the same or better than current clinical practice, we develop Man and Machine Mammography Oracle (MAMMO) - a clinical decision support system capable of triaging mammograms into those that can be confidently classified by a machine and those that cannot be, thus requiring the reading of a radiologist. The first component of MAMMO is a novel multi-view convoluti…
Mammography is using low-energy X-rays to screen the human breast and is utilized by radiologists to detect breast cancer. Typically radiologists require a mammogram with impeccable image quality for an accurate diagnosis. In this study, we propose a deep learning method based on Convolutional Neural Networks (CNNs) for mammogram denoising to improve the image quality. We first enhance the noise level and employ Anscombe Transformation (AT) to transform Poisson noise to white Gaussian noise. With this data augmentation, a deep residual network is trained to learn the noise map of the noisy ima…
School of Electrical Engineering and Computer Science, National University of Sciences and Technology（国家科技大学 电气工程与计算机科学学院）；Information Technology University (ITU)-Punjab（旁遮普信息技术大学）；University of the West of England (UWE)（西英格兰大学）
Breast cancer is one of the most common cause of deaths among women. Mammography is a widely used imaging modality that can be used for cancer detection in its early stages. Deep learning is widely used for the detection of cancerous masses in the images obtained via mammography. The need to improve accuracy remains constant due to the sensitive nature of the datasets so we introduce segmentation and wavelet transform to enhance the important features in the image scans. Our proposed system aids the radiologist in the screening phase of cancer detection by using a combination of segmentation a…
Currently Mammography is a most effective imaging modality used by radiologists for the screening of breast cancer. Finding an accurate, robust and efficient breast region segmentation technique still remains a challenging problem in digital mammography. Extraction of the breast profile region and the removal of pectoral muscle are essential pre-processing steps in Computer Aided Diagnosis (CAD) system for the diagnosis of breast cancer. Primarily it allows the search for abnormalities to be limited to the region of the breast tissue without undue influence from the background of the mammogram…
Beijing Institute of Technology（北京理工大学）；Université 8 Mai 1945 Guelma（盖勒马8 Mai 1945大学）；National Cancer Center/National Clinical Research Center for Cancer/Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院北京协和医学院肿瘤医院国家癌症中心国家肿瘤临床研究中心）
Mammography remains the most prevalent imaging tool for early breast cancer screening. The language used to describe abnormalities in mammographic reports is based on the breast Imaging Reporting and Data System (BI-RADS). Assigning a correct BI-RADS category to each examined mammogram is a strenuous and challenging task for even experts. This paper proposes a new and effective computer-aided diagnosis (CAD) system to classify mammographic masses into four assessment categories in BI-RADS. The mass regions are first enhanced by means of histogram equalization and then semiautomatically segment…
Faculty of Medicine, American University of Beirut（贝鲁特美国大学医学院）；American University of Beirut Medical Center（贝鲁特美国大学医学中心）；Department of Diagnostic Radiology, American University of Beirut Medical Center（贝鲁特美国大学医学中心诊断放射科）
During their formative years, radiology trainees are required to interpret hundreds of mammograms per month, with the objective of becoming apt at discerning the subtle patterns differentiating benign from malignant lesions. Unfortunately, medico-legal and technical hurdles make it difficult to access and query medical images for training. In this paper we train a generative adversarial network (GAN) to synthesize 512 x 512 high-resolution mammograms. The resulting model leads to the unsupervised separation of high-level features (e.g. the standard mammography views and the nature of the breas…
DSU-Net: An Attention-Enhanced Dense Skip U-Net for Breast Lesion Segmentation in Mammographic Images
Department of Biomedical Engineering, University of Wisconsin-Milwaukee（威斯康星大学密尔沃基分校生物医学工程系）；Department of Mechanical Engineering, Northern Arizona University（北亚利桑那大学机械工程系）
Medical University of Gdansk（格但斯克医科大学）；Karolinska University Hospital（卡罗林斯卡大学医院）；Karolinska Institutet（卡罗林斯卡学院）
Computer-aided detection systems based on deep learning have shown good performance in breast cancer detection. However, high-density breasts show poorer detection performance since dense tissues can mask or even simulate masses. Therefore, the sensitivity of mammography for breast cancer detection can be reduced by more than 20% in dense breasts. Additionally, extremely dense cases reported an increased risk of cancer compared to low-density breasts. This study aims to improve the mass detection performance in highdensity breasts using synthetic high-density full-field digital mammograms (FFD…
