Breast cancer is the second leading cause of death for women in the U.S. Early detection of breast cancer is key to higher survival rates of breast cancer patients. We are investigating infrared (IR) thermography as a noninvasive adjunct to mammography for breast cancer screening. IR imaging is radiation-free, pain-free, and non-contact. Automatic segmentation of the breast area from the acquired full-size breast IR images will help limit the area for tumor search, as well as reduce the time and effort costs of manual segmentation. Autoencoder-like convolutional and deconvolutional neural networks (C-DCNN) had been applied to automatically segment the breast area in IR images in previous studies. In this study, we applied a state-of-the-art deep-learning segmentation model, MultiResUnet, which consists of an encoder part to capture features and a decoder part for precise localization. It was used to segment the breast area by using a set of breast IR images, collected in our pilot study by imaging breast cancer patients and normal volunteers with a thermal infrared camera (N2 Imager). The database we used has 450 images, acquired from 14 patients and 16 volunteers. We used a thresholding method to remove interference in the raw images and remapped them from the original 16-bit to 8-bit, and then cropped and segmented the 8-bit images manually. Experiments using leave-one-out cross-validation (LOOCV) and comparison with the ground-truth images by using Tanimoto similarity show that the average accuracy of MultiResUnet is 91.47%, which is about 2% higher than that of the autoencoder. MultiResUnet offers a better approach to segment breast IR images than our previous model.
Divide and Conquer: A Large-Scale Dataset and Model for Left-Right Breast MRI Segmentation
German Cancer Research Center (DKFZ) Heidelberg, Division of Medical Image Computing, Germany（德国癌症研究中心（DKFZ）海德堡，医学图像计算部门，德国）；Learning Group, Department of Radiation Oncology, Heidelberg University Hospital（放射肿瘤学部门学习组，海德堡大学医院）；Faculty of Mathematics and Computer Science, Heidelberg University（海德堡大学数学与计算机科学学院）；Medical Faculty, Heidelberg University, Germany（海德堡大学医学学院，德国）
We present Spectral GUI, a multiplatform breast MR image analysis tool designed to facilitate the segmentation of fibro glandular tissues and lesions in T1 weighted breast MR images via a graphical user interface (GUI). Spectral GUIR uses spectrum loft method [1] for breast MR image segmentation. Not only is it interactive, but robust and expeditious at the same time. Being devoid of any machine learning algorithm, it shows exceptionally high execution speed with minimal overheads. The accuracy of the results has been simultaneously measured using performance metrics and expert entailment. The…
Université de Bretagne Occidentale（西布列塔尼大学）；Inserm（法国国家健康与医学研究院）；IMT Atlantique（大西洋国立高等矿业电信学院）；University Hospital of Brest（布雷斯特大学医院）
Mammography is the primary imaging modality used for early detection and diagnosis of breast cancer. X-ray mammogram analysis mainly refers to the localization of suspicious regions of interest followed by segmentation, towards further lesion classification into benign versus malignant. Among diverse types of breast abnormalities, masses are the most important clinical findings of breast carcinomas. However, manually segmenting breast masses from native mammograms is time-consuming and error-prone. Therefore, an integrated computer-aided diagnosis system is required to assist clinicians for au…
Incorporating various mass shapes and sizes in training deep learning architectures has made breast mass segmentation challenging. Moreover, manual segmentation of masses of irregular shapes is time-consuming and error-prone. Though Deep Neural Network has shown outstanding performance in breast mass segmentation, it fails in segmenting micro-masses. In this paper, we propose a novel U-net-shaped transformer-based architecture, called Swin-SFTNet, that outperforms state-of-the-art architectures in breast mammography-based micro-mass segmentation. Firstly to capture the global context, we desig…
School of Information Technology and Electrical Engineering, University of Queensland（昆士兰大学信息技术与电气工程学院）；Science and Engineering Faculty, Queensland University of Technology（昆士兰科技大学科学与工程学院）
Previous studies on computer aided detection/diagnosis (CAD) in 4D breast magnetic resonance imaging (MRI) regard lesion detection, segmentation and characterization as separate tasks, and typically require users to manually select 2D MRI slices or regions of interest as the input. In this work, we present a breast MRI CAD system that can handle 4D multimodal breast MRI data, and integrate lesion detection, segmentation and characterization with no user intervention. The proposed CAD system consists of three major stages: region candidate generation, feature extraction and region candidate cla…
Illinois Institute of Technology（伊利诺伊理工学院）；Rutgers University（罗格斯大学）
Automatically segmenting lesion area in breast ultrasound (BUS) images is a challenging one due to its noise, speckle and artifacts. Edge-map of BUS images also does not help because in most cases the edge-map gives no information whatsoever. Almost all segmentation technique takes the edge-map of the image as its first step, though there are a few algorithms that try to avoid edge-maps as well. Improving the edge-map of breast ultrasound images theoretically improves the chances of automatic segmentation to be more precise. In this paper, we propose a semi-automatic technique of histogram spl…
The advancements in deep learning technologies have produced immense contributions to biomedical image analysis applications. With breast cancer being the common deadliest disease among women, early detection is the key means to improve survivability. Medical imaging like ultrasound presents an excellent visual representation of the functioning of the organs; however, for any radiologist analysing such scans is challenging and time consuming which delays the diagnosis process. Although various deep learning based approaches are proposed that achieved promising results, the present article intr…
Memorial Sloan Kettering Cancer Center（纪念斯隆凯特琳癌症中心）；Weill Cornell Graduate School for Medical Sciences（威尔康奈尔医学研究生院）
Pathologic analysis of surgical excision specimens for breast carcinoma is important to evaluate the completeness of surgical excision and has implications for future treatment. This analysis is performed manually by pathologists reviewing histologic slides prepared from formalin-fixed tissue. In this paper, we present Deep Multi-Magnification Network trained by partial annotation for automated multi-class tissue segmentation by a set of patches from multiple magnifications in digitized whole slide images. Our proposed architecture with multi-encoder, multi-decoder, and multi-concatenation out…
Is Two-shot All You Need? A Label-efficient Approach for Video Segmentation in Breast Ultrasound
Guangdong Key Laboratory of Biomedical Measurements and Ultrasound Imaging（广东省生物医学测量与超声成像重点实验室）；School of Biomedical Engineering, Shenzhen University Medical School, Shenzhen University（深圳大学医学部生物医学工程学院）；Shenzhen University（深圳大学）
BUET（孟加拉国工程技术大学）；United International University（联合国际大学）
Lung cancer is a leading cause of death in most countries of the world. Since prompt diagnosis of tumors can allow oncologists to discern their nature, type and the mode of treatment, tumor detection and segmentation from CT Scan images is a crucial field of study worldwide. This paper approaches lung tumor segmentation by applying two-dimensional discrete wavelet transform (DWT) on the LOTUS dataset for more meticulous texture analysis whilst integrating information from neighboring CT slices before feeding them to a Deeply Supervised MultiResUNet model. Variations in learning rates, decay an…
Uncertainty-Gated Deformable Network for Breast Tumor Segmentation in MR Images
College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院）；School of Computer Science and Information Engineering, Hefei University of Science（合肥科学技术大学计算机科学与信息工程学院）；Department of Radiology, Southwest Hospital, Army Medical University（西南医院放射科，中国人民解放军陆军军医大学）；School of Electrical and Information Engineering, Tianjin University（天津大学电气与信息工程学院）
The Chinese University of Hong Kong（香港中文大学）；University of Cambridge（剑桥大学）；Inception Institute of Artificial Intelligence（启迪人工智能研究院）；The Hong Kong University of Science and Technology（香港科技大学）；Jinan University（暨南大学）；Southern University of Science and Technology（南方科技大学）；Chinese Academy of Sciences（中国科学院）
Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limit…
Universitat Rovira i Virgili（罗维拉-威尔吉利大学）；Bioinformatics Institute（生物信息学研究所）
This paper proposes an efficient solution for tumor segmentation and classification in breast ultrasound (BUS) images. We propose to add an atrous convolution layer to the conditional generative adversarial network (cGAN) segmentation model to learn tumor features at different resolutions of BUS images. To automatically re-balance the relative impact of each of the highest level encoded features, we also propose to add a channel-wise weighting block in the network. In addition, the SSIM and L1-norm loss with the typical adversarial loss are used as a loss function to train the model. Our model…
Institute of Fundamental Technological Research, Polish Academy of Sciences（波兰科学院基础技术研究所）
We propose a novel deep learning based approach to breast mass segmentation in ultrasound (US) imaging. In comparison to commonly applied segmentation methods, which use US images, our approach is based on quantitative entropy parametric maps. To segment the breast masses we utilized an attention gated U-Net convolutional neural network. US images and entropy maps were generated based on raw US signals collected from 269 breast masses. The segmentation networks were developed separately using US image and entropy maps, and evaluated on a test set of 81 breast masses. The attention U-Net traine…
Nankai University（南开大学）；Civil Aviation General Hospital（民航总医院）；Chinese PLA General Hospital（中国人民解放军总医院）
Breast lesions segmentation is an important step of computer-aided diagnosis system, and it has attracted much attention. However, accurate segmentation of malignant breast lesions is a challenging task due to the effects of heterogeneous structure and similar intensity distributions. In this paper, a novel bidirectional aware guidance network (BAGNet) is proposed to segment the malignant lesion from breast ultrasound images. Specifically, the bidirectional aware guidance network is used to capture the context between global (low-level) and local (high-level) features from the input coarse sal…
School of Computer Science and Technology, Harbin Institute of Technology（哈尔滨工业大学计算机科学与技术学院）；National University of Singapore（新加坡国立大学）；Shenzhen University（深圳大学）；School of Biomedical Engineering and Informatics, Nanjing Medical University（南京医科大学生物医学工程与信息学院）；Pohang University of Science and Technology (POSTECH)（浦项科技大学）；German Cancer Research Center (DKFZ)（德国癌症研究中心）；Heidelberg University（海德堡大学）；Helmholtz Imaging（亥姆霍兹成像机构）
Breast cancer is one of the most common causes of death among women worldwide. Early detection helps in reducing the number of deaths. Automated 3D Breast Ultrasound (ABUS) is a newer approach for breast screening, which has many advantages over handheld mammography such as safety, speed, and higher detection rate of breast cancer. Tumor detection, segmentation, and classification are key components in the analysis of medical images, especially challenging in the context of 3D ABUS due to the significant variability in tumor size and shape, unclear tumor boundaries, and a low signal-to-noise r…
Breast tumor segmentation provides accurate tumor boundary, and serves as a key step toward further cancer quantification. Although deep learning-based approaches have been proposed and achieved promising results, existing approaches have difficulty in detecting small breast tumors. The capacity to detecting small tumors is particularly important in finding early stage cancers using computer-aided diagnosis (CAD) systems. In this paper, we propose a novel deep learning architecture called Small Tumor-Aware Network (STAN), to improve the performance of segmenting tumors with different size. The…
University of Delaware（特拉华大学）；University of Guilan（吉兰大学）；Eindhoven University of Technology（埃因霍温理工大学）；Iran University of Science and Technology（伊朗科学技术大学）
Automated 3-D breast ultrasound (ABUS) is a newfound system for breast screening that has been proposed as a supplementary modality to mammography for breast cancer detection. While ABUS has better performance in dense breasts, reading ABUS images is exhausting and time-consuming. So, a computer-aided detection system is necessary for interpretation of these images. Mass segmentation plays a vital role in the computer-aided detection systems and it affects the overall performance. Mass segmentation is a challenging task because of the large variety in size, shape, and texture of masses. Moreov…
School of Biomedical Engineering, Southern Medical University（南方医科大学生物医学工程学院）
Breast ultrasound (BUS) image segmentation plays a crucial role in a computer-aided diagnosis system, which is regarded as a useful tool to help increase the accuracy of breast cancer diagnosis. Recently, many deep learning methods have been developed for segmentation of BUS image and show some advantages compared with conventional region-, model-, and traditional learning-based methods. However, previous deep learning methods typically use skip-connection to concatenate the encoder and decoder, which might not make full fusion of coarse-to-fine features from encoder and decoder. Since the str…
Universidad de Granada（格拉纳达大学）；Memorial Sloan-Kettering Cancer Center（纪念斯隆-凯特琳癌症中心）；Medical University Vienna/AKH Wien（维也纳医科大学/维也纳总医院）；Florida State University（佛罗里达州立大学）
Non-mass enhancing lesions (NME) constitute a diagnostic challenge in dynamic contrast enhanced magnetic resonance imaging (DCE-MRI) of the breast. Computer Aided Diagnosis (CAD) systems provide physicians with advanced tools for analysis, assessment and evaluation that have a significant impact on the diagnostic performance. Here, we propose a new approach to address the challenge of NME detection and segmentation, taking advantage of independent component analysis (ICA) to extract data-driven dynamic lesion characterizations. A set of independent sources was obtained from DCE-MRI dataset of …
University of Idaho（爱达荷大学）；University of Utah School of Medicine（犹他大学医学院）
Breast tumor segmentation is a critical task in computer-aided diagnosis (CAD) systems for breast cancer detection because accurate tumor size, shape and location are important for further tumor quantification and classification. However, segmenting small tumors in ultrasound images is challenging, due to the speckle noise, varying tumor shapes and sizes among patients, and the existence of tumor-like image regions. Recently, deep learning-based approaches have achieved great success for biomedical image analysis, but current state-of-the-art approaches achieve poor performance for segmenting …
BreastSegNet: Multi-label Segmentation of Breast MRI
Department of Biostatistics \& Bioinformatics, Duke University Department of Electrical；Computer Engineering, Duke University Department of Radiology, Duke University Medical Center Department of Computer Science, Duke University
Multilevel Perception Boundary-guided Network for Breast Lesion Segmentation in Ultrasound Images
Guizhou University（贵州大学）；College of Computer Science and Technology, Guizhou University（贵州大学计算机科学与技术学院）；Engineering Research Center of Text Computing & Cognitive Intelligence, Ministry of Education（教育部文本计算与认知智能工程研究中心）；Key Laboratory of Intelligent Medical Image Analysis and Precise Diagnosis of Guizhou Province（贵州省智能医学影像分析与精准诊断重点实验室）；State Key Laboratory of Public Big Data（公共大数据国家重点实验室）
Prototype Learning Guided Hybrid Network for Breast Tumor Segmentation in DCE-MRI
School of Health Science and Engineering, University of Shanghai for Science and Technology（上海理工大学健康科学与工程学院）；School of Biomedical Engineering, ShanghaiTech University（上海科技大学生物医学工程学院）；School of Computer Science and Engineering, Nanjing University of Science and Technology（南京理工大学计算机科学与工程学院）；Ruijin Hospital, Shanghai Jiaotong University School of Medicine（上海交通大学医学院附属瑞金医院）；Shanghai General Hospital（上海交通大学附属第一人民医院）
Breast cancer is considered as the most fatal type of cancer among women worldwide and it is crucially important to be diagnosed at its early stages. In the current study, we aim to represent a fast and efficient framework which consists of two main parts:1- image classification, and 2- tumor region segmentation. At the initial stage, the images are classified into the two categories of normal and abnormal. Since the Deep Neural Networks have performed successfully in machine vision task, we would employ the convolutional neural networks for the classification of images. In the second stage, t…
East Delta University（东三角洲大学）；University of Chittagong（吉大港大学）
Breast cancer has become a symbol of tremendous concern in the modern world, as it is one of the major causes of cancer mortality worldwide. In this regard, breast ultrasonography images are frequently utilized by doctors to diagnose breast cancer at an early stage. However, the complex artifacts and heavily noised breast ultrasonography images make diagnosis a great challenge. Furthermore, the ever-increasing number of patients being screened for breast cancer necessitates the use of automated end-to-end technology for highly accurate diagnosis at a low cost and in a short time. In this conce…
Large Kernel MedNeXt for Breast Tumor Segmentation and Self-Normalizing Network for pCR Classification in Magnetic Resonance Images
Department of Computer Engineering, Kwame Nkrumah University of Science and Technology（计算机工程系，库马西大学科学与技术学院）；Infectious Disease Group, Kumasi Centre for Collaborative Research in Tropical Medicine（传染病研究组，库马西热带医学协作研究中心）
Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos
Xiamen University（厦门大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）；Agency for Science, Technology and Research（新加坡科技研究局）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）
Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation
Department of Computer Engineering, Kwame Nkrumah University of Science and Technology（计算机工程系，加纳科拉布大学科学与技术大学）；Global Health and Infectious Disease Group, Kumasi Centre for Collaborative Research in Tropical Medicine（全球卫生与传染病组，科拉布热带医学协作研究中心）；Department of Radiology, National Hospital Abuja（放射科，阿布贾国家医院）；Computer Science Department, FAST National University of Computer and Emerging Sciences（计算机科学系，FAST国家计算机与新兴科学大学）；Medical Artificial Intelligence Lab, Lagos, Nigeria（医学人工智能实验室，尼日利亚拉各斯）；Department of Biomedical Engineering, McGill University（生物医学工程系，麦吉尔大学）；Perelman School of Medicine, University of Pennsylvania（佩尔曼医学学院，宾夕法尼亚大学）；Nnamdi Azikiwe University Teaching Hospital（纳曼迪·阿齐基韦大学教学医院）
Computer-aided diagnosis (CAD) has long become an integral part of radiological management of breast disease, facilitating a number of important clinical applications, including quantitative assessment of breast density and early detection of malignancies based on X-ray mammography. Common to such applications is the need to automatically discriminate between breast tissue and adjacent anatomy, with the latter being predominantly represented by pectoralis major (or pectoral muscle). Especially in the case of mammograms acquired in the mediolateral oblique (MLO) view, the muscle is easily confu…
Hybrid Attention Network for Accurate Breast Tumor Segmentation in Ultrasound Images
School of Information Engineering, Xi’an Eurasia University（信息工程学院，西安欧亚大学）；Department of Computer Science, University of Engineering and Technology Lahore（计算机科学系，拉合尔工程科技大学）
Progressive Dual Priori Network for Generalized Breast Tumor Segmentation
Guizhou University（贵州大学）；Harbin Medical University Cancer Hospital（哈尔滨医科大学附属肿瘤医院）；Univ Lyon（里昂大学）；INSA Lyon（里昂国立应用科学学院）；CNRS（法国国家科学研究中心）；Inserm（法国国家健康与医学研究院）；CREATIS（CREATIS研究所）
DSU-Net: An Attention-Enhanced Dense Skip U-Net for Breast Lesion Segmentation in Mammographic Images
Department of Biomedical Engineering, University of Wisconsin-Milwaukee（威斯康星大学密尔沃基分校生物医学工程系）；Department of Mechanical Engineering, Northern Arizona University（北亚利桑那大学机械工程系）
A Green Solution for Breast Region Segmentation Using Deep Active Learning
Department of Physics（物理系）；Norwegian University of Science and Technology（挪威科学与技术大学）；Research and Development Department（研发部）；More og Romsdal Hospital Trust（莫尔和罗姆斯达尔医院信托）；Department of Radiology（放射科）；Department of Health Sciences（健康科学系）；Stavanger Medical Imaging Group（斯塔万格医学成像组）；The University of Stavanger（斯塔万格大学）；Department of Diagnostic Imaging（诊断影像科）；Akershus University Hospital（阿克雪斯大学医院）；NordicCAD AS（北欧CAD有限公司）；Institute of Clinical Medicine（临床医学研究所）；Faculty of Medicine（医学院）
Indian Institute of Information Technology Allahabad（阿拉哈巴德印度信息技术学院）
In the clinical settings, during digital examination of histopathological slides, the pathologist annotate the slides by marking the rough boundary around the suspected tumour region. The marking or annotation is generally represented as a polygonal boundary that covers the extent of the tumour in the slide. These polygonal markings are difficult to imitate through CAD techniques since the tumour regions are heterogeneous and hence segmenting them would require exhaustive pixel wise ground truth annotation. Therefore, for CAD analysis, the ground truths are generally annotated by pathologist e…
A Multicentric Dataset for Training and Benchmarking Breast Cancer Segmentation in H&E Slides
Department of Pathology, Radboud University Medical Center（病理学系，拉德堡德大学医学中心）；Fondazione Bruno Kessler（布鲁诺·凯塞勒基金会）；Department of Cellular, Computational and Integrative Biology, University of Trento（细胞、计算与整合生物学系，特伦托大学）；Biopticka Laboratory Ltd.（Biopticka实验室有限公司）；Department of Pathology, Faculty of Medicine in Pilsen, Charles University（病理学系，皮尔森医学院，查尔斯大学）；University of Washington Medical Center（华盛顿大学医学中心）；Department of Surgical Pathology, Santa Chiara Hospital, APSS（外科病理学系，圣查理医院，APSS）；CISMed - Centre for Medical Sciences, University of Trento（CISMed医学研究中心，特伦托大学）；Pathology Unit, University and Hospital Trust of Verona（病理学部，韦罗纳大学与医院信托）；IRCCS Sacro Cuore Don Calabria Hospital（IRCCS圣心多玛利亚医院）
Deep learning has made a breakthrough in medical image segmentation in recent years due to its ability to extract high-level features without the need for prior knowledge. In this context, U-Net is one of the most advanced medical image segmentation models, with promising results in mammography. Despite its excellent overall performance in segmenting multimodal medical images, the traditional U-Net structure appears to be inadequate in various ways. There are certain U-Net design modifications, such as MultiResUNet, Connected-UNets, and AU-Net, that have improved overall performance in areas w…
Pre- to Post-Contrast Breast MRI Synthesis for Enhanced Tumour Segmentation
Universitat de Barcelona（巴塞罗那大学）；Helmholtz Center Munich（慕尼黑亥姆霍兹中心）；Technical University of Munich（慕尼黑工业大学）；Karolinska Institutet（卡罗林斯卡学院）；King’s College London（伦敦国王学院）
