Automatic lesion detection, segmentation and characterization via 3D multiscale morphological sifting in breast MRI
School of Information Technology and Electrical Engineering, University of Queensland（昆士兰大学信息技术与电气工程学院）；Science and Engineering Faculty, Queensland University of Technology（昆士兰科技大学科学与工程学院）
Hang Min, Darryl McClymont, Shekhar S. Chandra, Stuart Crozier, Andrew P. Bradley
Previous studies on computer aided detection/diagnosis (CAD) in 4D breast magnetic resonance imaging (MRI) regard lesion detection, segmentation and characterization as separate tasks, and typically require users to manually select 2D MRI slices or regions of interest as the input. In this work, we present a breast MRI CAD system that can handle 4D multimodal breast MRI data, and integrate lesion detection, segmentation and characterization with no user intervention. The proposed CAD system consists of three major stages: region candidate generation, feature extraction and region candidate classification. Breast lesions are firstly extracted as region candidates using the novel 3D multiscale morphological sifting (MMS). The 3D MMS, which uses linear structuring elements to extract lesion-like patterns, can segment lesions from breast images accurately and efficiently. Analytical features are then extracted from all available 4D multimodal breast MRI sequences, including T1-, T2-weighted and DCE sequences, to represent the signal intensity, texture, morphological and enhancement kinetic characteristics of the region candidates. The region candidates are lastly classified as lesion or normal tissue by the random under-sampling boost (RUSboost), and as malignant or benign lesion by the random forest. Evaluated on a breast MRI dataset which contains a total of 117 cases with 95 malignant and 46 benign lesions, the proposed system achieves a true positive rate (TPR) of 0.90 at 3.19 false positives per patient (FPP) for lesion detection and a TPR of 0.91 at a FPP of 2.95 for identifying malignant lesions without any user intervention. The average dice similarity index (DSI) is 0.72 for lesion segmentation. Compared with previously proposed systems evaluated on the same breast MRI dataset, the proposed CAD system achieves a favourable performance in breast lesion detection and characterization.
Iran University of Science and Technology（伊朗科技大学）；Radboud University Medical Center（拉德堡德大学医学中心）；Netherlands Cancer Institute（荷兰癌症研究所）
Purpose: We propose a deep learning-based computer-aided detection (CADe) method to detect breast lesions in ultrafast DCE-MRI sequences. This method uses both the three-dimensional spatial information and temporal information obtained from the early-phase of the dynamic acquisition. Methods: The proposed CADe method, based on a modified 3D RetinaNet model, operates on ultrafast T1 weighted sequences, which are preprocessed for motion compensation, temporal normalization, and are cropped before passing into the model. The model is optimized to enable the detection of relatively small breast le…
Accurate segmentation of breast lesions is a crucial step in evaluating the characteristics of tumors. However, this is a challenging task, since breast lesions have sophisticated shape, topological structure, and variation in the intensity distribution. In this paper, we evaluated the performance of three unsupervised algorithms for the task of breast Magnetic Resonance (MRI) lesion segmentation, namely, Gaussian Mixture Model clustering, K-means clustering and a marker-controlled Watershed transformation based method. All methods were applied on breast MRI slices following selection of regio…
Friedrich-Alexander-University Erlangen-Nuremberg（埃尔朗根-纽伦堡大学）；Universitat Politècnica de València（瓦伦西亚理工大学）；Universitätsklinikum Erlangen（埃尔朗根大学医院）
Magnetic resonance imaging (MRI) is an effective imaging modality for identifying and localizing breast lesions in women. Accurate and precise lesion segmentation using a computer-aided-diagnosis (CAD) system, is a crucial step in evaluating tumor volume and in the quantification of tumor characteristics. However, this is a challenging task, since breast lesions have sophisticated shape, topological structure, and high variance in their intensity distribution across patients. In this paper, we propose a novel marker-controlled watershed transformation-based approach, which uses the brightest p…
The University of Adelaide（阿德莱德大学）；Australian Institute for Machine Learning（澳大利亚机器学习研究所）；Delft University of Technology（代尔夫特理工大学）；Queensland University of Technology（昆士兰科技大学）
There is a heated debate on how to interpret the decisions provided by deep learning models (DLM), where the main approaches rely on the visualization of salient regions to interpret the DLM classification process. However, these approaches generally fail to satisfy three conditions for the problem of lesion detection from medical images: 1) for images with lesions, all salient regions should represent lesions, 2) for images containing no lesions, no salient region should be produced,and 3) lesions are generally small with relatively smooth borders. We propose a new model-agnostic paradigm to …
The University of Adelaide（阿德莱德大学）；Queensland University of Technology（昆士兰科技大学）；Instituto Superior Tecnico（里斯本高等理工学院）
We propose a new method for breast cancer screening from DCE-MRI based on a post-hoc approach that is trained using weakly annotated data (i.e., labels are available only at the image level without any lesion delineation). Our proposed post-hoc method automatically diagnosis the whole volume and, for positive cases, it localizes the malignant lesions that led to such diagnosis. Conversely, traditional approaches follow a pre-hoc approach that initially localises suspicious areas that are subsequently classified to establish the breast malignancy -- this approach is trained using strongly annot…
Eindhoven University of Technology（埃因霍温理工大学）；University Medical Center Utrecht（乌得勒支大学医学中心）；University Utrecht（乌得勒支大学）；Harvard Medical School（哈佛医学院）；Beth Israel Deaconess Medical Center（贝斯以色列女执事医疗中心）
Ductal carcinoma in situ (DCIS) is a non-invasive breast cancer that can progress into invasive ductal carcinoma (IDC). Studies suggest DCIS is often overtreated since a considerable part of DCIS lesions may never progress into IDC. Lower grade lesions have a lower progression speed and risk, possibly allowing treatment de-escalation. However, studies show significant inter-observer variation in DCIS grading. Automated image analysis may provide an objective solution to address high subjectivity of DCIS grading by pathologists. In this study, we developed a deep learning-based DCIS grading sys…
Immunohistochemistry guided segmentation of benign epithelial cells, in situ lesions, and invasive epithelial cells in breast cancer slides
Norwegian University of Science and Technology (NTNU)（挪威科技大学）；St. Olavs hospital, Trondheim University Hospital（圣奥拉夫医院，特隆赫姆大学医院）；SINTEF Digital（SINTEF数字研究所）；Sopra Steria（索普瑞斯特利亚）；Uppsala University（乌普萨拉大学）；University of Bergen（卑尔根大学）；Haukeland University Hospital（豪克兰大学医院）
LesiOnTime -- Joint Temporal and Clinical Modeling for Small Breast Lesion Segmentation in Longitudinal DCE-MRI
Computational Imaging Research Lab, Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Austria（医学影像研究实验室，生物医学影像与影像引导治疗系，维也纳医科大学）；Comprehensive Center for AI in Medicine, Medical University of Vienna, Austria（医学人工智能综合中心，维也纳医科大学）；Breast Health Center, Privatklinik Döbling, Austria（乳腺健康中心，多克林根私人诊所）；Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Austria（生物医学影像与影像引导治疗系，维也纳医科大学）；Department of Obstetrics and Gynecology, Medical University of Vienna, Austria（妇产科系，维也纳医科大学）；Department of Pathology, Medical University of Vienna, Austria（病理学系，维也纳医科大学）；Comprehensive Cancer Center, Medical University of Vienna, Austria（综合癌症中心，维也纳医科大学）
Machine learning is widely used in developing computer-aided diagnosis (CAD) schemes of medical images. However, CAD usually computes large number of image features from the targeted regions, which creates a challenge of how to identify a small and optimal feature vector to build robust machine learning models. In this study, we investigate feasibility of applying a random projection algorithm to build an optimal feature vector from the initially CAD-generated large feature pool and improve performance of machine learning model. We assemble a retrospective dataset involving 1,487 cases of mamm…
University of California, San Diego（加利福尼亚大学圣地亚哥分校）；Institute of Fundamental Technological Research, Polish Academy of Sciences（波兰科学院基础技术研究所）；Polish-Japanese Academy of Information Technology（波兰-日本信息技术学院）；The Maria Skłodowska-Curie Memorial Cancer Centre and Institute of Oncology（玛丽·斯克洛多夫斯卡-居里纪念癌症中心和肿瘤研究所）
Deep learning algorithms, especially convolutional neural networks, have become a methodology of choice in medical image analysis. However, recent studies in computer vision show that even a small modification of input image intensities may cause a deep learning model to classify the image differently. In medical imaging, the distribution of image intensities is related to applied image reconstruction algorithm. In this paper we investigate the impact of ultrasound image reconstruction method on breast lesion classification with neural transfer learning. Due to high dynamic range raw ultrasoni…
Deep transfer learning using dynamic contrast-enhanced magnetic resonance imaging (DCE-MRI) has shown strong predictive power in characterization of breast lesions. However, pretrained convolutional neural networks (CNNs) require 2D inputs, limiting the ability to exploit the rich 4D (volumetric and temporal) image information inherent in DCE-MRI that is clinically valuable for lesion assessment. Training 3D CNNs from scratch, a common method to utilize high-dimensional information in medical images, is computationally expensive and is not best suited for moderately sized healthcare datasets. …
Universidad Técnica Particular de Loja（洛哈技术大学）；Universitat Politécnica de Valencia（瓦伦西亚理工大学）；University of Waterloo（滑铁卢大学）
Breast cancer is the most common invasive cancer in women, and the second main cause of death. Breast cancer screening is an efficient method to detect indeterminate breast lesions early. The common approaches of screening for women are tomosynthesis and mammography images. However, the traditional manual diagnosis requires an intense workload by pathologists, who are prone to diagnostic errors. Thus, the aim of this study is to build a deep convolutional neural network method for automatic detection, segmentation, and classification of breast lesions in mammography images. Based on deep learn…
A Chain-of-thought Reasoning Breast Ultrasound Dataset Covering All Histopathology Categories
Peking University（北京大学）；Peking Union Medical College Hospital（北京大学人民医院）；Peking University Cancer Hospital & Institute（北京大学肿瘤医院）；National Cancer Center / National Clinical Research Center for Cancer / Cancer Hospital, Chinese Academy of Medical Sciences and Peking Union Medical College（中国医学科学院国家癌症中心/国家癌症临床科研中心/癌症医院）；Shenzhen Maternity & Child Health Care Hospital（深圳妇幼保健医院）；Xi’an Jiaotong University（西安交通大学）；Yizhun Medical AI Co., Ltd（亿众医疗人工智能有限公司）
University of Toronto（多伦多大学）；Sunnybrook Research Institute（桑尼布鲁克研究所）
High predictive performance and ease of use and interpretability are important requirements for the applicability of a computer-aided diagnosis (CAD) to human reading studies. We propose a CAD system specifically designed to be more comprehensible to the radiologist reviewing screening breast MRI studies. Multiparametric imaging features are combined to produce a CAD system for differentiating cancerous and non-cancerous lesions. The complete system uses a rule-extraction algorithm to present lesion classification results in an easy to understand graph visualization.
Robustness of breast lesion segmentation under MRI undersampling improves with k-space-aware deep learning
Institute for AI in Medicine (IKIM), University Hospital Essen（人工智能医学研究所（IKIM），埃森大学医院）；Department of Physics, Technical University Dortmund（物理系，多特蒙德技术大学）；Division of Radiology, German Cancer Research Center (DKFZ)（放射学部，德国癌症研究中心（DKFZ））；Cancer Research Center Cologne Essen (CCCE), University Medicine Essen（科隆埃森癌症研究中心（CCCE），埃森大学医学中心）；RACOON Study Group, Site Essen（RACOON研究组，埃森站点）；German Cancer Consortium (DKTK), Partner Site Essen（德国癌症联合会（DKTK），埃森合作伙伴站点）；Medical Faculty and Faculty of Computer Science, University of Duisburg-Essen（医学系和计算机科学系，杜伊斯堡-埃森大学）
Mask-Guided Multi-Channel SwinUNETR Framework for Robust MRI Classification
Departament de Matemàtiques i Informàtica, Universitat de Barcelona, Spain（巴塞罗那大学数学与计算机系）；Computer Vision Center, Bellaterra, Spain（贝尔特拉拉计算机视觉中心）；Institució Catalana de Recerca i Estudis Avançats (ICREA), Passeig Lluís Companys 23, Barcelona, Spain（加泰罗尼亚高级研究与教育研究所）
PRISM-Net: Patient-specific reference-guided inter-breast symmetry matching for three-class breast DCE-MRI classification
Nankai University（南开大学）；Zhongguancun Academy（中关村学院）；The First Medical Center of Chinese PLA General Hospital（中国人民解放军总医院第一医学中心）；Beijing University of Posts and Telecommunications（北京邮电大学）；The Six Medical Center of Chinese PLA General Hospital（中国人民解放军总医院第六医学中心）；Tsinghua University（清华大学）
The Johns Hopkins University School of Medicine（约翰霍普金斯大学医学院）；Sidney Kimmel Comprehensive Cancer Center（西德尼·基梅尔综合癌症中心）；The Johns Hopkins University（约翰霍普金斯大学）；University of Kentucky（肯塔基大学）；University of Wisconsin School of Medicine and Public Health（威斯康星大学医学与公共卫生学院）
A new paradigm is beginning to emerge in Radiology with the advent of increased computational capabilities and algorithms. This has led to the ability of real time learning by computer systems of different lesion types to help the radiologist in defining disease. For example, using a deep learning network, we developed and tested a multiparametric deep learning (MPDL) network for segmentation and classification using multiparametric magnetic resonance imaging (mpMRI) radiological images. The MPDL network was constructed from stacked sparse autoencoders with inputs from mpMRI. Evaluation of MPD…
Towards Trustworthy Breast Tumor Segmentation in Ultrasound using Monte Carlo Dropout and Deep Ensembles for Epistemic Uncertainty Estimation
Department of Computer Engineering, Kwame Nkrumah University of Science and Technology（计算机工程系，加纳科拉布大学科学与技术大学）；Global Health and Infectious Disease Group, Kumasi Centre for Collaborative Research in Tropical Medicine（全球卫生与传染病组，科拉布热带医学协作研究中心）；Department of Radiology, National Hospital Abuja（放射科，阿布贾国家医院）；Computer Science Department, FAST National University of Computer and Emerging Sciences（计算机科学系，FAST国家计算机与新兴科学大学）；Medical Artificial Intelligence Lab, Lagos, Nigeria（医学人工智能实验室，尼日利亚拉各斯）；Department of Biomedical Engineering, McGill University（生物医学工程系，麦吉尔大学）；Perelman School of Medicine, University of Pennsylvania（佩尔曼医学学院，宾夕法尼亚大学）；Nnamdi Azikiwe University Teaching Hospital（纳曼迪·阿齐基韦大学教学医院）
Efficient Multi-scale Masked Autoencoders with Hybrid-Attention Mechanism for Breast Lesion Classification
Department of Electrical and Computer Engineering, University of Houston（电气与计算机工程系，德克萨斯大学）；Systems Medicine and Biomedical Engineering, Houston Methodist（系统医学与生物医学工程，休斯顿 Methodist）
DBT-DINO: Towards Foundation model based analysis of Digital Breast Tomosynthesis
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School（阿提诺拉·A·马丁诺生物医学影像中心、麻省总医院和哈佛医学院）；Department of Radiology, Charité - Universitätsmedizin Berlin（放射科、柏林夏里特大学医学院）；Mass General Brigham Data Science Office（麻省总医院数据科学办公室）；Department of Computer Science, Institute for Machine Learning, ETH Zürich（计算机科学系、机器学习研究所、苏黎世联邦理工学院）；Massachusetts General Hospital Cancer Center and Harvard Medical School（麻省总医院癌症中心和哈佛医学院）；Department of Radiology, Massachusetts General Hospital（放射科、麻省总医院）；Department of Radiology, University of Wisconsin School of Medicine and Public Health（放射科、威斯康星大学医学与公共卫生学院）
Changes in Visual Attention Patterns for Detection Tasks due to Dependencies on Signal and Background Spatial Frequencies
Department of Biomedical Engineering, University of Houston（生物医学工程系，休斯顿大学）；Department of Physics, University of Houston（物理系，休斯顿大学）；Department of Electrical and Computer Engineering, University of Houston（电气与计算机工程系，休斯顿大学）
SAFE-Diff: Scale-Aware Attention and Feature-Dispersive Diffusion with Uncertainty Estimation for Contrast-Enhanced Breast MRI Synthesis
Department of Medical Imaging, Radboud University Medical Center（鲁文大学医学中心医学影像部）；Department of Radiology, Netherlands Cancer Institute（荷兰癌症研究所放射科）；Maastro Clinic（马斯垂克诊所）；Faculty of Applied Science, Macao Polytechnic University（澳门理工大学应用科学学院）；Department of Radiation Oncology, Netherlands Cancer Institute（荷兰癌症研究所放射肿瘤科）
Xiamen University（厦门大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）；Institute of High Performance Computing, Agency for Science, Technology and Research（新加坡科技研究局高性能计算研究院）；The Hong Kong Polytechnic University（香港理工大学）
Breast lesion detection in ultrasound is critical for breast cancer diagnosis. Existing methods mainly rely on individual 2D ultrasound images or combine unlabeled video and labeled 2D images to train models for breast lesion detection. In this paper, we first collect and annotate an ultrasound video dataset (188 videos) for breast lesion detection. Moreover, we propose a clip-level and video-level feature aggregated network (CVA-Net) for addressing breast lesion detection in ultrasound videos by aggregating video-level lesion classification features and clip-level temporal features. The clip-…
The Chinese University of Hong Kong（香港中文大学）；Imsight Medical Technology, Co., Ltd.（推想医疗科技股份有限公司）；Imperial College London（伦敦帝国理工学院）；The Fifth Medical Center of Chinese PLA General Hospital（中国人民解放军总医院第五医学中心）；Beijing Image Diagnostic Center of Rimag（北京一脉阳光影像诊断中心）
Accurate and automatic analysis of breast MRI plays an important role in early diagnosis and successful treatment planning for breast cancer. Due to the heterogeneity nature, accurate diagnosis of tumors remains a challenging task. In this paper, we propose to identify breast tumor in MRI by Cosine Margin Sigmoid Loss (CMSL) with deep learning (DL) and localize possible cancer lesion by COrrelation Attention Map (COAM) based on the learned features. The CMSL embeds tumor features onto a hypersphere and imposes a decision margin through cosine constraints. In this way, the DL model could learn …
A Preliminary Investigation into Search and Matching for Tumour Discrimination in WHO Breast Taxonomy Using Deep Networks
Mayo Clinic（梅奥诊所）；University of Waterloo（滑铁卢大学）；University of Pittsburgh Medical Center（匹兹堡大学医学中心）；Luma Medical Centre（卢玛医疗中心）；International Agency for Research on Cancer（国际癌症研究机构）；Rhazes Lab, Department of Artificial Intelligence and Informatics, Mayo Clinic, Rochester, MN, USA（梅奥诊所Rhazes实验室（人工智能与信息学系））；Kimia Lab, University of Waterloo, Canada（滑铁卢大学Kimia实验室）
University of Houston（休斯顿大学）；Houston Methodist（休斯顿卫理公会医院）
Accurate breast lesion risk estimation can significantly reduce unnecessary biopsies and help doctors decide optimal treatment plans. Most existing computer-aided systems rely solely on mammogram features to classify breast lesions. While this approach is convenient, it does not fully exploit useful information in clinical reports to achieve the optimal performance. Would clinical features significantly improve breast lesion classification compared to using mammograms alone? How to handle missing clinical information caused by variation in medical practice? What is the best way to combine mamm…
Emory University（埃默里大学）；Georgia Institute of Technology（佐治亚理工学院）；Kennesaw State University（肯尼索州立大学）
Developing and validating artificial intelligence models in medical imaging requires datasets that are large, granular, and diverse. To date, the majority of publicly available breast imaging datasets lack in one or more of these areas. Models trained on these data may therefore underperform on patient populations or pathologies that have not previously been encountered. The EMory BrEast imaging Dataset (EMBED) addresses these gaps by providing 3650,000 2D and DBT screening and diagnostic mammograms for 116,000 women divided equally between White and African American patients. The dataset also…
University of Malaya（马来亚大学）；University of Tehran（德黑兰大学）
Reliable classification of benign and malignant lesions in breast ultrasound images can provide an effective and relatively low cost method for early diagnosis of breast cancer. The accuracy of the diagnosis is however highly dependent on the quality of the ultrasound systems and the experience of the users (radiologists). The leverage in deep convolutional neural network approaches provided solutions in efficient analysis of breast ultrasound images. In this study, we proposed a new framework for classification of breast cancer lesions by use of an attention module in modified VGG16 architect…
We present Spectral GUI, a multiplatform breast MR image analysis tool designed to facilitate the segmentation of fibro glandular tissues and lesions in T1 weighted breast MR images via a graphical user interface (GUI). Spectral GUIR uses spectrum loft method [1] for breast MR image segmentation. Not only is it interactive, but robust and expeditious at the same time. Being devoid of any machine learning algorithm, it shows exceptionally high execution speed with minimal overheads. The accuracy of the results has been simultaneously measured using performance metrics and expert entailment. The…
UGGNet: Bridging U-Net and VGG for Advanced Breast Cancer Diagnosis
School of Engineering, Tokyo Institute of Technology（东京技术大学工学院）；Faculty of Information Technology Nguyen Tat Thanh University（Nguyen Tat Thanh大学信息科技学院）
BreastSegNet: Multi-label Segmentation of Breast MRI
Department of Biostatistics \& Bioinformatics, Duke University Department of Electrical；Computer Engineering, Duke University Department of Radiology, Duke University Medical Center Department of Computer Science, Duke University
University of Toronto（多伦多大学）；National Cancer Research Centre（国家癌症研究中心）；Institute for Oncology and Radiology（肿瘤与放射学研究所）
Accurate diagnosis of breast cancer in histopathology images is challenging due to the heterogeneity of cancer cell growth as well as of a variety of benign breast tissue proliferative lesions. In this paper, we propose a practical and self-interpretable invasive cancer diagnosis solution. With minimum annotation information, the proposed method mines contrast patterns between normal and malignant images in unsupervised manner and generates a probability map of abnormalities to verify its reasoning. Particularly, a fully convolutional autoencoder is used to learn the dominant structural patter…
Center for Data Science, New York University（纽约大学数据科学中心）；Department of Computer Science, Courant Institute, New York University（纽约大学库朗研究所计算机科学系）；Department of Radiology, NYU School of Medicine（纽约大学医学院放射科）；Perlmutter Cancer Center, NYU Langone Health（纽约大学朗格尼健康系统珀尔马特癌症中心）；Center for Advanced Imaging Innovation and Research, NYU Langone Health（纽约大学朗格尼健康系统先进成像创新与研究中心）；CIFAR Associate Fellow（CIFAR研究员（注：CIFAR是加拿大英属哥伦比亚大学的一个研究机构，但根据提取规则，此处仅提取“CIFAR”相关部分，严格按英文保留））
Medical images differ from natural images in significantly higher resolutions and smaller regions of interest. Because of these differences, neural network architectures that work well for natural images might not be applicable to medical image analysis. In this work, we extend the globally-aware multiple instance classifier, a framework we proposed to address these unique properties of medical images. This model first uses a low-capacity, yet memory-efficient, network on the whole image to identify the most informative regions. It then applies another higher-capacity network to collect detail…
The Chinese University of Hong Kong（香港中文大学）；University of Cambridge（剑桥大学）；Inception Institute of Artificial Intelligence（启迪人工智能研究院）；The Hong Kong University of Science and Technology（香港科技大学）；Jinan University（暨南大学）；Southern University of Science and Technology（南方科技大学）；Chinese Academy of Sciences（中国科学院）
Automatic breast lesion segmentation in ultrasound helps to diagnose breast cancer, which is one of the dreadful diseases that affect women globally. Segmenting breast regions accurately from ultrasound image is a challenging task due to the inherent speckle artifacts, blurry breast lesion boundaries, and inhomogeneous intensity distributions inside the breast lesion regions. Recently, convolutional neural networks (CNNs) have demonstrated remarkable results in medical image segmentation tasks. However, the convolutional operations in a CNN often focus on local regions, which suffer from limit…
The rapid development of deep learning, a family of machine learning techniques, has spurred much interest in its application to medical imaging problems. Here, we develop a deep learning algorithm that can accurately detect breast cancer on screening mammograms using an "end-to-end" training approach that efficiently leverages training datasets with either complete clinical annotation or only the cancer status (label) of the whole image. In this approach, lesion annotations are required only in the initial training stage, and subsequent stages require only image-level labels, eliminating the …
Shanghai Jiao Tong University（上海交通大学）；Shanghai General Hospital（上海市第一人民医院）；Shanghai Jiao Tong University School of Medicine（上海交通大学医学院）
Previous deep learning based Computer Aided Diagnosis (CAD) system treats multiple views of the same lesion as independent images. Since an ultrasound image only describes a partial 2D projection of a 3D lesion, such paradigm ignores the semantic relationship between different views of a lesion, which is inconsistent with the traditional diagnosis where sonographers analyze a lesion from at least two views. In this paper, we propose a multi-task framework that complements Benign/Malignant classification task with lesion recognition (LR) which helps leveraging relationship among multiple views …
Nankai University（南开大学）；Civil Aviation General Hospital（民航总医院）；Chinese PLA General Hospital（中国人民解放军总医院）
Breast lesions segmentation is an important step of computer-aided diagnosis system, and it has attracted much attention. However, accurate segmentation of malignant breast lesions is a challenging task due to the effects of heterogeneous structure and similar intensity distributions. In this paper, a novel bidirectional aware guidance network (BAGNet) is proposed to segment the malignant lesion from breast ultrasound images. Specifically, the bidirectional aware guidance network is used to capture the context between global (low-level) and local (high-level) features from the input coarse sal…
University of Delaware（特拉华大学）；Amazon Web Services（亚马逊云科技）；University of Rochester（罗切斯特大学）
Objective and Impact Statement. We adopt a deep learning model for bone osteolysis prediction on computed tomography (CT) images of murine breast cancer bone metastases. Given the bone CT scans at previous time steps, the model incorporates the bone-cancer interactions learned from the sequential images and generates future CT images. Its ability of predicting the development of bone lesions in cancer-invading bones can assist in assessing the risk of impending fractures and choosing proper treatments in breast cancer bone metastasis. Introduction. Breast cancer often metastasizes to bone, cau…
Data scarcity and class imbalance are two fundamental challenges in many machine learning applications to healthcare. Breast cancer classification in mammography exemplifies these challenges, with a malignancy rate of around 0.5% in a screening population, which is compounded by the relatively small size of lesions (~1% of the image) in malignant cases. Simultaneously, the prevalence of screening mammography creates a potential abundance of non-cancer exams to use for training. Altogether, these characteristics lead to overfitting on cancer cases, while under-utilizing non-cancer data. Here, w…
College of Information Science and Technology, Northwest University（西北大学信息科学与技术学院）；University of Texas Southwestern Medical Center（德克萨斯大学西南医学中心）
Breast ultrasound (US) is an effective imaging modality for breast cancer detec-tion and diagnosis. The structural characteristics of breast lesion play an im-portant role in Computer-Aided Diagnosis (CAD). In this paper, a novel struc-ture-aware triplet path networks (SATPN) was designed to integrate classifica-tion and two image reconstruction tasks to achieve accurate diagnosis on US im-ages with small training dataset. Specifically, we enhance clinically-approved breast lesion structure characteristics though converting original breast US imag-es to BIRADS-oriented feature maps (BFMs) with…
MeisenMeister: A Simple Two Stage Pipeline for Breast Cancer Classification on MRI
German Cancer Research Center (DKFZ) Heidelberg, Division of Medical Image Computing, Germany（德国癌症研究中心（DKFZ）海德堡，医学影像计算部，德国）；Medical Faculty, Heidelberg University, Germany（海德堡大学医学学院，德国）；Faculty of Mathematics and Computer Science, Heidelberg University（海德堡大学数学与计算机科学学院）；Learning Group, Department of Radiation Oncology, Heidelberg University Hospital, Heidelberg, Germany（放射肿瘤学系学习组，海德堡大学医院，海德堡，德国）
DSU-Net: An Attention-Enhanced Dense Skip U-Net for Breast Lesion Segmentation in Mammographic Images
Department of Biomedical Engineering, University of Wisconsin-Milwaukee（威斯康星大学密尔沃基分校生物医学工程系）；Department of Mechanical Engineering, Northern Arizona University（北亚利桑那大学机械工程系）
Radboud University Medical Center（拉德堡德大学医学中心）；Delft University of Technology（代尔夫特理工大学）
Computer-aided detection or decision support systems aim to improve breast cancer screening programs by helping radiologists to evaluate digital mammography (DM) exams. Commonly such methods proceed in two steps: selection of candidate regions for malignancy, and later classification as either malignant or not. In this study, we present a candidate detection method based on deep learning to automatically detect and additionally segment soft tissue lesions in DM. A database of DM exams (mostly bilateral and two views) was collected from our institutional archive. In total, 7196 DM exams (28294 …
A Large Model for Non-invasive and Personalized Management of Breast Cancer from Multiparametric MRI
The Hong Kong University of Science and Technology（香港科技大学）；PLA Middle Military Command General Hospital（中国人民解放军中部战区总医院）；The University of Hong Kong（香港大学）；The Chinese University of Hong Kong（香港中文大学）；Yunnan Cancer Hospital（云南省肿瘤医院）；th Medical Center of Chinese PLA General Hospital（中国人民解放军总医院第五医学中心）；Southern Medical University（南方医科大学）
Shifting More Attention to Breast Lesion Segmentation in Ultrasound Videos
Xiamen University（厦门大学）；The Hong Kong University of Science and Technology (Guangzhou)（香港科技大学（广州））；The Hong Kong University of Science and Technology（香港科技大学）；Agency for Science, Technology and Research（新加坡科技研究局）；Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院）
School of Electrical Engineering, Tel-Aviv University（特拉维夫大学电气工程学院）；The Manuel and Raquel Klachky Chair of Image Processing, School of Electrical Engineering, Tel-Aviv University（特拉维夫大学电气工程学院 Manuel and Raquel Klachky 图像处理教授职位）；Diagnostic Imaging, Sheba Medical Center, affiliated to the Sackler School of Medicine, Tel-Aviv University（舍巴医疗中心诊断影像科，隶属于特拉维夫大学萨克勒医学院）
Mammography and ultrasound are extensively used by radiologists as complementary modalities to achieve better performance in breast cancer diagnosis. However, existing computer-aided diagnosis (CAD) systems for the breast are generally based on a single modality. In this work, we propose a deep-learning based method for classifying breast cancer lesions from their respective mammography and ultrasound images. We present various approaches and show a consistent improvement in performance when utilizing both modalities. The proposed approach is based on a GoogleNet architecture, fine-tuned for o…
