Histopathological image analysis is the gold standard to diagnose cancer. Carcinoma is a subtype of cancer that constitutes more than 80% of all cancer cases. Squamous cell carcinoma and adenocarcinoma are two major subtypes of carcinoma, diagnosed by microscopic study of biopsy slides. However, manual microscopic evaluation is a subjective and time-consuming process. Many researchers have reported methods to automate carcinoma detection and classification. The increasing use of artificial intelligence (AI) in the automation of carcinoma diagnosis also reveals a significant rise in the use of deep network models. In this systematic literature review, we present a comprehensive review of the state-of-the-art approaches reported in carcinoma diagnosis using histopathological images. Studies are selected from well-known databases with strict inclusion/exclusion criteria. We have categorized the articles and recapitulated their methods based on specific organs of carcinoma origin. Further, we have summarized pertinent literature on AI methods, highlighted critical challenges and limitations, and provided insights on future research direction in automated carcinoma diagnosis. Out of 101 articles selected, most of the studies experimented on private datasets with varied image sizes, obtaining accuracy between 63% and 100%. Overall, this review highlights the need for a generalized AI-based carcinoma diagnostic system. Additionally, it is desirable to have accountable approaches to extract microscopic features from images of multiple magnifications that should mimic pathologists' evaluations.
Histopathological characterization of colorectal polyps allows to tailor patients' management and follow up with the ultimate aim of avoiding or promptly detecting an invasive carcinoma. Colorectal polyps characterization relies on the histological analysis of tissue samples to determine the polyps malignancy and dysplasia grade. Deep neural networks achieve outstanding accuracy in medical patterns recognition, however they require large sets of annotated training images. We introduce UniToPatho, an annotated dataset of 9536 hematoxylin and eosin (H&E) stained patches extracted from 292 whole-…
Techno India University, West Bengal（西孟加拉邦Techno印度大学）
In this paper we present a novel method for an automated diagnosis of breast carcinoma through multilevel iterative variational mode decomposition (VMD) and textural features encompassing Zernaike moments, fractal dimension and entropy features namely, Kapoor entropy, Renyi entropy, Yager entropy features are extracted from VMD components. The proposed method considers the histopathological image as a set of multidimensional spatially-evolving signals. ReliefF algorithm is used to select the discriminatory features and statistically most significant features are fed to squares support vector m…
Kepler University Hospital（开普勒大学医院）；Johannes Kepler University Linz（林茨约翰内斯·开普勒大学）；Medical University of Vienna（维也纳医科大学）
Diagnosing basal cell carcinomas (BCC), one of the most common cutaneous malignancies in humans, is a task regularly performed by pathologists and dermato-pathologists. Improving histological diagnosis by providing diagnosis suggestions, i.e. computer-assisted diagnoses is actively researched to improve safety, quality and efficiency. Increasingly, machine learning methods are applied due to their superior performance. However, typical images obtained by scanning histological sections often have a resolution that is prohibitive for processing with current state-of-the-art neural networks. Furt…
The grade of clear cell renal cell carcinoma (ccRCC) is a critical prognostic factor, making ccRCC nuclei grading a crucial task in RCC pathology analysis. Computer-aided nuclei grading aims to improve pathologists' work efficiency while reducing their misdiagnosis rate by automatically identifying the grades of tumor nuclei within histopathological images. Such a task requires precisely segment and accurately classify the nuclei. However, most of the existing nuclei segmentation and classification methods can not handle the inter-class similarity property of nuclei grading, thus can not be di…
Lung and Colon cancer are one of the leading causes of mortality and morbidity in adults. Histopathological diagnosis is one of the key components to discern cancer type. The aim of the present research is to propose a computer aided diagnosis system for diagnosing squamous cell carcinomas and adenocarcinomas of lung as well as adenocarcinomas of colon using convolutional neural networks by evaluating the digital pathology images for these cancers. Hereby, rendering artificial intelligence as useful technology in the near future. A total of 2500 digital images were acquired from LC25000 datase…
Xi’an Jiaotong University（西安交通大学）；Pennsylvania State University（宾夕法尼亚州立大学）；the First Affiliated Hospital of Xi’an Jiaotong University（西安交通大学第一附属医院）
Diagnostic pathology, which is the basis and gold standard of cancer diagnosis, provides essential information on the prognosis of the disease and vital evidence for clinical treatment. Tumor region detection, subtype and grade classification are the fundamental diagnostic indicators for renal cell carcinoma (RCC) in whole-slide images (WSIs). However, pathological diagnosis is subjective, differences in observation and diagnosis between pathologists is common in hospitals with inadequate diagnostic capacity. The main challenge for developing deep learning based RCC diagnostic system is the la…
Vietnam Aviation Academy（越南航空学院）；Ho Chi Minh City Open University（胡志明市开放大学）；University of Information Technology, VNU-HCM（胡志明市国家大学信息技术大学）
According to some medical imaging techniques, breast histopathology images called Hematoxylin and Eosin are considered as the gold standard for cancer diagnoses. Based on the idea of dividing the pathologic image (WSI) into multiple patches, we used the window [512,512] sliding from left to right and sliding from top to bottom, each sliding step overlapping by 50% to augmented data on a dataset of 400 images which were gathered from the ICIAR 2018 Grand Challenge. Then use the EffficientNet model to classify and identify the histopathological images of breast cancer into 4 types: Normal, Benig…
While microscopic analysis of histopathological slides is generally considered as the gold standard method for performing cancer diagnosis and grading, the current method for analysis is extremely time consuming and labour intensive as it requires pathologists to visually inspect tissue samples in a detailed fashion for the presence of cancer. As such, there has been significant recent interest in computer aided diagnosis systems for analysing histopathological slides for cancer grading to aid pathologists to perform cancer diagnosis and grading in a more efficient, accurate, and consistent ma…
Toward Efficient Weakly Supervised Semantic Segmentation Using Only Low-Magnification Histopathological Images
University of Information Technology, Ho Chi Minh City, Vietnam（越南胡志明市信息科技学院）；Vietnam National University Ho Chi Minh City, Ho Chi Minh City, Vietnam（越南国家大学胡志明市分校）
Arctique: An artificial histopathological dataset unifying realism and controllability for uncertainty quantification
Max-Delbrück-Center for Molecular Medicine in the Helmholtz Association（亥姆霍兹联合会马克斯·德尔布吕克分子医学中心）；Helmholtz Imaging（亥姆霍兹成像中心）；Charité—Universitätsmedizin Berlin（柏林夏里特医学院）；Freie Universität Berlin（柏林自由大学）；Humboldt-Universität zu Berlin（柏林洪堡大学）；University of Potsdam（波茨坦大学）
BCDNet: A Fast Residual Neural Network For Invasive Ductal Carcinoma Detection
Glasgow College, University of Electronic Science and Technology of China（电子科技大学格拉斯哥学院）；School of Automation Engineering, University of Electronic Science and Technology of China（电子科技大学自动化工程学院）
James A. Haley Veterans’ Hospital（詹姆斯·A·黑利退伍军人医院）；University of South Florida（南佛罗里达大学）；Moffitt Cancer Center（莫菲特癌症中心）
The field of Machine Learning, a subset of Artificial Intelligence, has led to remarkable advancements in many areas, including medicine. Machine Learning algorithms require large datasets to train computer models successfully. Although there are medical image datasets available, more image datasets are needed from a variety of medical entities, especially cancer pathology. Even more scarce are ML-ready image datasets. To address this need, we created an image dataset (LC25000) with 25,000 color images in 5 classes. Each class contains 5,000 images of the following histologic entities: colon a…
Northwestern Polytechnical University（西北工业大学）；Tianjin Medical University（天津医科大学）
Goal: Squamous cell carcinoma of cervix is one of the most prevalent cancer worldwide in females. Traditionally, the most indispensable diagnosis of cervix squamous carcinoma is histopathological assessment which is achieved under microscope by pathologist. However, human evaluation of pathology slide is highly depending on the experience of pathologist, thus big inter- and intra-observer variability exists. Digital pathology, in combination with deep learning provides an opportunity to improve the objectivity and efficiency of histopathologic slide analysis. Methods: In this study, we obtaine…
A Hierarchical Transformer Encoder to Improve Entire Neoplasm Segmentation on Whole Slide Image of Hepatocellular Carcinoma
Université Paris Cité（巴黎西岱大学）；University of Applied Sciences of Western Switzerland (HES-SO Valais)（瑞士西部应用科学大学（瓦莱州高等专业学院））；French University Institute (IUF)（法国大学研究院）
针对肝细胞癌 WSI 全肿瘤分割难题，提出分层 Transformer 架构 HiTrans，在 4096×4096 图像块上学习全局依赖并提升分割性能。
Unraveling Radiomics Complexity: Strategies for Optimal Simplicity in Predictive Modeling
Université de Sherbrooke（谢布鲁克大学）；OncoRay – National Center for Radiation Research in Oncology, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology, Helmholtz-Zentrum Dresden-Rossendorf（德累斯顿工业大学卡尔·古斯塔夫·卡鲁斯医学院及大学医院OncoRay肿瘤放射研究国家中心，德累斯顿-罗森多夫亥姆霍兹研究中心）；Cedars-Sinai Medical Center（西达赛奈医疗中心）；University of California San Francisco（加利福尼亚大学旧金山分校）；Stanford University（斯坦福大学）
Generalisation of automatic tumour segmentation in histopathological whole-slide images across multiple cancer types
Institute for Cancer Genetics and Informatics（癌症基因组学与信息学研究所）；Oslo University Hospital（奥斯陆大学医院）；University of Oslo（奥斯陆大学）；Department of Gastrointestinal（胃肠科部）；Institute of Clinical Medicine（临床医学研究所）；Department of Gynaecological Oncology（妇科肿瘤科部）；Amsterdam University Medical Centres（阿姆斯特丹大学医学中心）；Department of Obstetrics and Gynaecology（妇产科部）；Comprehensive Cancer Center Innsbruck（因斯布鲁克综合癌症中心）；Innsbruck Medical University（因斯布鲁克医学院）；Vestre Viken Hospital Trust（维斯特维肯医院信托）；Department of Medical Biology（医学生物学部）；UiT The Arctic University of Norway（挪威北极大学（UiT））；Department of Clinical Pathology（临床病理学部）
Jalpaiguri Government Engineering College（贾尔派古里政府工程学院）
Invasive ductal carcinoma (IDC), which is also sometimes known as the infiltrating ductal carcinoma, is the most regular form of breast cancer. It accounts for about 80% of all breast cancers. According to the American Cancer Society, more than 180,000 women in the United States are diagnosed with invasive breast cancer each year. The survival rate associated with this form of cancer is about 77% to 93% depending on the stage at which they are being diagnosed. The invasiveness and the frequency of the occurrence of these disease makes it one of the difficult cancers to be diagnosed. Our propos…
A Polarization and Radiomics Feature Fusion Network for the Classification of Hepatocellular Carcinoma and Intrahepatic Cholangiocarcinoma
University College London（伦敦大学学院）；Tsinghua University（清华大学）；Tsinghua Shenzhen International Graduate School（清华大学深圳国际研究生院）；Tsinghua-Berkeley Shenzhen Institute（清华-伯克利深圳学院）；Fujian Medical University Cancer Hospital（福建医科大学肿瘤医院）；Fujian Cancer Hospital（福建省肿瘤医院）
Cancer is one of the most dangerous diseases to humans, and yet no permanent cure has been developed for it. Breast cancer is one of the most common cancer types. According to the National Breast Cancer foundation, in 2020 alone, more than 276,000 new cases of invasive breast cancer and more than 48,000 non-invasive cases were diagnosed in the US. To put these figures in perspective, 64% of these cases are diagnosed early in the disease's cycle, giving patients a 99% chance of survival. Artificial intelligence and machine learning have been used effectively in detection and treatment of severa…
CB-HVTNet: A channel-boosted hybrid vision transformer network for lymphocyte assessment in histopathological images
Pakistan Institute of Engineering & Applied Sciences（巴基斯坦工程与应用科学学院）；Air University（空军大学）；Universiti Teknologi PETRONAS（马来西亚国油科技大学）；Korea National University of Transportation（韩国交通大学）
University of Warwick（华威大学）；University of Nottingham（诺丁汉大学）；Indian Institute of Technology Guwahati（印度理工学院古瓦哈提分校）；Maynooth University（梅努斯大学）；NLP Logix LLC（NLP Logix有限责任公司）；University of Castilla-La Mancha（卡斯蒂利亚-拉曼恰大学）；University of Canterbury（坎特伯雷大学）；Friedrich Schiller University of Jena（耶拿弗里德里希·席勒大学）；MSD International GmbH（MSD国际有限公司）；Singapore Agency for Science, Technology and Research（新加坡科技研究局）；University Hospitals Coventry and Warwickshire（考文垂和沃里克郡大学医院）
Evaluating expression of the Human epidermal growth factor receptor 2 (Her2) by visual examination of immunohistochemistry (IHC) on invasive breast cancer (BCa) is a key part of the diagnostic assessment of BCa due to its recognised importance as a predictive and prognostic marker in clinical practice. However, visual scoring of Her2 is subjective and consequently prone to inter-observer variability. Given the prognostic and therapeutic implications of Her2 scoring, a more objective method is required. In this paper, we report on a recent automated Her2 scoring contest, held in conjunction wit…
A High Magnifications Histopathology Image Dataset for Oral Squamous Cell Carcinoma Diagnosis and Prognosis
School of Software Engineering, South China University of Technology（华南理工大学软件工程学院）；Department of Oral and Maxillofacial Surgery, Sun Yat-sen Memorial Hospital, Sun Yat-sen University（中山大学口腔颌面外科医院）；Mohamed Bin Zayed University of Artificial Intelligence（马尔代夫人工智能大学）；School of Computer Science, University of Adelaide（阿德莱德大学计算机科学学院）
Institute of Medical Technology and Intelligent Systems, Hamburg University of Technology（汉堡工业大学医学技术与智能系统研究所）；Department of Pediatric Hematology and Oncology, University Medical Center Hamburg-Eppendorf（汉堡-埃彭多夫大学医学中心儿科血液学与肿瘤学系）；Mildred Scheel Cancer Career Center HaTriCS4, University Medical Center Hamburg-Eppendorf（汉堡-埃彭多夫大学医学中心米尔德丽德·谢尔癌症职业中心HaTriCS4）；Institute of Neuropathology, University Medical Center Hamburg-Eppendorf（汉堡-埃彭多夫大学医学中心神经病理学研究所）
Medulloblastoma (MB) is a primary central nervous system tumor and the most common malignant brain cancer among children. Neuropathologists perform microscopic inspection of histopathological tissue slides under a microscope to assess the severity of the tumor. This is a time-consuming task and often infused with observer variability. Recently, pre-trained convolutional neural networks (CNN) have shown promising results for MB subtype classification. Typically, high-resolution images are divided into smaller tiles for classification, while the size of the tiles has not been systematically eval…
Cancer is the uncontrollable cell division of abnormal cells inside the human body, which can spread to other body organs. It is one of the non-communicable diseases (NCDs) and NCDs accounts for 71% of total deaths worldwide whereas lung cancer is the second most diagnosed cancer after female breast cancer. Cancer survival rate of lung cancer is only 19%. There are various methods for the diagnosis of lung cancer, such as X-ray, CT scan, PET-CT scan, bronchoscopy and biopsy. However, to know the subtype of lung cancer based on the tissue type H and E staining is widely used, where the staining…
Hamburg University of Technology（汉堡工业大学）；University Medical Center Hamburg-Eppendorf（汉堡-埃彭多夫大学医学中心）；Research Institute Children’s Cancer Center Hamburg（汉堡儿童癌症中心研究所）
Medulloblastoma (MB) is the most common malignant brain tumor in childhood. The diagnosis is generally based on the microscopic evaluation of histopathological tissue slides. However, visual-only assessment of histopathological patterns is a tedious and time-consuming task and is also affected by observer variability. Hence, automated MB tumor classification could assist pathologists by promoting consistency and robust quantification. Recently, convolutional neural networks (CNNs) have been proposed for this task, while transfer learning has shown promising results. In this work, we propose an…
Jadavpur University（贾达普大学）；Theism Medical Diagnostics Centre（Theism医学诊断中心）
Cytology is the branch of pathology which deals with the microscopic examination of cells for diagnosis of carcinoma or inflammatory conditions. Automation in cytology started in the early 1950s with the aim to reduce manual efforts in diagnosis of cancer. The inflush of intelligent technological units with high computational power and improved specimen collection techniques helped to achieve its technological heights. In the present survey, we focus on such image processing techniques which put steps forward towards the automation of cytology. We take a short tour to 17 types of cytology and …
Charles Sturt University（查尔斯特大学）；University of Western Sydney（西悉尼大学）；Kent Institute Australia（肯特学院）；Asia Pacific International College（亚太国际学院）；Australian Institute of Higher Education（澳大利亚高等教育学院）；Al Iraqia University（伊拉克大学）；University of Kurdistan Hewler（库尔德斯坦赫勒大学）；AL Nisour University College（阿尔尼苏尔大学学院）
Background and Aim: Recently, deep learning using convolutional neural network has been used successfully to classify the images of breast cells accurately. However, the accuracy of manual classification of those histopathological images is comparatively low. This research aims to increase the accuracy of the classification of breast cancer images by utilizing a Patch-Based Classifier (PBC) along with deep learning architecture. Methodology: The proposed system consists of a Deep Convolutional Neural Network (DCNN) that helps in enhancing and increasing the accuracy of the classification proce…
A Gradient Mapping Guided Explainable Deep Neural Network for Extracapsular Extension Identification in 3D Head and Neck Cancer Computed Tomography Images
Department of Industrial and Systems Engineering, Mississippi State University, Mississippi State, MS, 39762, USA（工业与系统工程系，密苏里州立大学）；Department of Radiation Oncology, University of Mississippi Medical Center, Jackson, MS, 39216, USA（放射肿瘤学系，密苏里大学医学中心）
Artificial intelligence in digital pathology: a systematic review and meta-analysis of diagnostic test accuracy
University of Leeds（利兹大学）；Leeds Teaching Hospitals NHS Trust（利兹教学医院NHS信托）；Linköping University（林雪平大学）；Centre for Medical Image Science and Visualization (CMIV), Linköping University（林雪平大学医学图像科学与可视化中心）
University of California, San Francisco（加州大学旧金山分校）；Duke University（杜克大学）；University of Dusseldorf（杜塞尔多夫大学）；University of Washington（华盛顿大学）
Non-invasive prostate cancer detection from MRI has the potential to revolutionize patient care by providing early detection of clinically-significant disease (ISUP grade group >= 2), but has thus far shown limited positive predictive value. To address this, we present an MRI-based deep learning method for predicting clinically significant prostate cancer applicable to a patient population with subsequent ground truth biopsy results ranging from benign pathology to ISUP grade group~5. Specifically, we demonstrate that mixed supervision via diverse histopathological ground truth improves classi…
Department of Computer Science, Vanderbilt University（范德堡大学计算机科学系）
Histopathology has played an essential role in cancer diagnosis. With the rapid advances in convolutional neural networks (CNN). Various CNN-based automated pathological image segmentation approaches have been developed in computer-assisted pathological image analysis. In the past few years, Transformer neural networks (Transformer) have shown the unique merit of capturing the global long-distance dependencies across the entire image as a new deep learning paradigm. Such merit is appealing for exploring spatially heterogeneous pathological images. However, there have been very few, if any, stu…
