Skin cancer is considered to be the most common human malignancy. Around 5 million new cases of skin cancer are recorded in the United States annually. Early identification and evaluation of skin lesions is of great clinical significance, but the disproportionate dermatologist-patient ratio poses significant problem in most developing nations. Therefore a deep learning based architecture, known as SkiNet, is proposed with an objective to provide faster screening solution and assistance to newly trained physicians in the clinical diagnosis process. The main motive behind Skinet's design and development is to provide a white box solution, addressing a critical problem of trust and interpretability which is crucial for the wider adoption of Computer-aided diagnosis systems by the medical practitioners. SkiNet is a two-stage pipeline wherein the lesion segmentation is followed by the lesion classification. In our SkiNet methodology, Monte Carlo dropout and test time augmentation techniques have been employed to estimate epistemic and aleatoric uncertainty, while saliency-based methods are explored to provide post-hoc explanations of the deep learning models. The publicly available dataset, ISIC-2018, is used to perform experimentation and ablation studies. The results establish the robustness of the model on the traditional benchmarks while addressing the black-box nature of such models to alleviate the skepticism of medical practitioners by incorporating transparency and confidence to the model's prediction.
Are Explanations Helpful? A Comparative Analysis of Explainability Methods in Skin Lesion Classifiers
Instituto de Computação, Universidade Estadual de Campinas (UNICAMP), Campinas, Brazil（坎皮纳斯州立大学计算研究所（UNICAMP））；Department of Computer Science, Universidad Católica San Pablo, Arequipa, Peru（天主教圣巴布罗大学计算机科学系）；Department of Diabetes, Endocrinology, Nutritional Medicine and Metabolism UDEM, University of Bern, Switzerland（伯尔尼大学糖尿病、内分泌学、营养医学和代谢学系）
Universidade da Coruña（拉科鲁尼亚大学）；Instituto de Investigación Biomédica de A Coruña (INIBIC)（拉科鲁尼亚生物医学研究所）；Hospital Clínico San Carlos（圣卡洛斯临床医院）；Instituto de Investigación Sanitaria (IdISSC)（圣卡洛斯健康研究所）；Centro Internacional de Oftalmología Avanzada（国际高级眼科中心）
Age-related macular degeneration (AMD) is a degenerative disorder affecting the macula, a key area of the retina for visual acuity. Nowadays, it is the most frequent cause of blindness in developed countries. Although some promising treatments have been developed, their effectiveness is low in advanced stages. This emphasizes the importance of large-scale screening programs. Nevertheless, implementing such programs for AMD is usually unfeasible, since the population at risk is large and the diagnosis is challenging. All this motivates the development of automatic methods. In this sense, severa…
MEDIC-AD: Towards Medical Vision-Language Model's Clinical Intelligence
AIDAS Laboratory, Seoul National University（首尔大学AIDAS实验室）；Samsung Changwon Hospital（三星昌原医院）；Samsung Medical Center（三星医疗中心）；NVIDIA, Santa Clara, USA（英伟达（美国圣克拉拉））
In recent years, Artificial Intelligence (AI) has proven its relevance for medical decision support. However, the "black-box" nature of successful AI algorithms still holds back their wide-spread deployment. In this paper, we describe an eXplanatory Artificial Intelligence (XAI) that reaches the same level of performance as black-box AI, for the task of classifying Diabetic Retinopathy (DR) severity using Color Fundus Photography (CFP). This algorithm, called ExplAIn, learns to segment and categorize lesions in images; the final image-level classification directly derives from these multivaria…
Bayer AG（拜耳股份公司）；Median Technologies（Median科技公司）；Bayer Crop Science（拜耳作物科学公司）；Pfizer Worldwide Research Development and Medical（辉瑞全球研发与医疗部门）
In pre-clinical pathology, there is a paradox between the abundance of raw data (whole slide images from many organs of many individual animals) and the lack of pixel-level slide annotations done by pathologists. Due to time constraints and requirements from regulatory authorities, diagnoses are instead stored as slide labels. Weakly supervised training is designed to take advantage of those data, and the trained models can be used by pathologists to rank slides by their probability of containing a given lesion of interest. In this work, we propose a novel contextualized eXplainable AI (XAI) f…
PEFT-MedSAM: Efficient Fine-Tuning of Medical Foundation Models for Explainable Skin Lesion Segmentation
Department of Computer Science, Quaid-e-Awam University of Engineering, Sciences & Technology（计算机科学系，卡迪尔-阿瓦姆工程、科学与技术大学）；Department of Artificial Intelligence, Quaid-e-Awam University of Engineering, Sciences & Technology（人工智能系，卡迪尔-阿瓦姆工程、科学与技术大学）；Department of Computer Science, Sindh Madressatul Islam University, City Campus, Karachi（计算机科学系， Sind 阿里斯坦伊斯兰大学，卡拉奇城校区）；Department of Computer Science and Digital Technologies, School of Architecture, Computing and Engineering, University of East London（计算机科学与数字技术系，建筑、计算与工程学院，东伦敦大学）
Faculty of Biology and Medicine, University of Lausanne (UNIL)（日内瓦大学生物医学学院）；Radiology Department, Lausanne University Hospital (CHUV)（拉索恩大学医院放射科）；MedGIFT, Institute of Informatics, School of Management, HES--SO Valais--Wallis University of Applied Sciences and Arts Western Switzerland（应用科学与艺术西瓦利斯-瓦利斯大学信息学院）；CIBM Center for Biomedical Imaging（生物医学成像中心）；Department of Radiology and Medical Informatics, University of Geneva（日内瓦大学放射科与医学信息学系）；Translational Imaging in Neurology (ThINK) Basel, Department of Medicine and Biomedical Engineering, University Hospital Basel and University of Basel（神经学转化成像（ThINK）巴塞尔，医学与生物医学工程系，巴塞尔大学医院和巴塞尔大学）；Multiple Sclerosis Center, Department of Neurology, University Hospital Basel（多发性硬化中心，神经科，巴塞尔大学医院）；Research Center for Clinical Neuroimmunology and Neuroscience Basel (RC2NB), University Hospital Basel and University of Basel（临床神经免疫学和神经科学巴塞尔研究中心（RC2NB），巴塞尔大学医院和巴塞尔大学）；Department of Neurology, Icahn School of Medicine at Mount Sinai（伊坎医学院 Mount Sinai 神经科）；Translational Neuroradiology Section, National Institute of Neurological Disorders and Stroke, National Institutes of Health（神经学转化放射学部门，国家神经疾病与中风研究所，国家卫生研究院）；Neuroinflammation Imaging Lab (NIL), Université catholique de Louvain（神经炎症成像实验室（NIL），卢瓦纳大学）；EPFL+ECAL Lab, École polytechnique fédérale de Lausanne (EPFL)（EPFL+ECAL 实验室，日内瓦联邦理工学院（EPFL））
Université Clermont Auvergne（克莱蒙奥弗涅大学）；CNRS（法国国家科学研究中心）；ENSMSE（圣艾蒂安国立矿业工程师学校）；INRAE（法国国家农业食品与环境研究院）；VetAgro Sup（法国兽医与农学高等学院）；Université de Lyon（里昂大学）；CHU Clermont-Ferrand（克莱蒙费朗大学医院）；Inserm（法国国家健康与医学研究院）；Tous Chercheurs Laboratory（全民研究者实验室）；CPIE Champenoux（尚佩努环境倡议中心）；University Hospital of Nancy（南锡大学医院）；University Hospital of Saint Etienne（圣艾蒂安大学医院）；IHU-Méditerranée Infection（地中海感染大学医院研究所）；Aix Marseille Univ（艾克斯-马赛大学）；IRD（法国发展研究院）；AP-HM（马赛公立医院援助机构）；SSA（法国军队卫生勤务局）；Hôpitaux Universitaires（斯特拉斯堡大学医院）；Pontchaillou University Hospital（蓬查卢大学医院）；CHR Orléans（奥尔良地区中心医院）；Hospital of Villeneuve-Saint-Georges（维勒讷夫圣乔治医院）；Centre Hospitalier Universitaire de Rennes（雷恩大学医院）
Lyme disease which is one of the most common infectious vector-borne diseases manifests itself in most cases with erythema migrans (EM) skin lesions. Recent studies show that convolutional neural networks (CNNs) perform well to identify skin lesions from images. Lightweight CNN based pre-scanner applications for resource-constrained mobile devices can help users with early diagnosis of Lyme disease and prevent the transition to a severe late form thanks to appropriate antibiotic therapy. Also, resource-intensive CNN based robust computer applications can assist non-expert practitioners with an…
As interpretability has been pointed out as the obstacle to the adoption of Deep Neural Networks (DNNs), there is an increasing interest in solving a transparency issue to guarantee the impressive performance. In this paper, we demonstrate the efficiency of recent attribution techniques to explain the diagnostic decision by visualizing the significant factors in the input image. By utilizing the characteristics of objectness that DNNs have learned, fully decomposing the network prediction visualizes clear localization of target lesion. To verify our work, we conduct our experiments on Chest X-…
Medical Slice Transformer: Improved Diagnosis and Explainability on 3D Medical Images with DINOv2
University Hospital Aachen（亚琛大学医院）；Technical University Dresden（德累斯顿工业大学）；University Hospital Dresden（德累斯顿大学医院）；University Hospital Heidelberg（海德堡大学医院）
Multimodal Doctor-in-the-Loop: A Clinically-Guided Explainable Framework for Predicting Pathological Response in Non-Small Cell Lung Cancer
Research Unit of Computer Systems and Bioinformatics, Department of Engineering（计算机系统与生物信息学研究单位，工程系）；Research Unit of Radiation Oncology, Department of Medicine and Surgery（放射肿瘤学研究单位，医学与外科系）；Research Unit of Anatomical Pathology, Department of Medicine and Surgery（病理学研究单位，医学与外科系）
Clinical Interpretability of Deep Learning Segmentation Through Shapley-Derived Agreement and Uncertainty Metrics
Department of Mechanical Engineering, University of Washington（华盛顿大学机械工程系）；University of Washington School of Medicine（华盛顿大学医学院）；Department of Neurological Surgery, University of Washington（华盛顿大学神经外科系）
A Novel Hybrid Deep Learning and Chaotic Dynamics Approach for Thyroid Cancer Classification
Laboratory of Renewable Energy, Department of Electronics, University of Jijel（可再生能源实验室，电子系，杰吉尔大学）；Non-Destructive Testing Laboratory, Department of Electronics, University of Jijel（无损检测实验室，电子系，杰吉尔大学）；Institute of Technology, University Center Salhi Ahmed（技术学院，Salhi Ahmed大学中心）；College of Engineering and Information Technology, University of Dubai（工程与信息科技学院，迪拜大学）
