Precision pathology relies on detecting fine-grained morphological abnormalities within specific Regions of Interest (ROIs), as these local, texture-rich cues - rather than global slide contexts - drive expert diagnostic reasoning. While Vision-Language (V-L) models promise data efficiency by leveraging semantic priors, adapting them faces a critical Granularity Mismatch, where generic representations fail to resolve such subtle defects. Current adaptation methods often treat modalities as independent streams, failing to ground semantic prompts in ROI-specific visual contexts. To bridge this gap, we propose the Hierarchical Adaptation and Alignment Framework (HAAF). At its core is a novel Cross-Level Scaled Alignment (CLSA) mechanism that enforces a sequential calibration order: visual features first inject context into text prompts to generate content-adaptive descriptors, which then spatially guide the visual encoder to spotlight anomalies. Additionally, a dual-branch inference strategy integrates semantic scores with geometric prototypes to ensure stability in few-shot settings. Experiments on four benchmarks show HAAF significantly outperforms state-of-the-art methods and effectively scales with domain-specific backbones (e.g., CONCH) in low-resource scenarios.
Johns Hopkins University(约翰斯·霍普金斯大学);University of Maryland(马里兰大学)
Ear related concerns and symptoms represents the leading indication for seeking pediatric healthcare attention. Despite the high incidence of such encounters, the diagnostic process of commonly encountered disease of the middle and external presents significant challenge. Much of this challenge stems from the lack of cost effective diagnostic testing, which necessitating the presence or absence of ear pathology to be determined clinically. Research has however demonstrated considerable variation among clinicians in their ability to accurately diagnose and consequently manage ear pathology. Wit…
Quantitative Benchmarking of Anomaly Detection Methods in Digital Pathology
Department of Computer Science Vanderbilt University, TN, USA(计算机科学系范德堡大学);Department of Radiology Weill Cornell Medicine, NY, USA(放射学系韦尔·科恩医学中心);Department of Medicine Vanderbilt University Medical Center, TN, USA Veterans Affairs Tennessee Valley Healthcare System TN, USA(医学系范德堡大学医学中心退伍军人事务田纳西山谷医疗系统);Department of Medicine Vanderbilt University Medical Center Veterans Affairs Tennessee Valley Healthcare System TN, USA(医学系范德堡大学医学中心退伍军人事务田纳西山谷医疗系统);Department of Anatomical Pathology UT MD Anderson Cancer Center,TX, USA(解剖病理学系UT MD安德森癌症中心)
Pathology-Informed Latent Diffusion Model for Anomaly Detection in Lymph Node Metastasis
School of Electrical Engineering, Korea University, Seoul 02841, Korea(韩国大学电子工程学院);Department of Pathology, Korea University Anam Hospital and Department of Biomedical Informatics, Korea University College of Medicine, Seoul 02841, Korea(韩国大学医学院病理学系);Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic University of Korea, Seoul 06591, Korea(韩国天主大学医学院圣玛丽医院医院病理学系)
Machine learning (ML) algorithms are optimized for the distribution represented by the training data. For outlier data, they often deliver predictions with equal confidence, even though these should not be trusted. In order to deploy ML-based digital pathology solutions in clinical practice, effective methods for detecting anomalous data are crucial to avoid incorrect decisions in the outlier scenario. We propose a new unsupervised learning approach for anomaly detection in histopathology data based on generative adversarial networks (GANs). Compared to the existing GAN-based methods that have…
Conditional diffusion models for guided anomaly detection in brain images using fluid-driven anomaly randomization
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School, Boston, USA(Athinoula A. Martinos 生物医学成像中心、麻省总医院和哈佛医学院,波士顿,美国);Danish Research Centre for Magnetic Resonance, Department of Radiology and Nuclear Medicine(丹麦磁共振研究中心、放射学与核医学部门);Copenhagen University Hospital– Amager and Hvidovre(哥本哈根大学医院–阿马格和赫维多尔)
Technical University of Munich (TUM)(慕尼黑工业大学);Klinikum Rechts der Isar(伊萨尔河畔大学医院);Imperial College London(伦敦帝国理工学院)
In medical imaging, un-, semi-, or self-supervised pathology detection is often approached with anomaly- or out-of-distribution detection methods, whose inductive biases are not intentionally directed towards detecting pathologies, and are therefore sub-optimal for this task. To tackle this problem, we propose AutoSeg, an engine that can generate diverse artificial anomalies that resemble the properties of real-world pathologies. Our method can accurately segment unseen artificial anomalies and outperforms existing methods for pathology detection on a challenging real-world dataset of Chest X-…
Johns Hopkins University(约翰斯·霍普金斯大学);Sigma Technologies(12西格玛科技);Johns Hopkins School of Medicine(约翰斯·霍普金斯医学院)
Medical images are often used to detect and characterize pathology and disease; however, automatically identifying and segmenting pathology in medical images is challenging because the appearance of pathology across diseases varies widely. To address this challenge, we propose a Bayesian deep learning method that learns to translate healthy computed tomography images to magnetic resonance images and simultaneously calculates voxel-wise uncertainty. Since high uncertainty occurs in pathological regions of the image, this uncertainty can be used for unsupervised anomaly segmentation. We show enc…
Philips Research(飞利浦研究院);Skolkovo Institute of Science and Technology(斯科尔科沃科学技术研究院);Goethe University Frankfurt(法兰克福歌德大学)
Anomaly detection is the problem of recognizing abnormal inputs based on the seen examples of normal data. Despite recent advances of deep learning in recognizing image anomalies, these methods still prove incapable of handling complex medical images, such as barely visible abnormalities in chest X-rays and metastases in lymph nodes. To address this problem, we introduce a new powerful method of image anomaly detection. It relies on the classical autoencoder approach with a re-designed training pipeline to handle high-resolution, complex images and a robust way of computing an image abnormalit…
Tau Anomaly Detection in PET Imaging via Bilateral-Guided Deterministic Diffusion Model
Stevens Neuroimaging and Informatics Institute, Keck School of Medicine, University of Southern California(斯蒂文斯神经影像与信息学研究所,凯克医学院,南加州大学);Ming Hsieh Department of Electrical and Computer Engineering, Viterbi School of Engineering, University of Southern California(明希部门电气与计算机工程系,维特比工程学院,南加州大学);Alfred E. Mann Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California(阿尔弗雷德·E·曼生物医学工程系,维特比工程学院,南加州大学)
Imperial College London(帝国理工学院);King’s College London(伦敦国王学院);Friedrich–Alexander University Erlangen–Nürnberg(埃尔朗根-纽伦堡弗里德里希-亚历山大大学)
Supervised learning of every possible pathology is unrealistic for many primary care applications like health screening. Image anomaly detection methods that learn normal appearance from only healthy data have shown promising results recently. We propose an alternative to image reconstruction-based and image embedding-based methods and propose a new self-supervised method to tackle pathological anomaly detection. Our approach originates in the foreign patch interpolation (FPI) strategy that has shown superior performance on brain MRI and abdominal CT data. We propose to use a better patch inte…
University of Ljubljana(卢布尔雅那大学);XLAB d.o.o.(XLAB公司)
Anomaly detection in visual data refers to the problem of differentiating abnormal appearances from normal cases. Supervised approaches have been successfully applied to different domains, but require an abundance of labeled data. Due to the nature of how anomalies occur and their underlying generating processes, it is hard to characterize and label them. Recent advances in deep generative-based models have sparked interest in applying such methods for unsupervised anomaly detection and have shown promising results in medical and industrial inspection domains. In this work we evaluate a crucia…
CADD: Context aware disease deviations via restoration of brain images using normative conditional diffusion models
Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital and Harvard Medical School(阿提诺拉A.马丁纳生物医学成像中心,麻省总医院和哈佛医学院);Hawkes Institute, University College London(霍克斯研究所,伦敦大学学院);Mecha Health(Mecha健康);Computer Science & Artificial Intelligence Lab, Massachusetts Institute of Technology(计算机科学与人工智能实验室,麻省理工学院);Department of Radiology, the University of Tokyo(东京大学放射科);Medical Engineering, Chiba University(千叶大学医学工程);Department of Computational Diagnostic Radiology and Preventive Medicine, the University of Tokyo Hospital(东京大学医院计算诊断放射学与预防医学科)
University of Girona(赫罗纳大学);Technical University of Munich(慕尼黑工业大学);Antwerp University Hospital(安特卫普大学医院);University of Antwerp(安特卫普大学);KU Leuven(鲁汶大学)
Anomaly detection (AD) is the identification of data samples that do not fit a learned data distribution. As such, AD systems can help physicians to determine the presence, severity, and extension of a pathology. Deep generative models, such as Generative Adversarial Networks (GANs), can be exploited to capture anatomical variability. Consequently, any outlier (i.e., sample falling outside of the learned distribution) can be detected as an abnormality in an unsupervised fashion. By using this method, we can not only detect expected or known lesions, but we can even unveil previously unrecogniz…
Medical Faculty Mannheim of Heidelberg University(海德堡大学曼海姆医学院)
Statistical analysis of magnetic resonance imaging (MRI) can help radiologists to detect pathologies that are otherwise likely to be missed. Deep learning (DL) has shown promise in modeling complex spatial data for brain anomaly detection. However, DL models have major deficiencies: they need large amounts of high-quality training data, are difficult to design and train and are sensitive to subtle changes in scanning protocols and hardware. Here, we show that also simple statistical methods such as voxel-wise (baseline and covariance) models and a linear projection method using spatial pattern…
Otto von Guericke University Magdeburg(马格德堡奥托·冯·格里克大学);Center for Behavioral Brain Sciences(行为脑科学研究中心);German Center for Neurodegenerative Disease(德国神经退行性疾病研究中心)
Expert interpretation of anatomical images of the human brain is the central part of neuro-radiology. Several machine learning-based techniques have been proposed to assist in the analysis process. However, the ML models typically need to be trained to perform a specific task, e.g., brain tumour segmentation or classification. Not only do the corresponding training data require laborious manual annotations, but a wide variety of abnormalities can be present in a human brain MRI - even more than one simultaneously, which renders representation of all possible anomalies very challenging. Hence, …
Wasserstein-Aligned Localisation for VLM-Based Distributional OOD Detection in Medical Imaging
Department of Computing, Imperial College London, UK(伦敦帝国理工学院计算机系);Technical University Munich, DE(慕尼黑技术大学);Munich Center for Machine Learning (MCML), DE(慕尼黑机器学习中心(MCML))