arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.17405cs.CV

HAAF: 用于少样本病理异常检测的层次适应与对齐框架

HAAF: Hierarchical Adaptation and Alignment of Foundation Models for Few-Shot Pathology Anomaly Detection

Sch Comp Sci \& Technol, Xi'an Jiaotong University Xi'an China;University of Cambridge Cambridge United Kingdom;Sch Comp Sci \& Technol, Xi'an Jiaotong University;University of Cambridge

Chunze Yang, Wenjie Zhao, Yue Tang, Junbo Lu, Jiusong Ge, Qidong Liu, Zeyu Gao, Chen Li

AI总结:

HAAF通过层次适应与对齐框架,解决少样本病理异常检测中的粒度不匹配问题,提升模型在低资源场景下的性能。

摘要:

精准病理学依赖于在特定感兴趣区域(ROIs)内检测细粒度形态学异常,因为这些局部、纹理丰富的线索 - 而不是全局滑片上下文 - 驱动专家的诊断推理。虽然视觉-语言(V-L)模型通过利用语义先验来提高数据效率,但将其适应时面临关键的粒度不匹配问题,即通用表示无法解决此类细微缺陷。当前的适应方法往往将模态视为独立的流,未能在ROI特定的视觉上下文中 grounding 语义提示。为此,我们提出了层次适应与对齐框架(HAAF)。其核心是一种新颖的跨层缩放对齐(CLSA)机制,强制执行顺序校准流程:视觉特征首先将上下文注入文本提示以生成内容自适应的描述符,然后在空间上引导视觉编码器聚焦异常。此外,双分支推理策略将语义分数与几何原型结合,以确保在少样本设置下的稳定性。在四个基准测试上的实验表明,HAAF显著优于最先进的方法,并且在低资源场景中能够有效扩展到领域特定的backbone(例如CONCH)。\n

英文摘要:

Precision pathology relies on detecting fine-grained morphological abnormalities within specific Regions of Interest (ROIs), as these local, texture-rich cues - rather than global slide contexts - drive expert diagnostic reasoning. While Vision-Language (V-L) models promise data efficiency by leveraging semantic priors, adapting them faces a critical Granularity Mismatch, where generic representations fail to resolve such subtle defects. Current adaptation methods often treat modalities as independent streams, failing to ground semantic prompts in ROI-specific visual contexts. To bridge this gap, we propose the Hierarchical Adaptation and Alignment Framework (HAAF). At its core is a novel Cross-Level Scaled Alignment (CLSA) mechanism that enforces a sequential calibration order: visual features first inject context into text prompts to generate content-adaptive descriptors, which then spatially guide the visual encoder to spotlight anomalies. Additionally, a dual-branch inference strategy integrates semantic scores with geometric prototypes to ensure stability in few-shot settings. Experiments on four benchmarks show HAAF significantly outperforms state-of-the-art methods and effectively scales with domain-specific backbones (e.g., CONCH) in low-resource scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑