arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.16679cs.CV

HMAR:分层模态感知专家与动态路由医学图像检索架构

HMAR: Hierarchical Modality-Aware Expert and Dynamic Routing Medical Image Retrieval Architecture

Shanghai Jiao Tong University(上海交通大学)

Aojie Yuan

AI总结:

本文提出HMAR框架,通过双专家机制和两阶段对比学习实现细粒度医学图像检索,提升检索精度与效率。

摘要:

医学图像检索(MIR)是计算机辅助诊断的关键组成部分,但现有系统存在三个持久性限制:统一的特征编码无法反映解剖结构的临床重要性差异、基于粗分类标签的模糊相似性度量以及仅关注全局图像相似性的狭隘焦点。我们提出HMAR(分层模态感知专家与动态路由),基于混合专家(MoE)架构构建的自适应检索框架。HMAR采用双专家机制:Expert0提取全局特征用于整体相似性匹配,而Expert1学习位置不变的局部表示用于精确病变区域检索。两阶段对比学习策略消除了对昂贵边界框标注的需求,滑动窗口匹配算法在推理时实现密集的局部比较。通过Kolmogorov-Arnold网络(KAN)层生成哈希码以实现高效的汉明距离搜索。在RadioImageNet-CT数据集(16种临床模式,29,903张图像)上的实验表明,HMAR在64位和128位哈希码上分别达到0.711和0.724的平均精确度(mAP),优于当前最先进的ACIR方法,分别提高了0.7%和1.1%。

英文摘要:

Medical image retrieval (MIR) is a critical component of computer-aided diagnosis, yet existing systems suffer from three persistent limitations: uniform feature encoding that fails to account for the varying clinical importance of anatomical structures, ambiguous similarity metrics based on coarse classification labels, and an exclusive focus on global image similarity that cannot meet the clinical demand for fine-grained region-specific retrieval. We propose HMAR (Hierarchical Modality-Aware Expert and Dynamic Routing), an adaptive retrieval framework built on a Mixture-of-Experts (MoE) architecture. HMAR employs a dual-expert mechanism: Expert0 extracts global features for holistic similarity matching, while Expert1 learns position-invariant local representations for precise lesion-region retrieval. A two-stage contrastive learning strategy eliminates the need for expensive bounding-box annotations, and a sliding-window matching algorithm enables dense local comparison at inference time. Hash codes are generated via Kolmogorov-Arnold Network (KAN) layers for efficient Hamming-distance search. Experiments on the RadioImageNet-CT dataset (16 clinical patterns, 29,903 images) show that HMAR achieves mean Average Precision (mAP) of 0.711 and 0.724 for 64-bit and 128-bit hash codes, improving over the state-of-the-art ACIR method by 0.7% and 1.1%, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑