arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.19957cs.CVcs.AIcs.LG

HiPath: 用于结构化病理报告预测的分层视觉-语言对齐

HiPath: Hierarchical Vision-Language Alignment for Structured Pathology Report Prediction

College of Computer Science and Electronic Engineering, Hunan University(湖南大学计算机科学与电子工程学院);Department of Bioengineering and Imperial-X, Imperial College London(帝国理工学院伦敦校区生物工程系);Department of Pathology, Xiangtan Maternal and Child Health Hospital(湘潭 maternal and child health hospital pathology department);Department of Pathology, The First People’s Hospital of Xiangtan City(湘潭市第一人民医院病理科)

Ruicheng Yuan, Zhenxuan Zhang, Anbang Wang, Liwei Hu, Xiangqian Hua, Yaya Peng, Jiawei Luo, Guang Yang

AI总结:

提出HiPath框架,通过分层补丁聚合器、对比学习和槽位掩码诊断预测,在冻结UNI2和Qwen3骨干上实现结构化病理报告预测,准确率达68.9%,安全率97.3%。

摘要:

病理报告是结构化的多粒度文档,编码跨一个或多个解剖部位的诊断结论、组织学分级和辅助检测结果;然而现有的病理视觉-语言模型(VLM)将输出简化为扁平标签或自由文本。我们提出HiPath,一个轻量级VLM框架,基于冻结的UNI2和Qwen3骨干,将结构化报告预测作为其主要训练目标。三个可训练模块总计1500万参数,分别处理问题的互补方面:分层补丁聚合器(HiPA)用于多图像视觉编码,分层对比学习(HiCL)通过最优传输进行跨模态对齐,以及基于槽的掩码诊断预测(Slot-MDP)用于结构化诊断生成。在来自三家医院的749K真实世界中文病理病例上训练,HiPath实现了68.9%的严格准确率和74.7%的临床可接受准确率,安全率为97.3%,在相同冻结骨干下优于所有基线。跨医院评估证实了泛化能力,严格准确率仅下降3.4个百分点,同时保持97.1%的安全率。

英文摘要:

Pathology reports are structured, multi-granular documents encoding diagnostic conclusions, histological grades, and ancillary test results across one or more anatomical sites; yet existing pathology vision-language models (VLMs) reduce this output to a flat label or free-form text. We present HiPath, a lightweight VLM framework built on frozen UNI2 and Qwen3 backbones that treats structured report prediction as its primary training objective. Three trainable modules totalling 15M parameters address complementary aspects of the problem: a Hierarchical Patch Aggregator (HiPA) for multi-image visual encoding, Hierarchical Contrastive Learning (HiCL) for cross-modal alignment via optimal transport, and Slot-based Masked Diagnosis Prediction (Slot-MDP) for structured diagnosis generation. Trained on 749K real-world Chinese pathology cases from three hospitals, HiPath achieves 68.9% strict and 74.7% clinically acceptable accuracy with a 97.3% safety rate, outperforming all baselines under the same frozen backbone. Cross-hospital evaluation confirms generalisation with only a 3.4pp drop in strict accuracy while maintaining 97.1% safety.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑