arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2606.24510cs.AIcs.CL

一种用于加速罕见病诊断的专用推理大语言模型:随机AI辅助医生试验

A specialized reasoning large language model for accelerating rare disease diagnosis: a randomized AI physician assistance trial

Tsinghua Medicine, Tsinghua University(清华大学医学部,清华大学);Department of Ophthalmology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College(北京大学人民医院眼科,中国医学科学院 & 北京大学医学部);Department of Statistics and Data Science, Tsinghua University(清华大学统计与数据科学系);Department of Rheumatology and Clinical Immunology, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College(北京大学人民医院风湿免疫科,中国医学科学院 & 北京大学医学部);Department of Rare Diseases, Peking Union Medical College Hospital, Chinese Academy of Medical Sciences & Peking Union Medical College(北京大学人民医院罕见病科,中国医学科学院 & 北京大学医学部);Department of Dermatology, Xijing Hospital, Air Force Medical University(西安空军军医大学西京医院皮肤科);School of Computer Science and Technology, East China Normal University (ECNU)(东华大学计算机科学与技术学院);Department of Neurosurgery, Xuanwu Hospital, Capital Medical University(首都医科大学宣武医院神经外科);Department of Ophthalmology, National University of Singapore(新加坡国立大学眼科);Singapore Eye Research Institute, Singapore National Eye Centre(新加坡眼科学研究所,新加坡国家眼科中心);Ophthalmology and Visual Science Academic Clinical Program, Duke-NUS Medical School(杜克-国立新加坡大学医学学校眼科与视觉科学学术临床项目);Department of Pediatrics, The First Hospital of Tsinghua University(清华大学第一医院儿科);College of Future Technology, Peking University(北京大学未来技术学院);School of Health and Wellbeing, University of Glasgow(格拉斯哥大学健康与福祉学院)
Haichao Chen, Songchi Zhou, Zhengyun Zhao, Shikai Hu, Xianghong Jin, Hongwei Ji, Li He, Shuli Li, Yiming Qin, Xin Tan, Runfeng Shi, Yih Chung Tham, Jiaye Zhu, Y… 展开作者

Haichao Chen, Songchi Zhou, Zhengyun Zhao, Shikai Hu, Xianghong Jin, Hongwei Ji, Li He, Shuli Li, Yiming Qin, Xin Tan, Runfeng Shi, Yih Chung Tham, Jiaye Zhu, Ye Li, Ye Jin, Longhao Cao, Dawei Li, Honghan Wu, Hongqiu Gu, Guanqiao Li, Tudor Groza, Chunying Li, Dian Zeng, Weihong Yu, Gareth Baynam, Saumya Shekhar Jamuar, Min Shen, Shuyang Zhang, Bin Sheng, Sheng Yu, Tien Yin Wong

AI总结:

提出开源推理大模型RaDaR(32B参数),通过增强推理训练和合成数据,在罕见病诊断中超越DeepSeek-R1等模型,随机试验显示其辅助使医生诊断准确率提升21.44个百分点。

摘要:

罕见病影响着全球数百万人,但由于缺乏专业临床专业知识,及时诊断仍然是一个主要的公共卫生挑战。虽然大语言模型(LLMs)在支持罕见病诊断方面显示出潜力,但当前模型受到临床可部署性不足、临床证据有限以及训练数据稀缺的限制。本文提出RaDaR(Rare Disease navigatoR),一个开源的、紧凑的推理大语言模型(32B参数),用于罕见病诊断。RaDaR使用49,170个公开可用的自由文本病例和104,666个合成病例进行训练,并采用了推理增强训练。在公开基准测试和四个外部验证中心中,RaDaR在评估的开源模型中表现最强,包括671B的DeepSeek-R1。在一个回顾性队列中,RaDaR在61.06%的病例中优先于记录的临床怀疑给出最终诊断,对应的潜在提前时间为1.87个月,占中心内间隔的50.18%。在一项随机医生辅助试验中,与仅使用互联网搜索相比,RaDaR辅助将医生的罕见病诊断准确率提高了21.44个百分点。合成数据消融实验表明,表型锚定的叙述为长尾罕见病提供了有用的训练信号,在测试数据范围内呈现单调扩展趋势。综上所述,RaDaR及其开发和验证框架提供了一个可部署的罕见病推理模型,以及一个在数据稀缺条件下可复现的诊断AI开发框架。

英文摘要:

Rare diseases affect millions of individuals worldwide, yet timely diagnosis remains a major public health challenge due to scarcity of specialized clinical expertise. While large language models (LLMs) show promise to support rare disease diagnosis, current models are constrained by insufficient clinical deployability, limited clinically grounded evidence, and scarcity of training data. Here we present RaDaR (Rare Disease navigatoR), an open-source, compact reasoning LLM (32B parameters) for rare disease diagnosis. RaDaR was trained with 49,170 publicly available free-text cases and 104,666 synthetic cases with reasoning-enhanced training. RaDaR showed the strongest performance among evaluated open-source models, including the 671B DeepSeek-R1, across public benchmarks and four external validation centers. In a retrospective cohort, RaDaR prioritized the final diagnosis before documented clinical suspicion in 61.06 percent of cases, corresponding to a potential lead time of 1.87 months and 50.18 percent of the within-center interval. In a randomized physician-assistance trial, RaDaR assistance improved physicians' rare-disease diagnostic accuracy by 21.44 percentage points compared with internet search alone. Synthetic-data ablations suggested that phenotype-anchored narratives provide useful training signal for long-tail rare diseases, with a monotonic scaling trend within the tested data range. Together, RaDaR and its development and validation framework provide a deployable rare-disease reasoning model and a reproducible development framework for diagnostic AI under data scarcity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑