arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.09653cs.AI
收藏

ClinAlign: 从医生偏好扩展医疗对齐

ClinAlign: Scaling Healthcare Alignment from Clinician Preference

Ant Group(蚂蚁集团);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Peking University(北京大学)

Shiwei Lyu, Xidong Wang, Lei Liu, Hao Zhu, Chaohe Zhang, Jian Wang, Jinjie Gu, Benyou Wang, Yue Shen

AI总结:

ClinAlign通过HealthRubrics和HealthPrinciples实现医疗输出与医生偏好的高效对齐,验证了资源高效的临床对齐方法。

摘要:

尽管大型语言模型(LLMs)展现出专家级别的医学知识,但将它们的开放性输出与精细的医生偏好对齐仍然具有挑战性。现有方法往往依赖于粗略的目标或不可靠的自动评判者,这些评判者在专业指南上的基础薄弱。我们提出了一种两阶段框架来解决这一差距。首先,我们引入了HealthRubrics,一个包含7034个由医生验证的偏好示例的数据集,其中医生会细化LLM起草的评估标准以满足严格医学标准。其次,我们将这些评估标准提炼成HealthPrinciples:119个广泛可重用、临床相关的原理,按临床维度组织,使在手动注释之外也能实现可扩展的监督。我们利用HealthPrinciples进行(1)离线对齐,通过为无标签查询合成评估标准,以及(2)推理时的工具进行引导式自我修订。一个使用我们框架训练的30B-A3B模型在HealthBench-Hard上实现了33.4%的准确率,优于包括Deepseek-R1和o3在内的许多更大模型,建立了临床对齐的资源高效基准。

英文摘要:

Although large language models (LLMs) demonstrate expert-level medical knowledge, aligning their open-ended outputs with fine-grained clinician preferences remains challenging. Existing methods often rely on coarse objectives or unreliable automated judges that are weakly grounded in professional guidelines. We propose a two-stage framework to address this gap. First, we introduce HealthRubrics, a dataset of 7,034 physician-verified preference examples in which clinicians refine LLM-drafted rubrics to meet rigorous medical standards. Second, we distill these rubrics into HealthPrinciples: 119 broadly reusable, clinically grounded principles organized by clinical dimensions, enabling scalable supervision beyond manual annotation. We use HealthPrinciples for (1) offline alignment by synthesizing rubrics for unlabeled queries and (2) an inference-time tool for guided self-revision. A 30B-A3B model trained with our framework achieves 33.4% on HealthBench-Hard, outperforming much larger models including Deepseek-R1 and o3, establishing a resource-efficient baseline for clinical alignment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑