arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.11684cs.CLcs.AIcs.HC
收藏

PatientHub: 一个统一的患者模拟框架

PatientHub: A Unified Framework for Patient Simulation

The CoAI Group, DCST Institute for Artificial Intelligence Tsinghua University(CoAI集团、DCST人工智能研究所清华大学)

Sahand Sabour, TszYam NG, Minlie Huang

AI总结:

PatientHub提供了一个统一的患者模拟框架,通过标准化定义、组成和部署,促进跨方法和跨模型的基准测试,并降低新方法开发的门槛。

摘要:

随着大型语言模型越来越多地用于角色扮演游戏应用,模拟患者已成为训练顾问和扩大治疗评估的重要工具。然而,先前的工作碎片化:现有方法依赖于不兼容、非标准化的数据格式、提示和评估指标,阻碍了可重复性和公平比较。在本文中,我们介绍了PatientHub,一个统一且模块化的框架,它标准化了模拟患者定义、组成和部署。为了展示PatientHub的实用性,我们实现了几种代表性的患者模拟方法作为案例研究,展示了我们的框架如何支持标准化的跨方法评估和自定义评估指标的无缝集成。我们进一步通过原型设计两种新的模拟器变体来展示PatientHub的可扩展性,突显了PatientHub通过消除基础设施开销来加速方法开发的能力。通过将现有工作整合到一个可重复的管道中,PatientHub降低了开发新模拟方法的门槛,并促进了跨方法和跨模型基准测试。我们的框架为未来以患者为中心的对话数据集、方法和基准提供了实用的基础,代码可通过https://github.com/Sahandfer/PatientHub公开获取。

英文摘要:

As Large Language Models increasingly power role-playing applications, simulating patients has become a valuable tool for training counselors and scaling therapeutic assessment. However, prior work remains fragmented: existing approaches rely on incompatible, non-standardized profiles, prompts, and evaluation metrics, hindering reproducibility, fair comparison, and reuse. We introduce PatientHub, a unified and modular framework that standardizes the creation, simulation, and evaluation of LLM-based patients. Our framework provides 16 patient simulators, a graph-based orchestrator for multi-turn, multi-session interactions, and a configurable LLM-as-a-judge evaluator that supports multiple rubric types. Via our command-line interface, users can generate patient profiles, run simulations, and apply rubric-driven evaluation at the turn and session level. To demonstrate PatientHub's utility, we compare several supported simulators under a shared interaction protocol and showcase its extensibility by prototyping a new simulator variant with minimal additional code. By consolidating existing work into a single reproducible pipeline, our framework eliminates much of the infrastructure overhead that currently fragments this research and accelerates the development of new methods. Our code and data are publicly available via https://github.com/Sahandfer/PatientHub.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑