arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.06964cs.AIcs.HC
收藏

增强以患者为中心的沟通:利用大语言模型(LLMs)模拟患者视角

Enhancing Patient-Centric Communication: Leveraging LLMs to Simulate Patient Perspectives

Indiana University Bloomington(印第安纳大学伯明顿分校);Yale University(耶鲁大学);University of California, Davis(加利福尼亚大学戴维斯分校)

Xinyao Ma, Rui Zhu, Zihao Wang, Jingwei Xiong, Qingyu Chen, Haixu Tang, L. Jean Camp, Lucila Ohno-Machado

AI总结:

该研究评估大语言模型模拟不同背景患者解读ICU出院小结的效果,发现提供教育背景时其给出准确医疗指导的比例达88%,换其他信息则性能低于随机水平,指出LLM用于个性化健康沟通的潜力与待补差距。

摘要:

大语言模型(LLMs)在角色扮演场景中展现出了出色的能力,尤其是通过定制化提示词模拟特定领域专家方面。这种能力让LLMs能够扮演具有特定背景的个体角色,为传统的、资源密集型的用户研究提供了一种高性价比且高效的替代方案。通过模仿人类行为,LLMs可以根据具体的人口统计学或职业特征预测对应的反应。在本文中,我们评估了LLMs模拟不同背景个体的有效性,并分析了这些模拟行为与真实结果相比的一致性。具体而言,我们探究了LLMs解读并回应给重症监护室(ICU)出院患者的出院小结的潜力。我们评估了不同教育背景个体对出院小结的理解程度,并将其与人类的反应进行对比,通过该分析评估LLM驱动的模拟的优势与局限性。值得注意的是,当为LLMs提供教育背景信息作为提示时,它们在88%的情况下能给出准确且可操作的医疗指导。然而,当提供其他信息时,其性能会显著下降,甚至低于随机水平。这项初步研究揭示了从不同人群中自动生成患者专属健康信息的潜在益处与缺陷。尽管LLMs在模拟健康相关人物角色方面展现出前景,但我们的结果也凸显了在其能可靠应用于临床场景前必须解决的关键差距。我们的发现表明,在传递健康信息时,简单的查询-响应模型可能比更定制化的方法表现更好。这是理解如何在保持准确性的同时优化LLMs以实现个性化健康沟通的关键第一步。

英文摘要:

Large Language Models (LLMs) have demonstrated impressive capabilities in role-playing scenarios, particularly in simulating domain-specific experts using tailored prompts. This ability enables LLMs to adopt the persona of individuals with specific backgrounds, offering a cost-effective and efficient alternative to traditional, resource-intensive user studies. By mimicking human behavior, LLMs can anticipate responses based on concrete demographic or professional profiles. In this paper, we evaluate the effectiveness of LLMs in simulating individuals with diverse backgrounds and analyze the consistency of these simulated behaviors compared to real-world outcomes. In particular, we explore the potential of LLMs to interpret and respond to discharge summaries provided to patients leaving the Intensive Care Unit (ICU). We evaluate and compare with human responses the comprehensibility of discharge summaries among individuals with varying educational backgrounds, using this analysis to assess the strengths and limitations of LLM-driven simulations. Notably, when LLMs are primed with educational background information, they deliver accurate and actionable medical guidance 88% of the time. However, when other information is provided, performance significantly drops, falling below random chance levels. This preliminary study shows the potential benefits and pitfalls of automatically generating patient-specific health information from diverse populations. While LLMs show promise in simulating health personas, our results highlight critical gaps that must be addressed before they can be reliably used in clinical settings. Our findings suggest that a straightforward query-response model could outperform a more tailored approach in delivering health information. This is a crucial first step in understanding how LLMs can be optimized for personalized health communication while maintaining accuracy.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑