arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.18290cs.AIcs.CY

前列腺癌收件箱消息的回顾性比较分析:封闭域大语言模型与临床团队的回复对比

Retrospective Comparative Analysis of Prostate Cancer In-Basket Messages: Responses from Closed-Domain LLM vs. Clinical Teams

Mayo Clinic(梅奥诊所)
Yuexing Hao, Jason M. Holmes, Jared Hobson, Alexandra Bennett, Daniel K. Ebner, David M. Routman, Satomi Shiraishi, Samir H. Patel, Nathan Y. Yu, Chris L. Halle… 展开作者

Yuexing Hao, Jason M. Holmes, Jared Hobson, Alexandra Bennett, Daniel K. Ebner, David M. Routman, Satomi Shiraishi, Samir H. Patel, Nathan Y. Yu, Chris L. Hallemeier, Brooke E. Ball, Mark R. Waddle, Wei Liu

AI总结:

本文提出基于GPT-4的前列腺癌放疗专用大语言模型RadOnc-GPT,集成EHR后在158条收件箱消息上评估,其在清晰度和同理心上略优于临床团队,并能显著节省医护时间,有望减轻工作负担并降低医疗成本。

摘要:

收件箱消息交互在医患沟通中起着至关重要的作用,贯穿患者诊疗旅程的所有阶段(诊疗前、诊疗中和诊疗后)。然而,回复这些患者咨询已成为医疗工作流程中的重大负担,耗费临床护理团队大量时间。为解决这一问题,我们引入了 RadOnc-GPT,这是一个由 GPT-4 驱动的专用大语言模型(LLM),其设计重点在于前列腺癌的放射治疗,并采用了先进的提示工程,专门用于辅助生成回复。我们将 RadOnc-GPT 与患者电子健康记录(EHR)进行了集成,数据来源既包括全院范围的 EHR 数据库,也包括一个内部的放射肿瘤学专用数据库。RadOnc-GPT 在 158 条历史记录的收件箱消息交互上进行了评估。我们使用定量自然语言处理(NLP)分析以及由临床医生和护士参与的两项评分研究来评估 RadOnc-GPT 的回复。研究结果表明,RadOnc-GPT 在“清晰度”和“同理心”方面略优于临床护理团队,同时在“完整性”和“正确性”方面取得了相当的得分。据估计,从阅读咨询到发送回复,RadOnc-GPT 可为护士每条消息节省 5.2 分钟,为临床医生节省 2.4 分钟。采用 RadOnc-GPT 生成收件箱消息草稿,有潜力通过产出高质量、及时的回复来减轻临床护理团队的工作负担并降低医疗成本。

英文摘要:

In-basket message interactions play a crucial role in physician-patient communication, occurring during all phases (pre-, during, and post) of a patient's care journey. However, responding to these patients' inquiries has become a significant burden on healthcare workflows, consuming considerable time for clinical care teams. To address this, we introduce RadOnc-GPT, a specialized Large Language Model (LLM) powered by GPT-4 that has been designed with a focus on radiotherapeutic treatment of prostate cancer with advanced prompt engineering, and specifically designed to assist in generating responses. We integrated RadOnc-GPT with patient electronic health records (EHR) from both the hospital-wide EHR database and an internal, radiation-oncology-specific database. RadOnc-GPT was evaluated on 158 previously recorded in-basket message interactions. Quantitative natural language processing (NLP) analysis and two grading studies with clinicians and nurses were used to assess RadOnc-GPT's responses. Our findings indicate that RadOnc-GPT slightly outperformed the clinical care team in "Clarity" and "Empathy," while achieving comparable scores in "Completeness" and "Correctness." RadOnc-GPT is estimated to save 5.2 minutes per message for nurses and 2.4 minutes for clinicians, from reading the inquiry to sending the response. Employing RadOnc-GPT for in-basket message draft generation has the potential to alleviate the workload of clinical care teams and reduce healthcare costs by producing high-quality, timely responses.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑