基于检索增强生成的大语言模型医疗化身在不同人群中的可用性与信任度可行性研究
A Feasibility Study on Usability and Trust among Population Groups of a Medical Avatar Supported by Large Language Models with Retrieval Augmented Generation
AI总结:
本研究通过调查165名来自多国的40岁以上成年人,评估了基于RAG增强LLM的医疗化身在患者及亲属角色中的可用性与信任度,结果显示评分均高于量表均值,且不受性别、国家或教育水平影响。
摘要:
医疗保健专业人员支持患者及其亲属的时间有限,但他们的信息需求很高。因此,拉德堡德大学与坎尼斯乌斯-威廉明娜医院共同开发了一个会说话的虚拟人类化身,与许多化身不同,该化身使用了一种通过检索增强生成(RAG)增强的大语言模型(LLM)。RAG技术使得医院提供的医疗信息能够在交互过程中被利用,而非通用的LLM信息。制作了两个视频,一个展示了关于全髋关节手术的患者-化身交互,另一个展示了患者亲属与化身之间关于术后谵妄的交互。在荷兰、英国和美国的40岁以上成年人中进行了一项调查,以研究性别、国家和教育水平对可用性和信任度的影响,这些是化身接受度的重要因素。参与者观看视频,想象自己为患者(视频1)或亲属(视频2),并在7点李克特量表(0-6)上对相关构念进行评分。共有165人(平均年龄=51.6,年龄标准差=8.9,男性=80,女性=85)完成了调查。在患者角色中,参与者对可用性的评分为均值=4.61(标准差=0.97),信任度评分为均值=3.92(标准差=1.10),均高于量表均值。在患者亲属角色中,参与者对可用性的评分为均值=4.64(标准差=1.08),信任度评分为均值=4.31(标准差=1.06)。未发现性别、国家和教育水平的影响。
英文摘要:
Healthcare professionals have limited time to support patients and their relatives, but their information needs are high. Therefore, the Radboud University together with the Canisius Wilhelmina Hospital hospital developed a speaking virtual hu-man avatar which, contrary to many avatars, uses a Large Language Model (LLM) enhanced with Retrieval Augmented Generation (RAG). The RAG tech-nique enables medical information supplied by the hospital to be utilized during interactions, rather than generic LLM information. Two videos were produced, one presenting a patient-avatar interaction regarding a total hip surgery, and an-other one presenting an interaction between a relative of a patient and the avatar concerning postoperative delirium. A survey was conducted among adults over 40 from the Netherlands, the UK and the USA to study the effects of gender, country and education level on usability and trust, which are important factors for avatar acceptance. Participants watched videos, imagining themselves as the pa-tient (video 1) or relative (video 2), and rated the constructs on a 7-point Likert scale (0-6). 165 persons (MeanAge=51.6, SDAge=8.9, Male=80, Female=85) completed the survey. In the patient role, participants scored the usability as M=4.61 (SD=0.97) and trust as M=3.92 (SD=1.10), all above the mean scale value. In the role as relative to the patient, participants scored usability as M=4.64 (SD=1.08) and trust as M=4.31 (SD=1.06). No effects were found of gender, country and education level.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。