arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.07920cs.HC
收藏

探索患者对AI驱动的LLM(如ChatGPT)提供的临床自我诊断建议的信任

Exploring patient trust in clinical advice from AI-driven LLMs like ChatGPT for self-diagnosis

University of Siegen(锡根大学)

Delong Du, Richard Paluch, Gunnar Stevens, Claudia Müller

AI总结:

本研究通过观察患者使用GPT-4自我诊断并访谈,发现患者因缺乏医学知识难以识别错误,信任有限,且医生核查成本高,引发对LLM临床建议的伦理担忧。

摘要:

可信的临床建议至关重要,但获取可能负担沉重。有限的可及性和经济成本可能导致人们进行自我诊断。然而,自我诊断需要大量学习,并且在人们未经专业指导寻求治疗时可能带来风险。大型语言模型(LLM),如GPT-4,可能提供一种便捷但有风险的替代方案,因为它们可能生成不准确但令人信服的信息。因此,我们探究患者能否信任AI驱动的LLM提供的临床建议。我们通过一项出声思考观察来考察这一问题,其中一名患者使用GPT-4进行自我诊断,同时一名医生利用专业知识评估其回应。随后,我们对患者进行了一次半结构化访谈,了解其对该系统的信任。我们的结果表明,患者可能难以识别错误,因为他们缺乏专业医学知识,即使GPT-4提供的建议医生能识别为虚假。患者可能因GPT-4解释其回应并承认其局限性而产生一定信任,但这种信任仍不确定,因为其建议可能不可靠。医生还报告称,检查GPT-4的回应比不借助它进行诊断需要更多努力。患者倾向于信任医生,因为受过教育和授权的专业人士能提供有效指导。这种信任还通过社会联系、认证、机构问责和专业规则得以发展。医生可以调整问题、观察患者,并在患者无法清晰描述症状时使用不同方法。然而,LLM主要依赖提示中提供的信息,可能忽略医生在临床会诊中能识别的细节。这些发现引发了关于LLM用于临床建议时的能力、责任、自主性和安全性的问题。

英文摘要:

Trustworthy clinical advice is crucial but can be burdensome to obtain. Limited access and financial costs may lead people to self-diagnose. However, self-diagnosis requires considerable learning and can create risks when people pursue treatment without professional guidance. Large language models (LLMs) such as GPT-4 may offer a convenient yet risky alternative because they can produce inaccurate but convincing information. We therefore ask whether patients can trust clinical advice from AI-driven LLMs. We examined this question through a think-aloud observation in which a patient used GPT-4 for self-diagnosis while a doctor assessed its responses using professional expertise. We then conducted a semi-structured interview with the patient about their trust in the system. Our results show that patients may struggle to identify errors because they lack professional medical knowledge, even when GPT-4 provides advice that a doctor can recognize as false. Patients may develop some trust because GPT-4 explains its responses and acknowledges its limitations, but this trust remains uncertain because its advice can be unreliable. The doctor also reported that checking GPT-4's responses required more effort than making a diagnosis without it. Patients tend to trust doctors because educated and authorized professionals can provide effective guidance. This trust also develops through social connection, certification, institutional accountability, and professional rules. Doctors can adapt their questions, observe patients, and use different methods when patients cannot clearly describe their symptoms. An LLM, however, depends primarily on the information provided in a prompt and may overlook details that a doctor could identify during a clinical consultation. These findings raise questions about competence, responsibility, autonomy, and safety when LLMs are used for clinical advice.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑