AI在临床决策中极易被说服

中文摘要 AI 辅助

随着AI越来越多地融入临床实践，其在医疗决策中发挥的作用日益增大。然而，医学是高风险、循证的领域，决策可直接影响患者生命，因此理解AI在他人试图说服时能否保持客观判断十分重要。本文通过对照实验研究AI被说服的难易程度，发现专业权威、国籍背景、机构隶属关系、声称的过往表现、多名医生、支持临床医生的观点及反复施压均会影响AI决策。令人惊讶的是，相同说服性输入来自资深临床医生时，改变的案例比来自医学生时多约10%；仅声称更好的过往表现就能持续提升医生的说服力。更引人注目的是，即使是为支持错误答案编造的看似合理的临床医生观点，也能说服AI偏离正确决策，这表明AI易被有说服力的支持影响，却无法可靠判断该临床医生观点是否正确。综合这些发现，AI极易被人们的言论、说话者身份及观点呈现方式说服，因此AI在被说服时保持合理判断，以确保其在高风险医疗决策中的安全可靠使用至关重要。

英文摘要

As AI becomes increasingly integrated into clinical practice, it is playing a growing role in medical decision making. Medicine, however, is a high stakes and evidence based field, where decisions can directly affect patients' lives. It is therefore important to understand whether AI can maintain objective judgment when others try to persuade it. In this paper, we study how easily AI can be persuaded through controlled experiments. We find that professional authority, national background, institutional affiliation, claimed past performance, multiple physicians, supported clinician views, and repeated pressure can all affect AI decisions. Surprisingly, the same persuasive input changes about 10% more cases when it comes from a senior clinician than from a medical student. Simply claiming a better performance history consistently makes the physician more persuasive. More strikingly, a plausible clinician view can persuade AI away from a correct decision even when it is fabricated to support an incorrect answer. This indicates that AI can be strongly influenced by convincing support without reliably determining whether this view from the clinician is correct. Together, these findings suggest that AI can be easily persuaded by what people say, who says it, and how the opinion is presented. Therefore, it is essential for AI to maintain sound judgment under persuasion, enabling its safe and reliable use in high stakes medical decision making.

发表机构

• University of Oxford（牛津大学）
• Stanford University（斯坦福大学）

机构由 AI 辅助整理，请以论文原文为准。