arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.04681cs.CLcs.AIcs.CYcs.HC

由大型语言模型驱动的对话式AI会放大证人访谈中的错误记忆

Conversational AI Powered by Large Language Models Amplifies False Memories in Witness Interviews

Massachusetts Institute of Technology(麻省理工学院);MIT Media Lab(麻省理工学院媒体实验室);University of California, Irvine(加州大学欧文分校)

Samantha Chan, Pat Pataranutaporn, Aditya Suri, Wazeer Zulfikar, Pattie Maes, Elizabeth F. Loftus

AI总结:

本研究模拟犯罪证人访谈,对比四种访谈条件,发现基于LLM的生成式聊天机器人会显著诱发并强化错误记忆,揭示敏感场景中应用对话式AI的伦理风险。

摘要:

本研究考察了AI对人类错误记忆的影响,错误记忆即对未发生事件或偏离实际发生情况事件的回忆。研究通过在人机交互中采用暗示性提问来探究错误记忆的诱发过程,并模拟了犯罪证人访谈场景。实验测试了四种条件:对照组、基于调查问卷的方式、预编写脚本的聊天机器人,以及使用大型语言模型(LLM)的生成式聊天机器人。参与者(N=200)先观看一段犯罪视频,随后与其被分配到的AI访谈员或调查问卷进行交互,回答包括五个误导性问题在内的若干问题。研究在访谈结束后立即以及一周后对错误记忆进行评估。结果显示,生成式聊天机器人条件显著增加了错误记忆的形成,其诱发的即时错误记忆数量是对照组的3倍以上,是调查问卷方法的1.7倍。用户对生成式聊天机器人的回答中有36.4%在交互过程中受到误导。一周后,生成式聊天机器人诱发的错误记忆数量保持不变。然而,一周后受试者对这些错误记忆的信心仍高于对照组。研究还探讨了调节因素:对聊天机器人不太熟悉但对AI技术更熟悉、且对犯罪调查更感兴趣的用户更容易受到错误记忆影响。这些发现凸显了在警察访谈等敏感情境中使用先进AI的潜在风险,强调了进行伦理考量的必要性。

英文摘要:

This study examines the impact of AI on human false memories -- recollections of events that did not occur or deviate from actual occurrences. It explores false memory induction through suggestive questioning in Human-AI interactions, simulating crime witness interviews. Four conditions were tested: control, survey-based, pre-scripted chatbot, and generative chatbot using a large language model (LLM). Participants (N=200) watched a crime video, then interacted with their assigned AI interviewer or survey, answering questions including five misleading ones. False memories were assessed immediately and after one week. Results show the generative chatbot condition significantly increased false memory formation, inducing over 3 times more immediate false memories than the control and 1.7 times more than the survey method. 36.4% of users' responses to the generative chatbot were misled through the interaction. After one week, the number of false memories induced by generative chatbots remained constant. However, confidence in these false memories remained higher than the control after one week. Moderating factors were explored: users who were less familiar with chatbots but more familiar with AI technology, and more interested in crime investigations, were more susceptible to false memories. These findings highlight the potential risks of using advanced AI in sensitive contexts, like police interviews, emphasizing the need for ethical considerations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑