arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.01303cs.CLcs.AI
收藏

LLM生成回答中的引用与信任

Citations and Trust in LLM Generated Responses

University of Notre Dame(圣母大学);Deloitte & Touche LLP(德勤全球有限公司)

Yifan Ding, Matthew Facciani, Amrit Poudel, Ellen Joyce, Salvador Aguinaga, Balaji Veeramani, Sanmitra Bhattacharya, Tim Weninger

AI总结:

通过实时问答实验研究引用对LLM生成回答信任的影响,发现引用存在可显著提升信任(即使引用随机),而检查引用会降低信任,揭示了引用在增强AI内容可信度中的关键作用。

摘要:

问答系统正在快速发展,但其不透明的特性可能影响用户信任。我们通过一个反监控框架来研究信任,该框架预测信任与引用的存在相关,并与检查引用的行为呈负相关。我们通过一项实时问答实验检验了这一假设,该实验展示了由商用聊天机器人生成的文本回答,并附带不同数量的引用(零个、一个或五个),这些引用既有相关的也有随机的,同时记录参与者是否检查了引用以及他们对生成回答的自我报告信任度。我们发现,当引用存在时,信任显著增加,即使引用是随机的,这一结果仍然成立;我们还发现,当参与者检查引用时,信任显著下降。这些结果凸显了引用在增强对AI生成内容的信任方面的重要性。

英文摘要:

Question answering systems are rapidly advancing, but their opaque nature may impact user trust. We explored trust through an anti-monitoring framework, where trust is predicted to be correlated with presence of citations and inversely related to checking citations. We tested this hypothesis with a live question-answering experiment that presented text responses generated using a commercial Chatbot along with varying citations (zero, one, or five), both relevant and random, and recorded if participants checked the citations and their self-reported trust in the generated responses. We found a significant increase in trust when citations were present, a result that held true even when the citations were random; we also found a significant decrease in trust when participants checked the citations. These results highlight the importance of citations in enhancing trust in AI-generated content.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑