arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.14262cs.CRcs.CL

良好的引导就是你所需的一切——多智能体 LLM 幻觉缓解

Good Parenting is all you need -- Multi-agentic LLM Hallucination Mitigation

Harvard University(哈佛大学)

Ted Kwartler, Matthew Berman, Alan Aqrawi

AI总结:

该研究通过主智能体生成、审查智能体纠错的多智能体框架评估 LLM 幻觉缓解,4,900 次实验显示先进模型可近乎完美识别幻觉并高比例完成修订。

摘要:

本研究探讨了大型语言模型(LLM)智能体检测并纠正 AI 生成内容中幻觉的能力。一个主智能体被要求撰写一篇关于名为 Flipfloppidy 的虚构丹麦艺术家的博客,随后由另一个智能体审查其中的事实不准确之处。大多数 LLM 都幻觉该艺术家存在。在涉及主智能体与审查智能体不同组合的 4,900 次测试运行中,Llama3-70b 和 GPT-4 变体等先进 AI 模型在识别幻觉方面表现出近乎完美的准确率,并在接收反馈后于 85% 至 100% 的情况下成功修订输出。这些发现强调了先进 AI 模型显著提升生成内容准确性和可靠性的潜力,为改进 AI 工作流编排提供了一种有前景的方法。

英文摘要:

This study explores the ability of Large Language Model (LLM) agents to detect and correct hallucinations in AI-generated content. A primary agent was tasked with creating a blog about a fictional Danish artist named Flipfloppidy, which was then reviewed by another agent for factual inaccuracies. Most LLMs hallucinated the existence of this artist. Across 4,900 test runs involving various combinations of primary and reviewing agents, advanced AI models such as Llama3-70b and GPT-4 variants demonstrated near-perfect accuracy in identifying hallucinations and successfully revised outputs in 85% to 100% of cases following feedback. These findings underscore the potential of advanced AI models to significantly enhance the accuracy and reliability of generated content, providing a promising approach to improving AI workflow orchestration.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑