arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.18786cs.CLcs.AI
收藏

大型语言模型诚实性综述

A Survey on the Honesty of Large Language Models

The University of Hong Kong(香港大学);Tsinghua University(清华大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Virginia(弗吉尼亚大学);Peking University(北京大学);WeChat AI(微信人工智能);The Chinese University of Hong Kong(香港中文大学)

Siheng Li, Cheng Yang, Taiqiang Wu, Chufan Shi, Yuji Zhang, Xinyu Zhu, Zesen Cheng, Deng Cai, Mo Yu, Lemao Liu, Jie Zhou, Yujiu Yang, Ngai Wong, Xixin Wu, Wai Lam

AI总结:

本文综述了大型语言模型的诚实性研究,涵盖定义澄清、评估方法及改进策略,并指出当前模型存在的欺骗行为及研究挑战,为未来探索提供见解。

摘要:

诚实性是将大型语言模型(LLM)与人类价值观对齐的基本原则,要求这些模型识别其所知与未知,并能够忠实地表达其知识。尽管前景广阔,当前的LLM仍表现出显著的欺骗行为,如自信地给出错误答案或无法表达其所知。此外,LLM诚实性研究也面临挑战,包括诚实性定义不一、难以区分已知与未知知识,以及对相关研究缺乏全面理解。为解决这些问题,我们提供了关于LLM诚实性的综述,涵盖其澄清、评估方法及改进策略。此外,我们为未来研究提供了见解,旨在激发对这一重要领域的进一步探索。

英文摘要:

Honesty is a fundamental principle for aligning large language models (LLMs) with human values, requiring these models to recognize what they know and don't know and be able to faithfully express their knowledge. Despite promising, current LLMs still exhibit significant dishonest behaviors, such as confidently presenting wrong answers or failing to express what they know. In addition, research on the honesty of LLMs also faces challenges, including varying definitions of honesty, difficulties in distinguishing between known and unknown knowledge, and a lack of comprehensive understanding of related research. To address these issues, we provide a survey on the honesty of LLMs, covering its clarification, evaluation approaches, and strategies for improvement. Moreover, we offer insights for future research, aiming to inspire further exploration in this important area.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑