大语言模型(Large Language Models,LLMs),尤其是经过指令微调用于对话的大语言模型,已成为我们日常生活的一部分。它们通过在单一平台为各类问题提供直接答案,将人们从多源信息搜索、提取与整合的流程中解放出来。遗憾的是,在诸多场景下,LLM的回复存在事实错误,这限制了其在现实场景中的适用性。因此,评估与提升LLMs事实性的研究近期受到了广泛关注。在本综述中,我们批判性地分析了现有研究,旨在识别核心挑战及其成因,指出提升LLMs事实性的潜在解决方案,并分析开放式文本生成场景下自动化事实性评估面临的障碍。我们还对未来研究的方向进行了展望。
英文摘要:
Large language models (LLMs), especially when instruction-tuned for chat, have become part of our daily lives, freeing people from the process of searching, extracting, and integrating information from multiple sources by offering a straightforward answer to a variety of questions in a single place. Unfortunately, in many cases, LLM responses are factually incorrect, which limits their applicability in real-world scenarios. As a result, research on evaluating and improving the factuality of LLMs has attracted a lot of attention recently. In this survey, we critically analyze existing work with the aim to identify the major challenges and their associated causes, pointing out to potential solutions for improving the factuality of LLMs, and analyzing the obstacles to automated factuality evaluation for open-ended text generation. We further offer an outlook on where future research should go.
Beyond Under-Alignment: Atomic Preference Enhanced Factuality Tuning for Large Language Models
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
Survey on Factuality in Large Language Models: Knowledge, Retrieval and Domain-Specificity
Westlake University(西湖大学);Zhejiang University(浙江大学);Purdue University(普渡大学);Fudan University(复旦大学);Amazon AWS AI(亚马逊AWS人工智能);Yale University(耶鲁大学);Shanghai Jiao Tong University(上海交通大学);The Hong Kong University of Science and Technology(香港科技大学);Tsinghua University(清华大学);Microsoft Research(微软研究院)
FELM: Benchmarking Factuality Evaluation of Large Language Models
National University of Singapore(新加坡国立大学);The Hong Kong University of Science and Technology(香港科技大学);Carnegie Mellon University(卡内基梅隆大学);City University of Hong Kong(香港城市大学);Shanghai Jiao Tong University(上海交通大学)
Is Factuality Enhancement a Free Lunch For LLMs? Better Factuality Can Lead to Worse Context-Faithfulness
Institute of Computing Technology, CAS(中国科学院计算技术研究所);University of Chinese Academy of Sciences(中国科学院大学);University of California, Merced(加州大学默塞德分校);University of Science and Technology of China(中国科学技术大学)
Beyond Factuality: A Comprehensive Evaluation of Large Language Models as Knowledge Generators
The Chinese University of Hong Kong(香港中文大学);National University of Singapore(新加坡国立大学);Tencent AI Lab(腾讯人工智能实验室);The Hong Kong University of Science and Technology(香港科技大学)
FacLens: Transferable Probe for Foreseeing Non-Factuality in Fact-Seeking Question Answering of Large Language Models
Zhipu AI(智谱AI);Zhongguancun Laboratory(中关村实验室);Renmin University of China(中国人民大学);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Tsinghua University(清华大学)
Large Language Models, scientific knowledge and factuality: A framework to streamline human expert evaluation
National Biomarker Centre, CRUK-MI, Univ. of Manchester(英国曼彻斯特大学CRUK-MI国家生物标志物中心);Idiap Research Institute(Idiap研究所);Inflamalps SA(因弗马尔普斯公司);Department of Computer Science, Univ. of Manchester(英国曼彻斯特大学计算机科学系)
Mitigating Geospatial Knowledge Hallucination in Large Language Models: Benchmarking and Dynamic Factuality Aligning
College of AI, Tsinghua University(清华大学人工智能学院);Department of Electronic Engineering, BNRist, Tsinghua University(清华大学电子工程系);School of Electronic and Information Engineering, Beijing Jiaotong University(北京交通大学电子信息学院);Department of Computer Science and Technology, Tsinghua University(清华大学计算机科学与技术系)
FAITH: Factuality Alignment through Integrating Trustworthiness and Honestness
Tsinghua University, Institute for Interdisciplinary Information Sciences(清华大学,交叉信息研究院);Shanghai Qi Zhi Institute(上海期智研究院);South China Normal University, School of Electronic Science and Engineering(华南师范大学,电子科学与工程学院);Guangzhou Richstone Data Technologies Co., Ltd.(广州瑞驰数据技术有限公司);LMU Munich & Munich Center for Machine Learning(慕尼黑大学 & 慕尼黑机器学习中心)
UAlign: Leveraging Uncertainty Estimations for Factuality Alignment on Large Language Models
The Chinese University of Hong Kong(香港中文大学);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);The University of Hong Kong(香港大学);The Hong Kong Polytechnic University(香港理工大学);Hong Kong University of Science and Technology, Guangzhou(香港科技大学(广州));MoE Key Laboratory of High Confidence Software Technologies(教育部高可信软件技术重点实验室)