Recent progress in natural language processing (NLP) owes much to remarkable advances in large language models (LLMs). Nevertheless, LLMs frequently "hallucinate," resulting in non-factual outputs. Our carefully-designed human evaluation substantiates the serious hallucination issue, revealing that even GPT-3.5 produces factual outputs less than 25% of the time. This underscores the importance of fact verifiers in order to measure and incentivize progress. Our systematic investigation affirms that LLMs can be repurposed as effective fact verifiers with strong correlations with human judgments. Surprisingly, FLAN-T5-11B, the least factual generator in our study, performs the best as a fact verifier, even outperforming more capable LLMs like GPT3.5 and ChatGPT. Delving deeper, we analyze the reliance of these LLMs on high-quality evidence, as well as their deficiencies in robustness and generalization ability. Our study presents insights for developing trustworthy generation models.
How do Humans Process AI-generated Hallucination Contents: a Neuroimaging Study
Department of Computer Science and Technology, Tsinghua University, Beijing, China(清华大学计算机科学与技术系);Institute of Trustworthy Embodied AI, Fudan University, Shanghai, China(复旦大学可信具身人工智能研究院)
VL-GenRM: Enhancing Vision-Language Verification via Vision Experts and Iterative Training
The Hong Kong University of Science and Technology(香港科学与技术大学);Nanyang Technological University(南洋理工大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Advancing Tool-Augmented Large Language Models via Meta-Verification and Reflection Learning
State Key Laboratory of Cognitive Intelligence, University of Science and Technology of China(认知智能国家重点实验室,中国科学技术大学);Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology(社会计算与交互机器人研究中心,哈尔滨工业大学)
Enhancing Multi-Hop Fact Verification with Structured Knowledge-Augmented Large Language Models
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Detecting Contextual Hallucinations in LLMs with Frequency-Aware Attention
Department of Informatics, King's College London, UK(伦敦国王学院信息学院);Department of Statistics, University of Warwick, UK(沃里克大学统计系);School of Computer Science, The University of Sheffield, UK(谢菲尔德大学计算机科学学院);The Alan Turing Institute, UK(艾伦·图灵研究所)
Hybrid Fact-Checking that Integrates Knowledge Graphs, Large Language Models, and Search-Based Retrieval Agents Improves Interpretable Claim Verification
HalluTruthQA: A Fine-Grained Benchmark for Hallucination Detection, Localization, and Explanation in Arabic Question Answering
Hamad Bin Khalifa University(哈马德·本·哈利法大学);Qatar University(卡塔尔大学);University of Biskra(比斯克拉大学);University of the Basque Country(巴斯克大学);Nazarbayev University(纳扎尔巴耶夫大学);Universiti Malaysia Kelantan(马来西亚吉兰丹大学)
Vera: A General-Purpose Plausibility Estimation Model for Commonsense Statements
University of Washington(华盛顿大学);Allen Institute for Artificial Intelligence(艾伦人工智能研究所);Nanyang Technological University(南洋理工大学);Harvard University(哈佛大学)