Large language models (large LMs) are susceptible to producing text that contains hallucinated content. An important instance of this problem is self-contradiction, where the LM generates two contradictory sentences within the same context. In this work, we present a comprehensive investigation into self-contradiction for various instruction-tuned LMs, covering evaluation, detection, and mitigation. Our primary evaluation task is open-domain text generation, but we also demonstrate the applicability of our approach to shorter question answering. Our analysis reveals the prevalence of self-contradictions, e.g., in 17.7% of all sentences produced by ChatGPT. We then propose a novel prompting-based framework designed to effectively detect and mitigate self-contradictions. Our detector achieves high accuracy, e.g., around 80% F1 score when prompting ChatGPT. The mitigation algorithm iteratively refines the generated text to remove contradictory information while preserving text fluency and informativeness. Importantly, our entire framework is applicable to black-box LMs and does not require retrieval of external knowledge. Rather, our method complements retrieval-based methods, as a large portion of self-contradictions (e.g., 35.2% for ChatGPT) cannot be verified using online text. Our approach is practically effective and has been released as a push-button tool to benefit the public at https://chatprotect.ai/.
In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation
City University of Hong Kong（香港城市大学）；National University of Singapore（新加坡国立大学）；Shanghai Jiao Tong University（上海交通大学）；Stanford University（斯坦福大学）；Penn State University（宾夕法尼亚州立大学）；Hong Kong University of Science and Technology（香港科技大学）
A Concise Review of Hallucinations in LLMs and their Mitigation
Computer Engineering K J Somaiya Institute of Technology Mumbai, India；Data Science K J Somaiya Institute of Technology Mumbai, India；Information Technology K J Somaiya Institute of Technology Mumbai, India
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University（武汉大学电子信息学院）；School of Computing, Dublin City University（都柏林城市大学计算机学院）；School of Public Health, Wuhan University（武汉大学公共卫生学院）；Insight Centre for Data Analytics, University of Galway（Galway大学数据分析研究中心）；Insight Centre for Data Analytics, Dublin City University（都柏林城市大学数据分析研究中心）
Towards Mitigation of Hallucination for LLM-empowered Agents: Progressive Generalization Bound Exploration and Watchdog Monitor
College of Computer Science, Nankai University（南开大学计算机科学学院）；Haihe Lab of ITAI College of intelligent Science and Technology, Inner Mongolia University of Technology（内蒙古工业大学智能科学与技术学院海河实验室）；Institute of Computing Technology, Chinese Academy of Sciences（中国科学院计算技术研究所）；Department of Electrical and Computer Engineering, Stony Brook University（石溪大学电气与计算机工程系）；Department of Computer Science, Michigan Technological University（密歇根技术大学计算机科学系）
An Evolutionary Large Language Model for Hallucination Mitigation
BIOSTIM Laboratory Faculty of Medicine Salah Boubnider University Constantine, Algeria（BIOSTIM实验室医学院萨拉赫·布宾德大学阿尔及利亚科纳克特）；Department of IFA Faculty of NTIC Abdelhamid Mehri University Constantine, Algeria（IFA部门NTIC学院阿卜杜勒哈米德·梅赫里大学阿尔及利亚科纳克特）
Steering LVLMs via Sparse Autoencoder for Hallucination Mitigation
School of Computer Science and Engineering, Southeast University（东南大学计算机科学与工程学院）；Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications (Southeast University)（东南大学新一代人工智能技术及其交叉应用关键实验室）；Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所基础模型研究中心）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系）；Wuhan University of Technology（武汉理工大学）；National University of Singapore（新加坡国立大学）
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning
Shenzhen Key Laboratory for High Performance Data Mining（深圳高性能数据挖掘重点实验室）；Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（深圳先进技术研究院，中国科学院）；Artificial Intelligence Research Institute, Shenzhen University of Advanced Technology（深圳先进技术大学人工智能研究院）
HAVE: Head-Adaptive Gating and ValuE Calibration for Hallucination Mitigation in Large Language Models
Xin Tong School of Information and Cyber Security People’s Public Security University of China（信息与网络安全学院 中国人民公安大学）；Zhi Lin School of Safety Science Tsinghua University（安全科学学院 清华大学）；Jingya Wang School of Information and Cyber Security People’s Public Security University of China（信息与网络安全学院 中国人民公安大学）；Bo Jin* The Third Research Institute of the Ministry of Public Security of China（公安部第三研究所）
On-Policy Self-Alignment with Fine-grained Knowledge Feedback for Hallucination Mitigation
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences, Beijing, China（中国科学院软件研究所信息处理实验室，北京，中国）；University of Chinese Academy of Sciences, Beijing, China（中国科学院大学，北京，中国）；Xiaohongshu Inc（小红书公司）
