Large language models (LLMs) have shown promise for generative and knowledge-intensive tasks including question-answering (QA) tasks. However, the practical deployment still faces challenges, notably the issue of "hallucination", where models generate plausible-sounding but unfaithful or nonsensical information. This issue becomes particularly critical in the medical domain due to the uncommon professional concepts and potential social risks involved. This paper analyses the phenomenon of hallucination in medical generative QA systems using widely adopted LLMs and datasets. Our investigation centers on the identification and comprehension of common problematic answers, with a specific emphasis on hallucination. To tackle this challenge, we present an interactive self-reflection methodology that incorporates knowledge acquisition and answer generation. Through this feedback process, our approach steadily enhances the factuality, consistency, and entailment of the generated answers. Consequently, we harness the interactivity and multitasking ability of LLMs and produce progressively more precise and accurate answers. Experimental results on both automatic and human evaluation demonstrate the superiority of our approach in hallucination reduction compared to baselines.
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University（武汉大学电子信息学院）；School of Computing, Dublin City University（都柏林城市大学计算机学院）；School of Public Health, Wuhan University（武汉大学公共卫生学院）；Insight Centre for Data Analytics, University of Galway（Galway大学数据分析研究中心）；Insight Centre for Data Analytics, Dublin City University（都柏林城市大学数据分析研究中心）
NTS-CoT: Mitigating Hallucinations in LLM-based News Timeline Summarization with Chain-of-Thought Reasoning
Central South University（中南大学）；Tsinghua University（清华大学）；Nanjing University（南京大学）；Suzhou Aerospace Information Research Institute（苏州空天信息研究院）；McGill University（麦吉尔大学）
Whispers that Shake Foundations: Analyzing and Mitigating False Premise Hallucinations in Large Language Models
Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）；School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）；Hunan Normal University（湖南师范大学）
Attention-guided Self-reflection for Zero-shot Hallucination Detection in Large Language Models
New Laboratory of Pattern Recognition (NLPR), State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)（模式识别新实验室、多模态人工智能系统国家重点实验室、自动化研究所、中国科学院）
Mitigating Behavioral Hallucination in Multimodal Large Language Models for Sequential Images
Provable Responsible AI and Data Analytics (PRADA) Lab（可证明负责任的人工智能与数据分析实验室）；King Abdullah University of Science and Technology（国王阿卜杜勒阿齐兹大学）；University of Electronic Science and Technology of China（中国电子科学技术大学）；University of Copenhagen（哥本哈根大学）
Mitigating Large Language Model Hallucinations via Autonomous Knowledge Graph-based Retrofitting
Institute of Software, Chinese Academy of Sciences（中国科学院软件研究所）；State Key Laboratory of Computer Science（计算机科学国家重点实验室）；University of Chinese Academy of Sciences（中国科学院大学）
MHSA: A Lightweight Framework for Mitigating Hallucinations via Steered Attention in LVLMs
Tsinghua University（清华大学）；Tsinghua University, Tencent（清华大学腾讯）；Tencent（腾讯）；University of Science and Technology Beijing（北京科技大学）；University of Macau（澳门大学）
Mitigating Hallucination Through Theory-Consistent Symmetric Multimodal Preference Optimization
Shandong University（山东大学）；Southern University of Science and Technology（南方科技大学）；University of Georgia（佐治亚大学）；National University of Singapore（新加坡国立大学）；Harbin Institute of Technology (Shenzhen)（哈尔滨工业大学（深圳））
Prescribing the Right Remedy: Mitigating Hallucinations in Large Vision-Language Models via Targeted Instruction Tuning
Beijing Key Lab of Traffic Data Analysis and Mining（北京交通大数据分析与挖掘重点实验室）；Beijing Jiaotong University（北京交通大学）；School of Information Technology and Management（信息科学技术学院）
Mitigating Multilingual Hallucination in Large Vision-Language Models
School of Computer Science & Technology, Huazhong University of Science and Technology（华中科技大学计算机科学与技术学院）；School of Computing Science and Technology, Fudan University（复旦大学计算机科学技术学院）；Wangxuan Institute of Computer Technology, Peking University（北京大学王选计算机研究所）；School of Computing Science and Technology, Zhejiang Gongshang University（浙江工商大学计算机科学与技术学院）；Department of Computer Science and Engineering, The Chinese University of Hong Kong（香港中文大学计算机科学与工程学系）
MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Models
The Chinese University of Hong Kong（香港中文大学）；Institute of Medical Intelligence and XR, The Chinese University of Hong Kong（香港中文大学医学智能与XR研究所）；Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）
Mitigating Geospatial Knowledge Hallucination in Large Language Models: Benchmarking and Dynamic Factuality Aligning
College of AI, Tsinghua University（清华大学人工智能学院）；Department of Electronic Engineering, BNRist, Tsinghua University（清华大学电子工程系）；School of Electronic and Information Engineering, Beijing Jiaotong University（北京交通大学电子信息学院）；Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系）
SeeMe: Mitigating Hallucinations in Large Vision-Language Models through Effective Visual Token Engineering
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University（北京大学计算机科学学院多媒体信息处理国家重点实验室）；University of Pennsylvania（宾夕法尼亚大学）；University of Electronic Science and Technology of China（电子科技大学）；Nanyang Technological University（南洋理工大学）；Tsinghua University（清华大学）；The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳））；De Artificial Intelligence Lab（德人工智能实验室）
TruthPrInt: Mitigating Large Vision-Language Models Object Hallucination Via Latent Truthful-Guided Pre-Intervention
Drexel University（德雷塞尔大学）；University of Electronic Science and Technology of China（电子科技大学）；Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州））；LLNL（劳伦斯利弗莫尔国家实验室）；Lehigh University（莱斯大学）
HalluClear: Diagnosing, Evaluating and Mitigating Hallucinations in GUI Agents
MAIS&NLPR, Institute of Automation, Chinese Academy of Sciences（自动化研究所人工智能与自然语言处理实验室，中国科学院）；School of Artificial Intelligence, UCAS（中国科学院大学人工智能学院）；Meituan（美团）
