A Concise Review of Hallucinations in LLMs and their Mitigation
Computer Engineering K J Somaiya Institute of Technology Mumbai, India;Data Science K J Somaiya Institute of Technology Mumbai, India;Information Technology K J Somaiya Institute of Technology Mumbai, India
Traditional language models face a challenge from hallucinations. Their very presence casts a large, dangerous shadow over the promising realm of natural language processing. It becomes crucial to understand the various kinds of hallucinations that occur nowadays, their origins, and ways of reducing them. This document provides a concise and straightforward summary of that. It serves as a one-stop resource for a general understanding of hallucinations and how to mitigate them.
In-Context Sharpness as Alerts: An Inner Representation Perspective for Hallucination Mitigation
City University of Hong Kong(香港城市大学);National University of Singapore(新加坡国立大学);Shanghai Jiao Tong University(上海交通大学);Stanford University(斯坦福大学);Penn State University(宾夕法尼亚州立大学);Hong Kong University of Science and Technology(香港科技大学)
MeasHalu: Mitigation of Scientific Measurement Hallucinations for Large Language Models with Enhanced Reasoning
Shenzhen Key Laboratory for High Performance Data Mining(深圳高性能数据挖掘重点实验室);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(深圳先进技术研究院,中国科学院);Artificial Intelligence Research Institute, Shenzhen University of Advanced Technology(深圳先进技术大学人工智能研究院)
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University(武汉大学电子信息学院);School of Computing, Dublin City University(都柏林城市大学计算机学院);School of Public Health, Wuhan University(武汉大学公共卫生学院);Insight Centre for Data Analytics, University of Galway(Galway大学数据分析研究中心);Insight Centre for Data Analytics, Dublin City University(都柏林城市大学数据分析研究中心)
On-Policy Self-Alignment with Fine-grained Knowledge Feedback for Hallucination Mitigation
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences, Beijing, China(中国科学院软件研究所信息处理实验室,北京,中国);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学,北京,中国);Xiaohongshu Inc(小红书公司)
GRAIT: Gradient-Driven Refusal-Aware Instruction Tuning for Effective Hallucination Mitigation
Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);Peking University(北京大学);Southwest Jiaotong University(西南交通大学);Shanghai Jiaotong University(上海交通大学);Chinese University of Hong Kong(香港中文大学)
An Evolutionary Large Language Model for Hallucination Mitigation
BIOSTIM Laboratory Faculty of Medicine Salah Boubnider University Constantine, Algeria(BIOSTIM实验室医学院萨拉赫·布宾德大学阿尔及利亚科纳克特);Department of IFA Faculty of NTIC Abdelhamid Mehri University Constantine, Algeria(IFA部门NTIC学院阿卜杜勒哈米德·梅赫里大学阿尔及利亚科纳克特)
Exploring the Generalizability of Factual Hallucination Mitigation via Enhancing Precise Knowledge Utilization
Dept. of Comp. Sci. and Tech.(计算机科学与技术系);Institute for AI(人工智能研究院);Tsinghua-Bosch Joint ML Center(清华大学-博世联合机器学习中心);THBI Lab(THBI实验室);BNRist Center(BNRist中心);Tsinghua University(清华大学)
Trust Me, I'm Wrong: LLMs Hallucinate with Certainty Despite Knowing the Answer
Technion – Israel Institute of Technology(技术ion-以色列理工学院);University of Oxford and WhiteBox(牛津大学和WhiteBox);School of Computer Science and Engineering, The Hebrew University of Jerusalem(耶路撒冷希伯来大学计算机科学与工程学院)
The Dawn After the Dark: An Empirical Study on Factuality Hallucination in Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);DIRO, Université de Montréal(蒙特利尔大学计算机科学与运筹学系);School of Information, Renmin University of China(中国人民大学信息资源管理学院)
HAVE: Head-Adaptive Gating and ValuE Calibration for Hallucination Mitigation in Large Language Models
Xin Tong School of Information and Cyber Security People’s Public Security University of China(信息与网络安全学院 中国人民公安大学);Zhi Lin School of Safety Science Tsinghua University(安全科学学院 清华大学);Jingya Wang School of Information and Cyber Security People’s Public Security University of China(信息与网络安全学院 中国人民公安大学);Bo Jin* The Third Research Institute of the Ministry of Public Security of China(公安部第三研究所)
Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Gaoling School of Artifical Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院)
Retrieval, not hallucinations, will be the limiting factor for LLM-based clinical AI tools
The University of Texas Health Science Center at Houston(德克萨斯大学休斯顿健康科学中心);Oregon Health & Science University(俄勒冈健康与科学大学);Mayo Clinic(梅奥诊所);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
Siren's Song in the AI Ocean: A Survey on Hallucination in Large Language Models
Tencent AI lab(腾讯AI实验室);Soochow University(苏州大学);Zhejiang University(浙江大学);Renmin University of China(中国人民大学);Nanyang Technological University(南洋理工大学);Toyota Technological Institute at Chicago(芝加哥丰田技术研究所)