Large language models (LLMs) have experienced notable advancements in generating coherent and contextually relevant responses. However, hallucinations - incorrect or unfounded claims - are still prevalent, prompting the creation of automated metrics to detect these in LLM outputs. Our contributions include: introducing ChainPoll, an innovative hallucination detection method that excels compared to its counterparts, and unveiling RealHall, a refined collection of benchmark datasets to assess hallucination detection metrics from recent studies. While creating RealHall, we assessed tasks and datasets from previous hallucination detection studies and observed that many are not suitable for the potent LLMs currently in use. Overcoming this, we opted for four datasets challenging for modern LLMs and pertinent to real-world scenarios. Using RealHall, we conducted a comprehensive comparison of ChainPoll with numerous hallucination metrics from recent studies. Our findings indicate that ChainPoll outperforms in all RealHall benchmarks, achieving an overall AUROC of 0.781. This surpasses the next best theoretical method by 11% and exceeds industry standards by over 23%. Additionally, ChainPoll is cost-effective and offers greater transparency than other metrics. We introduce two novel metrics to assess LLM hallucinations: Adherence and Correctness. Adherence is relevant to Retrieval Augmented Generation workflows, evaluating an LLM's analytical capabilities within given documents and contexts. In contrast, Correctness identifies logical and reasoning errors.
Attention-guided Self-reflection for Zero-shot Hallucination Detection in Large Language Models
New Laboratory of Pattern Recognition (NLPR), State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences (CASIA)(模式识别新实验室、多模态人工智能系统国家重点实验室、自动化研究所、中国科学院)
Beyond Superficial Unlearning: Sharpness-Aware Robust Erasure of Hallucinations in Multimodal LLMs
College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);Institute for AI, Tsinghua University(清华大学人工智能研究院);Huzhou University(湖州大学);Institute of Dataspace, Hefei Comprehensive National Science Center(合肥综合性国家科学中心数据空间研究院);University of Science and Technology of China(中国科学技术大学)
Prescribing the Right Remedy: Mitigating Hallucinations in Large Vision-Language Models via Targeted Instruction Tuning
Beijing Key Lab of Traffic Data Analysis and Mining(北京交通大数据分析与挖掘重点实验室);Beijing Jiaotong University(北京交通大学);School of Information Technology and Management(信息科学技术学院)
Mitigating LLM Hallucinations through Domain-Grounded Tiered Retrieval
Computational Unit, Z.H. College of Engineering & Technology, Aligarh Muslim University, India(计算单元,Z.H. 工程技术学院,阿利加尔穆斯林大学,印度);Interdisciplinary Center for Artificial Intelligence, Aligarh Muslim University, India(跨学科人工智能中心,阿利加尔穆斯林大学,印度);Department of Computer Engineering, Aligarh Muslim University, India(计算机工程系,阿利加尔穆斯林大学,印度)
Balancing Efficiency and Efficacy: Training-Free Attention-Guided Switching Between Explicit and Latent Thoughts for MLLMs
Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳));Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Peng Cheng Laboratory(鹏城实验室);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院)
Enhanced Hallucination Detection in Neural Machine Translation through Simple Detector Aggregation
CentraleSupélec(中央高等电力学院);Universite Paris-Saclay(巴黎萨克雷大学);Inria(法国国家信息与自动化研究所);CEA(法国原子能和替代能源委员会);digeiz;Equall;Instituto de Telecomunicações(电信研究所);University of Lisbon(里斯本大学);Unbabel
An Empirical Study on Prompt Compression for Large Language Models
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));South China University of Technology(华南理工大学);University of Science and Technology of China(中国科学技术大学)
Loki's Dance of Illusions: A Comprehensive Survey of Hallucination in Large Language Models
Beijing University of Posts and Telecommunications(北京邮电大学);Shihezi University(石河子大学);Beihang University(北航);Beijing Academy of Artificial Intelligence(北京人工智能研究院);Jilin University(吉林大学);Central South University(中南大学);Jinan University(暨南大学)
ZhiFangDanTai: Fine-tuning Graph-based Retrieval-Augmented Generation Model for Traditional Chinese Medicine Formula
School of Management, Capital Normal University(管理学院,首都师范大学);School of Electrical Engineering and Computer Science, the University of Queensland(电气工程与计算机科学学院,昆士兰大学)
LLM-Confidence Reranker: A Training-Free Approach for Enhancing Retrieval-Augmented Generation Systems
organization= School of Computer Science;Technology, Dalian University of Technology , addressline= No.2 Linggong Road, Ganjingzi District , city= Dalian , postcode= 116024 , country= China;organization= School of Information Engineering, Liaodong University , addressline= No.116 Linjiang Back Street, Zhenan District , city= Dandong , postcode= 118001 , country= China;organization= School of Information Engineering, Dalian Ocean University , addressline= No. 2-52, Heishijiao Street, Shahekou District , city= Dalian , postcode= 116023 , country= China;organization= Information Technology Center, Qinghai University , addressline= 251 Ningda Road, Chengbei District , city= Xining , postcode= 810016 , country= China;organization= School of Electronic;Information Engineering, Liaoning Technical University , addressline= 188 Longwan South Street, Sijiatun District , city= Huludao , postcode= 125105 , country= China;organization= School of Artificial Intelligence, Tianjin Normal University , addressline= 393 Binshui West Road, Xiqing District , city= Tianjin , postcode= 300387 , country= China;organization= Tencent (Dalian Northern Interactive Entertainment Technology Co., Ltd.) , addressline= 21/F, Tencent Building, No. 26 Jingxian St, Ganjingzi District , city= Dalian , postcode= 116085 , country= China
HGOT: Hierarchical Graph of Thoughts for Retrieval-Augmented In-Context Learning in Factuality Evaluation
Smith School of Business, Queen’s University(女王大学史密斯商学院);Ingenuity Labs Research Institute, Queen’s University(女王大学 Ingenuity 实验室研究所);Department of Electrical and Computer Engineering, Queen’s University(女王大学电气与计算机工程系)
PoLLMgraph: Unraveling Hallucinations in Large Language Models via State Transition Dynamics
Technical University of Munich(慕尼黑工业大学);CISPA Helmholtz Center for Information Security(亥姆霍兹信息安全研究中心CISPA);University of Stavanger(斯塔万格大学);Fraunhofer FOKUS(弗劳恩霍夫FOKUS研究所);The University of Tokyo(东京大学);University of Alberta(阿尔伯塔大学)
Navigation-GPT: A Robust and Adaptive Framework Utilizing Large Language Models for Navigation Applications
Wuhan University of Technology(武汉理工大学);Intelligent Transportation Systems Research Center, Wuhan University of Technology(武汉理工大学智能交通系统研究中心);Hangzhou Dianzi University(杭州电子科技大学);Nanjing Smart Water Transport Technology Co., Ltd.(南京智慧水运科技有限公司)
CogMG: Collaborative Augmentation Between Large Language Model and Knowledge Graph
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Bridging the Knowledge-Action Gap by Evaluating LLMs in Dynamic Dental Clinical Scenarios
The Second Affiliated Hospital of Harbin Medical University(哈尔滨医科大学附属第二医院);Peking University School and Hospital of Stomatology(北京大学口腔医学院(口腔医院));Medlinker Intelligent and Digital Technology Co., Ltd(医联智数科技有限公司);The University of Queensland(昆士兰大学);Beijing Xicheng District Health Care Hospital for Mothers and Children(北京市西城区妇幼保健院)