Retromorphic Testing with Hierarchical Verification for Hallucination Detection in RAG
Lero, the Research Ireland Centre for Software, University of Limerick(Lero,爱尔兰科学基金会软件研究中心,利默里克大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));University of Ottawa(渥太华大学)
Large language models can still hallucinate in retrieval-augmented generation (RAG), producing claims that are unsupported by or conflict with the retrieved context. Detecting such errors remains challenging when faithfulness is judged solely against the retrieved context: many existing detectors return holistic answer-level scores, while others target open-domain factuality or fail to provide evidence-grounded diagnostics.
We present RT4CHART, a retromorphic testing framework for context-faithfulness assessment. RT4CHART decomposes an answer into independently verifiable claims, performs hierarchical local-to-global verification against the retrieved context, and assigns each claim one of three labels: entailed, contradicted, or baseless. It further maps these claim-level decisions back to specific answer spans and returns explicit context-side evidence, enabling fine-grained auditing rather than opaque scoring.
We evaluate RT4CHART on RAGTruth++ (408 samples) and our re-annotated RAGTruth-Enhance (2,675 samples). RT4CHART achieves the best answer-level hallucination-detection F1 score among the evaluated baselines. On RAGTruth++, it attains a precision of 0.845, a recall of 0.718, and an F1 score of 0.776, representing an 83% relative improvement over the strongest baseline. It also achieves a span-level F1 score of 47.5% on RAGTruth-Enhance.
Ablation studies show that claim-based local processing drives most of the observed improvement, while global verification provides selective benefits across datasets. Finally, our re-annotation identifies 1.68X more hallucination cases than the original labels, suggesting that commonly used benchmarks substantially underestimate the prevalence of hallucination.
Probabilistic distances-based hallucination detection in LLMs with RAG
Markov Lab, Department of Mathematics(马尔可夫实验室,数学系);Computer Science, Saint-Petersburg University(计算机科学,圣彼得堡大学);AI Center, Skoltech(人工智能中心,斯克里普丘克技术学院);SB AI Lab(SB人工智能实验室);AI Center, Skoltech, Risk department, Sber(人工智能中心,斯克里普丘克技术学院,风险部门)
FACTOID: FACtual enTailment fOr hallucInation Detection
AI Institute, University of South Carolina(南卡罗来纳大学AI学院);Islamic University of Technology(伊斯兰技术大学);National Institute of Technology, Silchar(锡尔卡尔国家理工学院);Indira Gandhi Delhi Technical University for Women(英迪拉·甘地德里女子技术大学);Stanford University(斯坦福大学);Amazon AI(亚马逊人工智能)
Mitigating Hallucination in Large Language Models: A Capability-Oriented Survey on RAG, Reasoning, and Agentic Systems
Electronic Information School, Wuhan University(武汉大学电子信息学院);School of Computing, Dublin City University(都柏林城市大学计算机学院);School of Public Health, Wuhan University(武汉大学公共卫生学院);Insight Centre for Data Analytics, University of Galway(Galway大学数据分析研究中心);Insight Centre for Data Analytics, Dublin City University(都柏林城市大学数据分析研究中心)
Stable-RAG: Mitigating Retrieval-Permutation-Induced Hallucinations in Retrieval-Augmented Generation
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(北京未来区块链与隐私计算先进创新中心);School of Artificial Intelligence, Beihang University(北航人工智能学院);Beijing Academy of Blockchain and Edge Computing(北京区块链与边缘计算研究院);Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所)
LRP4RAG: Detecting Hallucinations in Retrieval-Augmented Generation via Layer-wise Relevance Propagation
Alibaba Cloud(阿里云);School of Computer Sciences, Universiti Sains Malaysia(计算机科学学院,马来西亚国立大学);Department of Service Science and Operations Management, School of Management, Zhejiang University(服务科学与运营管理系,浙江大学);State Key Laboratory for Novel Software Technology, Nanjing University(新型软件技术国家重点实验室,南京大学)
ReDeEP: Detecting Hallucination in Retrieval-Augmented Generation via Mechanistic Interpretability
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院);Kuaishou Technology Co., Ltd.(快手科技有限公司);School of Information Technology and Management, University of International Business and Economics(对外经济贸易大学信息学院)
Facet-Level Tracing of Evidence Uncertainty and Hallucination in RAG
Johannes Kepler University Linz(约翰内斯·开普勒大学林茨);Linz Institute of Technology(林茨技术学院);Institute of Computational Perception(计算感知研究所);Artificial Intelligence Lab(人工智能实验室)
RAG-KG-IL: A Multi-Agent Hybrid Framework for Reducing Hallucinations and Enhancing LLM Reasoning through RAG and Incremental Knowledge Graph Learning Integration
FACTUM: Mechanistic Detection of Citation Hallucination in Long-Form RAG
University of Amsterdam(阿姆斯特丹大学);Department of Defense(美国国防部);HLTCOE, Johns Hopkins University(约翰霍普金斯大学HLTCOE);Applied Physics Laboratory, Johns Hopkins University(约翰霍普金斯大学应用物理实验室)
DRAG: Distilling RAG for SLMs from LLMs to Transfer Knowledge and Mitigate Hallucination via Evidence and Graph-based Distillation
VILA Lab(VILA实验室);Mohamed bin Zayed University of AI(莫扎伊德·本·泽德人工智能大学);McGill University(麦吉尔大学);National University of Science and Technology(国家科学与技术大学)
Bridging External and Parametric Knowledge: Mitigating Hallucination of LLMs with Shared-Private Semantic Synergy in Dual-Stream Knowledge
Beijing Institute of Technology, China(北京理工大学);Beijing University of Posts and Telecommunications, China(北京邮电大学);Meituan, China(美团);The Open University, UK(开放大学)