Hallucination detection methods for large language models increasingly operate on chain-of-thought reasoning traces, yet it remains unclear whether they evaluate the reasoning itself or merely exploit surface correlates of the final answer. We introduce a controlled-invariance methodology that exposes this distinction through two oracle tests: \textsc{Force}, which replaces each response's final answer with the ground truth while preserving the reasoning trace, and \textsc{Remove}, which strips answer-announcement steps while leaving the trajectory intact. This reveals if their predictive power derives from answer-level artifacts rather than from the structure or validity of intermediate reasoning. We further show that once these artifacts are controlled for, effective detection does not necessarily require complex learned representations: TRACT, a lightweight scorer built on lexical trajectory features (hedging trends, step-length dynamics, and cross-response vocabulary convergence), achieves strong robustness while remaining competitive with or outperforming existing baselines on unperturbed traces. These findings suggest that the current central challenge in reasoning-aware hallucination detection is not the absence of signal in the trace, but the failure to isolate it from endpoint cues.
Are LLM Evaluators Really Narcissists? Sanity Checking Self-Preference Evaluations
Department of Machine Learning, Carnegie Mellon University, Pittsburgh, PA, USA(卡内基梅隆大学机器学习系);Department of Computer Science and Engineering, University of California San Diego, La Jolla, CA, USA(加州大学圣地亚哥分校计算机科学与工程系);Department of Computer Science, University of Virginia, Charlottesville, VA, USA(弗吉尼亚大学计算机科学系);Martian Research, San Francisco, California, USA(火星研究公司);Apart Research, San Francisco, California, USA(Apart研究公司)
Hallucination to Truth: A Review of Fact-Checking and Factuality Evaluation in Large Language Models
Department of Computer Science and Engineering, United International University, Dhaka 1212, Bangladesh(乌姆特国际大学计算机科学与工程系);Department of Computer Science and Engineering, Daffodil International University, Dhaka-1341, Bangladesh(达芙尼国际大学计算机科学与工程系);Faculty of Science and Technology, Charles Darwin University, Casuarina, NT 0909, Australia(查尔斯·达尔文大学科学与技术学院)
Mitigating hallucinations in healthcare LLMs with granular fact-checking and domain-specific adaptation
Applied Artificial Intelligence and Intelligent Systems (AAIINS) Laboratory(应用人工智能与智能系统实验室);Department of Computer Science and Engineering(计算机科学与工程系);Department of Data Science and Artificial Intelligence(数据科学与人工智能系);Department of Software Engineering(软件工程系);Faculty of Science and Information Technology(科学与信息技术学院);Faculty of Science and Technology(科学与技术学院)
Improving Reliability and Explainability of Medical Question Answering through Atomic Fact Checking in Retrieval-Augmented LLMs
Technical University of Munich(慕尼黑工业大学);TUM University Hospital Rechts der Isar(慕尼黑工业大学 Rechts der Isar 大学医院);German Heart Center Munich(慕尼黑德国心脏中心);Helmholtz Zentrum München(慕尼黑亥姆霍兹中心);German Consortium for Translational Cancer Research(德国转化癌症研究联盟)
Zero-resource Hallucination Detection for Text Generation via Graph-based Contextual Knowledge Triples Modeling
College of Computer, National University of Defense Technology(国防科技大学计算机学院);College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院)
Is Imagination Derived from Hallucination? A Cross-Taxonomy Evaluation of Imagination and Hallucination in Large Language Models
City University of Hong Kong(香港城市大学);Northwestern Polytechnical University(西北工业大学);The Hong Kong University of Science and Technology(香港科技大学);The Hong Kong Polytechnic University(香港理工大学)
MedObvious: Exposing the Medical Moravec's Paradox in VLMs via Clinical Triage
Mohamed bin Zayed University of Artificial Intelligence, UAE(马尔代夫布扎伊德人工智能大学,阿联酋);National Institute of Technology, Silchar(西尔CHAR国家理工学院);Birmingham City University, UK(伯明翰城市大学,英国)
Mitigating Behavioral Hallucination in Multimodal Large Language Models for Sequential Images
Provable Responsible AI and Data Analytics (PRADA) Lab(可证明负责任的人工智能与数据分析实验室);King Abdullah University of Science and Technology(国王阿卜杜勒阿齐兹大学);University of Electronic Science and Technology of China(中国电子科学技术大学);University of Copenhagen(哥本哈根大学)
RSHallu: Dual-Mode Hallucination Evaluation for Remote-Sensing Multimodal Large Language Models with Domain-Tailored Mitigation
College of Computer Science, Chongqing University(重庆大学计算机科学学院);Heavy Rainfall Research Center of China(中国强降水研究中心);CMA Key Open Laboratory of Transforming Climate Resources to Economy, Chongqing Institute of Meteorological Sciences(中国气象局气候资源转化经济重点开放实验室、重庆气象科学研究院);Chongqing Metropolitan College of Science(重庆科学理工学院);School of Intelligence Science(智能科学学院);College of Artificial Intelligence, Harbin Institute of Technology(人工智能学院、哈尔滨工业大学);BNU-UIC Institute of Artificial Intelligence(北京师范大学-国际学院人工智能与未来网络研究院);Future Networks, Beijing Normal University at Zhuhai(未来网络、北京师范大学珠海分校)
AI Hallucination from Students' Perspective: A Thematic Analysis
Department of Computer and Information Engineering, Center for Cyber Physical Systems, Khalifa University(计算机与信息工程系,跨物理系统中心,哈利法大学);Department of Psychology, University Malaysia Sabah(心理学系,马来西亚Sabah大学)
AutoHall: Automated Factuality Hallucination Dataset Generation for Large Language Models
AGI Institute, School of Computer Science, Shanghai Jiao Tong University(AGI研究院,计算机科学学院,上海交通大学);Shanghai Key Laboratory of Trusted Data Circulation and Governance in Web3(上海可信数据流通与治理Web3重点实验室);School of Media & Communication, Shanghai Jiao Tong University(媒体与传播学院,上海交通大学)
Towards Detecting LLMs Hallucination via Markov Chain-based Multi-agent Debate Framework
Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);Gaoling School of Artifical Intelligence, Renmin University of China(中国人民大学高瓴人工智能学院)
AURORA: Asymmetry and Update-Induced Rotation for Robust Hallucination Detection in Large Language Models
School of Artificial Intelligence, Beihang University, China(北京航空航天大学人工智能学院);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing, Beihang University, China(北京航空航天大学未来区块链与隐私计算先进创新中心)