Large Language Models (LLMs) are prone to hallucinations, e.g., factually incorrect information, in their responses. These hallucinations present challenges for LLM-based applications that demand high factual accuracy. Existing hallucination detection methods primarily depend on external resources, which can suffer from issues such as low availability, incomplete coverage, privacy concerns, high latency, low reliability, and poor scalability. There are also methods depending on output probabilities, which are often inaccessible for closed-source LLMs like GPT models. This paper presents MetaQA, a self-contained hallucination detection approach that leverages metamorphic relation and prompt mutation. Unlike existing methods, MetaQA operates without any external resources and is compatible with both open-source and closed-source LLMs. MetaQA is based on the hypothesis that if an LLM's response is a hallucination, the designed metamorphic relations will be violated. We compare MetaQA with the state-of-the-art zero-resource hallucination detection method, SelfCheckGPT, across multiple datasets, and on two open-source and two closed-source LLMs. Our results reveal that MetaQA outperforms SelfCheckGPT in terms of precision, recall, and f1 score. For the four LLMs we study, MetaQA outperforms SelfCheckGPT with a superiority margin ranging from 0.041 - 0.113 (for precision), 0.143 - 0.430 (for recall), and 0.154 - 0.368 (for F1-score). For instance, with Mistral-7B, MetaQA achieves an average F1-score of 0.435, compared to SelfCheckGPT's F1-score of 0.205, representing an improvement rate of 112.2%. MetaQA also demonstrates superiority across all different categories of questions.
Detecting LLM Fact-conflicting Hallucinations Enhanced by Temporal-logic-based Reasoning
Huazhong University of Science and Technology(华中科技大学);National University of Singapore(新加坡国立大学);University of New South Wales(新南威尔士大学);Nanyang Technological University(南洋理工大学)
Can LLM be a Good Path Planner based on Prompt Engineering? Mitigating the Hallucination for Path Planning
College of Computer Science(计算机科学学院);Sichuan Normal University(四川师范大学);School of Information and Software Engineering(信息与软件工程学院);University of Electronic Science and Technology of China(电子科技大学)
How to Detect and Defeat Molecular Mirage: A Metric-Driven Benchmark for Hallucination in LLM-based Molecular Comprehension
Shenzhen Graduate School, Peking University(北京大学深圳研究生院);International Digital Economy Academy (IDEA)(国际数字经济学院(IDEA));Pengcheng Laboratory(鹏城实验室);Hong Kong University of Science and Technology(香港科技大学)
Relational Linearity is a Predictor of Hallucinations
Center for Information and Language Processing (CIS), LMU Munich(慕尼黑大学信息与语言处理中心(CIS));Ubiquitous Knowledge Processing Lab (UKP Lab), Technical University of Darmstadt(达姆施塔特工业大学普适知识处理实验室(UKP Lab));Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心(MCML))
Hallucination-Resistant Relation Extraction via Dependency-Aware Sentence Simplification and Two-tiered Hierarchical Refinement
Shanghai Jiao Tong University(上海交通大学);University of California San Diego(加州大学圣地亚哥分校);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);Alibaba Group(阿里巴巴集团)