Despite their success, large language models (LLMs) face the critical challenge of hallucinations, generating plausible but incorrect content. While much research has focused on hallucinations in multiple modalities including images and natural language text, less attention has been given to hallucinations in source code, which leads to incorrect and vulnerable code that causes significant financial loss. To pave the way for research in LLMs' hallucinations in code, we introduce Collu-Bench, a benchmark for predicting code hallucinations of LLMs across code generation (CG) and automated program repair (APR) tasks. Collu-Bench includes 13,234 code hallucination instances collected from five datasets and 11 diverse LLMs, ranging from open-source models to commercial ones. To better understand and predict code hallucinations, Collu-Bench provides detailed features such as the per-step log probabilities of LLMs' output, token types, and the execution feedback of LLMs' generated code for in-depth analysis. In addition, we conduct experiments to predict hallucination on Collu-Bench, using both traditional machine learning techniques and neural networks, which achieves 22.03 -- 33.15% accuracy. Our experiments draw insightful findings of code hallucination patterns, reveal the challenge of accurately localizing LLMs' hallucinations, and highlight the need for more sophisticated techniques.
Can Humans Dream of Electric Sheep? Human-Written Samples for Fine-Grained Vision-and-Language Hallucination Benchmarking
University of Helsinki(赫尔辛基大学);Politecnico di Torino(都灵理工大学);Universiteit Utrecht(乌得勒支大学);Université Bretagne Sud(南布列塔尼大学);University of Copenhagen(哥本哈根大学);University Grenoble Alpes(格勒诺布尔阿尔卑斯大学);University of Lorraine(洛林大学)
OpenHalDet: A Unified Benchmark for Hallucination Detection across Diverse Generation Scenarios
University of Technology Sydney(新南威尔士大学);University of Wisconsin–Madison(威斯康星大学麦迪逊分校);University of Bristol(布里斯托大学);The University of Queensland(昆士兰大学);Nanyang Technological University(南洋理工大学)
ChartInsighter: An Approach for Mitigating Hallucination in Time-series Chart Summary Generation with A Benchmark Dataset
Henan Institute of Advanced Technology, Zhengzhou University(郑州大学河南先进技术研究院);Zhengzhou Zhongke Institute of Integrated Circuit and System Application(郑州中科集成电路与系统应用研究院);Fudan University(复旦大学);School of Computer Science, Fudan University(复旦大学计算机科学技术学院)
College of Computer Science and Technology, Zhejiang University(浙江大学计算机科学与技术学院);ZJU-Ant Group Joint Research Center for Knowledge Graphs, Zhejiang University(浙江大学-蚂蚁集团知识图谱联合研究中心);School of Software Technology, Zhejiang University(浙江大学软件学院);Alibaba Group(阿里巴巴集团)
ViBe: A Text-to-Video Benchmark for Evaluating Hallucination in Large Multimodal Models
AI Institute, University of South Carolina(南卡罗来纳大学AI研究所);Guru Gobind Singh Indraprastha University(古鲁·戈宾德·辛格·因德拉普拉斯塔大学);Vellore Institute of Technology(韦洛尔理工大学);Indian Institute of Technology (BHU)(印度理工学院(瓦拉纳西印度大学));University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);University of California Santa Cruz(加州大学圣克鲁兹分校);Amazon Web Services(亚马逊网络服务);Meta;Amazon GenAI(亚马逊生成式人工智能部门)
CodeHalu: Investigating Code Hallucinations in LLMs via Execution-based Verification
Hong Kong Baptist University(香港浸会大学);UC Santa Barbara(加州大学圣巴巴拉分校);UC Berkeley(加州大学伯克利分校);Alibaba Group(阿里巴巴集团);The University of Tokyo(东京大学);University of Alberta(阿尔伯塔大学)
A Systematic Literature Review of Code Hallucinations in LLMs: Characterization, Mitigation Methods, Challenges, and Future Directions for Reliable AI
Harbin Institute of Technology(哈尔滨工业大学);Shandong Agriculture and Engineering University(山东农业工程学院);Monash University Malaysia(马来西亚马来亚大学);Tianjin University(天津大学);Chongqing University(重庆大学);Singapore Management University(新加坡管理大学);Sun Yat-sen University(中山大学)