Large vision language models (LVLMs) often suffer from object hallucination, producing objects not present in the given images. While current benchmarks for object hallucination primarily concentrate on the presence of a single object class rather than individual entities, this work systematically investigates multi-object hallucination, examining how models misperceive (e.g., invent nonexistent objects or become distracted) when tasked with focusing on multiple objects simultaneously. We introduce Recognition-based Object Probing Evaluation (ROPE), an automated evaluation protocol that considers the distribution of object classes within a single image during testing and uses visual referring prompts to eliminate ambiguity. With comprehensive empirical studies and analysis of potential factors leading to multi-object hallucination, we found that (1). LVLMs suffer more hallucinations when focusing on multiple objects compared to a single object. (2). The tested object class distribution affects hallucination behaviors, indicating that LVLMs may follow shortcuts and spurious correlations. (3). Hallucinatory behaviors are influenced by data-specific factors, salience and frequency, and model intrinsic behaviors. We hope to enable LVLMs to recognize and reason about multiple objects that often occur in realistic visual scenes, provide insights, and quantify our progress towards mitigating the issues.
MedHallTune: An Instruction-Tuning Benchmark for Mitigating Medical Hallucination in Vision-Language Models
The Chinese University of Hong Kong(香港中文大学);Institute of Medical Intelligence and XR, The Chinese University of Hong Kong(香港中文大学医学智能与XR研究所);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室)
Evaluation and Analysis of Hallucination in Large Vision-Language Models
Beijing Jiaotong University(北京交通大学);Xi’an Jiaotong University(西安交通大学);DAMO Academy, Alibaba Group(阿里巴巴集团达摩院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Shandong University(山东大学)
DHCP: Detecting Hallucinations by Cross-modal Attention Pattern in Large Vision-Language Models
Tsinghua University, Tencent(清华大学、腾讯);Tencent(腾讯);Tencent, University of Macau(腾讯、澳门大学);University of Science and Technology Beijing(北京科技大学);Tsinghua University(清华大学)
Mitigating Multilingual Hallucination in Large Vision-Language Models
School of Computer Science & Technology, Huazhong University of Science and Technology(华中科技大学计算机科学与技术学院);School of Computing Science and Technology, Fudan University(复旦大学计算机科学技术学院);Wangxuan Institute of Computer Technology, Peking University(北京大学王选计算机研究所);School of Computing Science and Technology, Zhejiang Gongshang University(浙江工商大学计算机科学与技术学院);Department of Computer Science and Engineering, The Chinese University of Hong Kong(香港中文大学计算机科学与工程学系)
Mitigating Entangled Steering in Large Vision-Language Models for Hallucination Reduction
Ministry of Education Key Laboratory of Intelligent Networks and Network Security(教育部智能网络与网络安全重点实验室);Centre for Frontier AI Research, Institute of High Performance Computing, Agency for Science, Technology and Research(前沿人工智能研究中心,高性能计算研究所,科技研究局)
Mitigating Object Hallucinations in Large Vision-Language Models with Assembly of Global and Local Attention
Xi’an Jiaotong University(西安交通大学);National Engineering Laboratory for Big Data Analytics(国家大数据分析工程实验室);Nanyang Technological University(南洋理工大学);Lenovo Research(联想研究院);University of Massachusetts Boston(马萨诸塞大学波士顿分校);Zhejiang University of Technology(浙江工业大学)
Prescribing the Right Remedy: Mitigating Hallucinations in Large Vision-Language Models via Targeted Instruction Tuning
Beijing Key Lab of Traffic Data Analysis and Mining(北京交通大数据分析与挖掘重点实验室);Beijing Jiaotong University(北京交通大学);School of Information Technology and Management(信息科学技术学院)
TruthPrInt: Mitigating Large Vision-Language Models Object Hallucination Via Latent Truthful-Guided Pre-Intervention
Drexel University(德雷塞尔大学);University of Electronic Science and Technology of China(电子科技大学);Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));LLNL(劳伦斯利弗莫尔国家实验室);Lehigh University(莱斯大学)
Mixture of Decoding: An Attention-Inspired Adaptive Decoding Strategy to Mitigate Hallucinations in Large Vision-Language Models
New Laboratory of Pattern Recognition (NLPR), Institute of Automation, Chinese Academy of Sciences (CASIA)(模式识别新技术实验室,自动化研究所,中国科学院);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Kuaishou Technology(快手科技);Nanjing University(南京大学)
本文提出 Mixture of Decoding(MoD),通过比较原始与被注意图像 token 的输出一致性,自适应采用互补或对比解码策略,从而在多个基准上有效缓解 LVLMs 幻觉。
Cracking the Code of Hallucination in LVLMs with Vision-aware Head Divergence
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);National University of Singapore(新加坡国立大学);Southeast University(东南大学);Wuhan AI Research(武汉人工智能研究所)
SeeMe: Mitigating Hallucinations in Large Vision-Language Models through Effective Visual Token Engineering
State Key Laboratory of Multimedia Information Processing, School of Computer Science, Peking University(北京大学计算机科学学院多媒体信息处理国家重点实验室);University of Pennsylvania(宾夕法尼亚大学);University of Electronic Science and Technology of China(电子科技大学);Nanyang Technological University(南洋理工大学);Tsinghua University(清华大学);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));De Artificial Intelligence Lab(德人工智能实验室)
HalluShift++: Bridging Language and Vision through Internal Representation Shifts for Hierarchical Hallucinations in MLLMs
Netaji Subhash Engineering College (NSEC)(奈尔贾伊·萨布哈工程学院);TCG Crest;Electronics and Communication Sciences Unit (ECSU)(电子与通信科学单位);Indian Statistical Institute(印度统计研究所)
Mitigating Hallucinations in Large Vision-Language Models by Self-Injecting Hallucinations
Beijing Key Laboratory of Super Intelligent Security of Multi-Modal Information, CASIA(北京多模态信息超级智能安全重点实验室,中国科学院自动化所);State Key Laboratory of Multimodal Artificial Intelligence Systems, CASIA(多模态人工智能系统国家重点实验室,中国科学院自动化所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Hello Group(Hello集团);Nanchang Hangkong University(南昌航空大学);The University of Hong Kong(香港大学);School of Information Science and Technology, ShanghaiTech University(上海科技大学信息科学与技术学院)