Although Large Vision-Language Models (LVLMs) have demonstrated powerful capabilities in interpreting visual information, they frequently produce content that deviates from visual information, leading to object hallucination. To tackle this, recent works mostly depend on expensive manual annotations and training cost, or significantly increase inference time. In this work, we observe that LVLMs' attention to visual information is significantly stronger when answering caption queries compared to non-caption queries. Inspired by this phenomenon, we propose Caption-sensitive Attention Intervention (CAI), a training-free, plug-and-play hallucination mitigation method that leverages the attention activation pattern in response to caption queries to enhance LVLMs' visual perception capability. Extensive experimental results across four benchmarks covering both discriminative and generative tasks, demonstrate that CAI achieves state-of-the-art (SOTA) hallucination mitigating performance only with minimal additional inference cost.
Explaining an image with missing or non-existent objects is known as object bias (hallucination) in image captioning. This behaviour is quite common in the state-of-the-art captioning models which is not desirable by humans. To decrease the object hallucination in captioning, we propose three simple yet efficient training augmentation method for sentences which requires no new training data or increase in the model size. By extensive analysis, we show that the proposed methods can significantly diminish our models' object bias on hallucination metrics. Moreover, we experimentally demonstrate t…
With the advent of rich visual representations and pre-trained language models, video captioning has seen continuous improvement over time. Despite the performance improvement, video captioning models are prone to hallucination. Hallucination refers to the generation of highly pathological descriptions that are detached from the source material. In video captioning, there are two kinds of hallucination: object and action hallucination. Instead of endeavoring to learn better representations of a video, in this work, we investigate the fundamental sources of the hallucination problem. We identif…
Despite continuously improving performance, contemporary image captioning models are prone to "hallucinating" objects that are not actually in a scene. One problem is that standard metrics only measure similarity to ground truth captions and may not fully capture image relevance. In this work, we propose a new image relevance metric to evaluate current models with veridical visual labels and assess their rate of object hallucination. We analyze how captioning model architectures and learning objectives contribute to object hallucination, explore when hallucination is likely due to image miscla…
Wangxuan Institute of Computer Technology, Peking University（北京大学王选计算机研究所）；The MOE Key Laboratory of Computational Linguistics, Peking University（北京大学计算语言学教育部重点实验室）
Video captioning aims to describe events in a video with natural language. In recent years, many works have focused on improving captioning models' performance. However, like other text generation tasks, it risks introducing factual errors not supported by the input video. These factual errors can seriously affect the quality of the generated text, sometimes making it completely unusable. Although factual consistency has received much research attention in text-to-text tasks (e.g., summarization), it is less studied in the context of vision-based text generation. In this work, we conduct a det…
Mitigating Image Captioning Hallucinations in Vision-Language Models
Department of Computer Science, The University of Alabama at Birmingham（亚拉巴马大学伯明翰分校计算机科学系）；Department of Computer Science, University of Waterloo（滑铁卢大学计算机科学系）
Toward Robust Hyper-Detailed Image Captioning: A Multiagent Approach and Dual Evaluation Metrics for Factuality and Coverage
Department of Electrical and Computer Engineering, Seoul National University（电气与计算机工程系，首尔国立大学）；Interdisciplinary Program in Artificial Intelligence, Seoul National University（人工智能交叉学科项目，首尔国立大学）；Adobe Research（Adobe研究）
Generating Accurate and Detailed Captions for High-Resolution Images
Department of Artificial Intelligence, University of Seoul（首尔大学人工智能系）；Department of Computer Science and Engineering, POSTECH（POSTECH计算机科学与工程系）；Department of Applied Statistics, Yonsei University（延世大学应用统计系）
Tracing and Mitigating Hallucinations in Multimodal LLMs via Dynamic Attention Localization
MBZUAI；Provable Responsible AI and Data Analytics (PRADA) Lab（可证明负责任的人工智能与数据分析实验室）；King Abdullah University of Science and Technology（卡迪夫大学科学与技术大学）；School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences（中国科学院大学先进交叉科学学院）；University of Copenhagen（哥本哈根大学）；Tsinghua University（清华大学）
The contemporary visual captioning models frequently hallucinate objects that are not actually in a scene, due to the visual misclassification or over-reliance on priors that resulting in the semantic inconsistency between the visual information and the target lexical words. The most common way is to encourage the captioning model to dynamically link generated object words or phrases to appropriate regions of the image, i.e., the grounded image captioning (GIC). However, GIC utilizes an auxiliary task (grounding objects) that has not solved the key issue of object hallucination, i.e., the sema…
VOPE: Revisiting Hallucination of Vision-Language Models in Voluntary Imagination Task
Key Laboratory of AI Safety of CAS, Institute of Computing Technology, Chinese Academy of Sciences (CAS)（中国科学院人工智能安全重点实验室，计算技术研究所，中国科学院）；University of Chinese Academy of Sciences（中国科学院大学）；Zhongguancun Academy（中关村学院）
Beyond Single Models: Mitigating Multimodal Hallucinations via Adaptive Token Ensemble Decoding
Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学 Gallup 学院）；Department of Electrical and Computer Engineering, McGill University（麦吉尔大学电气与计算机工程系）；School of Statistics, Renmin University of China（中国人民大学统计学院）；Tencent Jarvis Lab（腾讯 Jarvis 实验室）；Medical Artificial Intelligence Lab, Westlake University（西湖大学医学人工智能实验室）
SAVER: Mitigating Hallucinations in Large Vision-Language Models via Style-Aware Visual Early Revision
ROSE Lab, Interdisciplinary Graduate Programme, Nanyang Technological University, Singapore（南洋理工大学罗思实验室，跨学科研究生项目，新加坡）；ROSE Lab, School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore（南洋理工大学罗思实验室，电子与电气工程学院，新加坡）；City University of Hong Kong, Hong Kong SAR（香港城市大学，香港特别行政区）；Shanghai Jiao Tong University, China（上海交通大学，中国）；Singapore University of Technology and Design, Singapore（新加坡科技设计大学，新加坡）；VinUniversity, Hanoi, Vietnam（越南文大学，河内，越南）
