视觉大模型 / VLM - arXivDaily 专题

2410.01620 2025-02-06 cs.CV 79%

LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models

Zhenyue Qin, Yu Yin, Dylan Campbell, Xuansheng Wu, Ke Zou, Yih-Chung Tham, Ninghao Liu, Xiuzhen Zhang, Qingyu Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments 2025 NAACL: Annual Conference of the Nations of the Americas Chapter of the Association for Computational Linguistics Project Page: https://kfzyqin.github.io/lmod/

2502.01056 2025-02-04 cs.CV cs.CL 79%

Mitigating Hallucinations in Large Vision-Language Models with Internal Fact-based Contrastive Decoding

Chao Wang, Xuancheng Zhou, Weiwei Fu, Yang Zhou

专题命中幻觉与鲁棒性：vision-language model(title)；visual language model(abstract)；分类 cs.CV

2410.01438 2025-02-04 cs.LG 79%

The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models?

Ching-Chia Kao, Chia-Mu Yu, Chun-Shien Lu, Chu-Song Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.LG

2410.03189 2025-01-23 cs.CV 79%

Generalizable Prompt Tuning for Vision-Language Models

Qian Zhang

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments in progress

2311.05608 2025-01-22 cs.CR cs.AI cs.CL 79%

FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts

Yichen Gong, Delong Ran, Jinyuan Liu, Conglei Wang, Tianshuo Cong, Anyu Wang, Sisi Duan, Xiaoyun Wang

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.AI

Comments AAAI 2025 (Oral)

2501.03729 2025-01-08 cs.CV 79%

Realistic Test-Time Adaptation of Vision-Language Models

Maxime Zanella, Clément Fuchs, Christophe De Vleeschouwer, Ismail Ben Ayed

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2412.15739 2024-12-23 cs.CV 79%

VORD: Visual Ordinal Calibration for Mitigating Object Hallucinations in Large Vision-Language Models

Dexter Neo, Tsuhan Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2406.18844 2024-12-17 cs.CV 79%

Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shift

Siyuan Liang, Jiawei Liang, Tianyu Pang, Chao Du, Aishan Liu, Mingli Zhu, Xiaochun Cao, Dacheng Tao

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments 11 pages, 9 figures

2412.07077 2024-12-11 cs.CV 79%

Retaining and Enhancing Pre-trained Knowledge in Vision-Language Models with Prompt Ensembling

Donggeun Kim, Yujin Jo, Myungjoo Lee, Taesup Kim

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments IEEE/CVF Winter Conference on Applications of Computer Vision (WACV) 2025

2411.11919 2024-12-03 cs.CV 79%

VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation

Ruiyang Zhang, Hu Zhang, Zhedong Zheng

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2411.15720 2024-11-26 cs.CV 79%

Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks

Peng Xie, Yequan Bie, Jianda Mao, Yangqiu Song, Yang Wang, Hao Chen, Kani Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2411.15268 2024-11-26 cs.CV cs.CL 79%

ICT: Image-Object Cross-Level Trusted Intervention for Mitigating Object Hallucination in Large Vision-Language Models

Junzhe Chen, Tianshu Zhang, Shiyu Huang, Yuwei Niu, Linfeng Zhang, Lijie Wen, Xuming Hu

专题命中幻觉与鲁棒性：vision-language model(title)；vision language model(abstract)；分类 cs.CV

2404.03027 2024-11-26 cs.CR cs.AI cs.CL 79%

JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks

Weidi Luo, Siyuan Ma, Xiaogeng Liu, Xiaoyu Guo, Chaowei Xiao

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.AI

2411.13136 2024-11-21 cs.CV 79%

TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models

Xin Wang, Kai Chen, Jiaming Zhang, Jingjing Chen, Xingjun Ma

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2408.05767 2024-11-20 cs.CL cs.AI 79%

Reference-free Hallucination Detection for Large Vision-Language Models

Qing Li, Jiahui Geng, Chenyang Lyu, Derui Zhu, Maxim Panov, Fakhri Karray

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.AI

2410.07571 2024-11-18 cs.CL cs.CV 79%

How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?

Seongyun Lee, Geewook Kim, Jiyeon Kim, Hyunji Lee, Hoyeon Chang, Sue Hyun Park, Minjoon Seo

专题命中幻觉与鲁棒性：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments Work in Progress

2404.19287 2024-11-13 cs.CV 79%

Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspective

Wanqi Zhou, Shuanghao Bai, Danilo P. Mandic, Qibin Zhao, Badong Chen

专题命中幻觉与鲁棒性：vision language model(title)；vision-language model(abstract)；分类 cs.CV

Comments 17 pages, 13 figures

2406.10839 2024-11-13 cs.CV cs.CL 79%

Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags

Daiqing Qi, Handong Zhao, Zijun Wei, Sheng Li

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.CV

Comments Main Conference at EMNLP 2024

2411.06921 2024-11-12 cs.CV 79%

UMFC: Unsupervised Multi-Domain Feature Calibration for Vision-Language Models

Jiachen Liang, Ruibing Hou, Minyang Hu, Hong Chang, Shiguang Shan, Xilin Chen

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments NeurIPS 2024

2402.15721 2024-11-11 cs.AI cs.CL 79%

Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models

Chaoya Jiang, Hongrui Jia, Wei Ye, Mengfan Dong, Haiyang Xu, Ming Yan, Ji Zhang, Shikun Zhang

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.AI

Comments Accepted by ACM MM 2024

2411.02733 2024-11-06 cs.CV 79%

DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark

Haodong Li, Haicheng Qu, Xiaofeng Zhang

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.CV

2410.22187 2024-10-30 cs.CV 79%

Active Learning for Vision-Language Models

Bardia Safaei, Vishal M. Patel

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted in WACV 2025

2410.15359 2024-10-22 cs.AI 79%

A Survey of Hallucination in Large Visual Language Models

Wei Lan, Wenyi Chen, Qingfeng Chen, Shirui Pan, Huiyu Zhou, Yi Pan

专题命中幻觉与鲁棒性：visual language model(title,abstract)；分类 cs.AI

2407.08374 2024-10-17 cs.CV 79%

Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Self-Regularization

Jinlong Li, Dong Zhao, Zequn Jie, Elisa Ricci, Lin Ma, Nicu Sebe

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

2410.08895 2024-10-14 cs.CV 79%

Calibrated Cache Model for Few-Shot Vision-Language Model Adaptation

Kun Ding, Qiang Yu, Haojian Zhang, Gaofeng Meng, Shiming Xiang

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments submitted to IJCV

2404.13874 2024-10-07 cs.CL cs.CV 79%

VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models

Haoyi Qiu, Wenbo Hu, Zi-Yi Dou, Nanyun Peng

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments ACL 2024 Findings

2403.10492 2024-10-07 cs.CV 79%

Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning

Dongmin Park, Zhaofang Qian, Guangxing Han, Ser-Nam Lim

专题命中幻觉与鲁棒性：vision language model(title,abstract)；分类 cs.CV

2402.09801 2024-09-24 cs.CL cs.CV 79%

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

Shangyu Xing, Fei Zhao, Zhen Wu, Tuo An, Weihao Chen, Chunhui Li, Jianbing Zhang, Xinyu Dai

专题命中幻觉与鲁棒性：multimodal large language model(title,abstract)；分类 cs.CV

2409.14083 2024-09-24 cs.CV 79%

SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information

Jiashuo Sun, Jihai Zhang, Yucheng Zhou, Zhaochen Su, Xiaoye Qu, Yu Cheng

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

Comments 19 pages, 9 tables, 11 figures

2403.08542 2024-09-04 cs.CV 79%

AIGCs Confuse AI Too: Investigating and Explaining Synthetic Image-induced Hallucinations in Large Vision-Language Models

Yifei Gao, Jiaqi Wang, Zhiyu Lin, Jitao Sang

专题命中幻觉与鲁棒性：vision-language model(title,abstract)；分类 cs.CV

1. 幻觉与鲁棒性 2260 篇

LMOD: A Large Multimodal Ophthalmology Dataset and Benchmark for Large Vision-Language Models

Mitigating Hallucinations in Large Vision-Language Models with Internal Fact-based Contrastive Decoding

The Great Contradiction Showdown: How Jailbreak and Stealth Wrestle in Vision-Language Models?

Generalizable Prompt Tuning for Vision-Language Models

FigStep: Jailbreaking Large Vision-Language Models via Typographic Visual Prompts

Realistic Test-Time Adaptation of Vision-Language Models

VORD: Visual Ordinal Calibration for Mitigating Object Hallucinations in Large Vision-Language Models

Revisiting Backdoor Attacks against Large Vision-Language Models from Domain Shift

Retaining and Enhancing Pre-trained Knowledge in Vision-Language Models with Prompt Ensembling

VL-Uncertainty: Detecting Hallucination in Large Vision-Language Model via Uncertainty Estimation

Chain of Attack: On the Robustness of Vision-Language Models Against Transfer-Based Adversarial Attacks

ICT: Image-Object Cross-Level Trusted Intervention for Mitigating Object Hallucination in Large Vision-Language Models

JailBreakV: A Benchmark for Assessing the Robustness of MultiModal Large Language Models against Jailbreak Attacks

TAPT: Test-Time Adversarial Prompt Tuning for Robust Inference in Vision-Language Models

Reference-free Hallucination Detection for Large Vision-Language Models

How Does Vision-Language Adaptation Impact the Safety of Vision Language Models?

Revisiting the Adversarial Robustness of Vision Language Models: a Multimodal Perspective

Reminding Multimodal Large Language Models of Object-aware Knowledge with Retrieved Tags

UMFC: Unsupervised Multi-Domain Feature Calibration for Vision-Language Models

Hal-Eval: A Universal and Fine-grained Hallucination Evaluation Framework for Large Vision Language Models

DDFAV: Remote Sensing Large Vision Language Models Dataset and Evaluation Benchmark

Active Learning for Vision-Language Models

A Survey of Hallucination in Large Visual Language Models

Enhancing Robustness of Vision-Language Models through Orthogonality Learning and Self-Regularization

Calibrated Cache Model for Few-Shot Vision-Language Model Adaptation

VALOR-EVAL: Holistic Coverage and Faithfulness Evaluation of Large Vision-Language Models

Mitigating Dialogue Hallucination for Large Vision Language Models via Adversarial Instruction Tuning

EFUF: Efficient Fine-grained Unlearning Framework for Mitigating Hallucinations in Multimodal Large Language Models

SURf: Teaching Large Vision-Language Models to Selectively Utilize Retrieved Information

AIGCs Confuse AI Too: Investigating and Explaining Synthetic Image-induced Hallucinations in Large Vision-Language Models