视觉大模型 / VLM - arXivDaily 专题

2502.13095 2025-02-19 cs.CV cs.CL cs.LG 62%

Understanding and Rectifying Safety Perception Distortion in VLMs

Xiaohan Zou, Jian Kang, George Kesidis, Lu Lin

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

2404.14394 2025-02-13 cs.AI cs.CL cs.CV 62%

A Multimodal Automated Interpretability Agent

Tamar Rott Shaham, Sarah Schwettmann, Franklin Wang, Achyuta Rajaram, Evan Hernandez, Jacob Andreas, Antonio Torralba

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments 25 pages, 13 figures

2402.06529 2025-02-12 cs.AI cs.CL cs.LG 62%

Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity

Kaiqu Liang, Zixu Zhang, Jaime Fernández Fisac

专题命中幻觉与鲁棒性：grounding(abstract)；分类 cs.AI、cs.LG

Comments NeurIPS 2024

2411.18676 2025-02-11 cs.RO cs.AI cs.LG 62%

Embodied Red Teaming for Auditing Robotic Foundation Models

Sathwik Karnik, Zhang-Wei Hong, Nishant Abhangi, Yen-Chen Lin, Tsun-Hsuan Wang, Christophe Dupuy, Rahul Gupta, Pulkit Agrawal

专题命中幻觉与鲁棒性：vision language model(abstract)；分类 cs.AI、cs.LG

2502.04470 2025-02-10 cs.CV cs.AI 62%

Color in Visual-Language Models: CLIP deficiencies

Guillem Arias, Ramon Baldrich, Maria Vanrell

专题命中幻觉与鲁棒性：visual language model(abstract)；分类 cs.CV、cs.AI

Comments 6 pages, 10 figures, conference, Artificial Intelligence

Journal ref in Color and Imaging Conference, 2024, pp 101 - 106

2402.03973 2025-02-04 cs.CV cs.LG 62%

A comparison between humans and AI at recognizing objects in unusual poses

Netta Ollikka, Amro Abbas, Andrea Perin, Markku Kilpeläinen, Stéphane Deny

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments version accepted at TMLR

2412.09718 2025-01-14 cs.CV cs.LG 62%

BayesAdapter: enhanced uncertainty estimation in CLIP few-shot adaptation

Pablo Morales-Álvarez, Stergios Christodoulidis, Maria Vakalopoulou, Pablo Piantanida, Jose Dolz

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments 30 pages, 5 figures, 23 tables

2501.03995 2025-01-08 cs.LG cs.CV cs.IR cs.IT math.IT 62%

RAG-Check: Evaluating Multimodal Retrieval Augmented Generation Performance

Matin Mortaheb, Mohammad A. Amir Khojastepour, Srimat T. Chakradhar, Sennur Ulukus

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

2409.15631 2025-01-07 cs.LG cs.AI 62%

Data Augmentation for Sparse Multidimensional Learning Performance Data Using Generative AI

Liang Zhang, Jionghao Lin, John Sabatini, Conrad Borchers, Daniel Weitekamp, Meng Cao, John Hollander, Xiangen Hu, Arthur C. Graesser

专题命中幻觉与鲁棒性：grounding(abstract)；分类 cs.AI、cs.LG

2304.10727 2024-12-23 cs.CV cs.AI 62%

RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models

Seulki Park, Daeho Um, Hajung Yoon, Sanghyuk Chun, Sangdoo Yun, Jin Young Choi

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to ECCV Synthetic Data for Computer Vision Workshop (Oral)

2412.02803 2024-12-05 cs.CV cs.AI eess.IV 62%

Gaussian Splatting Under Attack: Investigating Adversarial Noise in 3D Objects

Abdurrahman Zeybey, Mehmet Ergezer, Tommy Nguyen

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accepted to Safe Generative AI Workshop @ NeurIPS 2024: https://neurips.cc/virtual/2024/workshop/84705

Journal ref Safe Generative AI Workshop @ NeurIPS 2024

2411.09968 2024-11-18 cs.CV cs.AI 62%

Seeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMs

Xiaofeng Zhang, Yihao Quan, Chaochen Gu, Chen Shen, Xiaosong Yuan, Shaotian Yan, Hao Cheng, Kaijie Wu, Jieping Ye

专题命中幻觉与鲁棒性：multimodal large language model(abstract)；分类 cs.CV、cs.AI

2403.11497 2024-11-05 cs.CV cs.LG stat.ML 62%

A Sober Look at the Robustness of CLIPs to Spurious Features

Qizhou Wang, Yong Lin, Yongqiang Chen, Ludwig Schmidt, Bo Han, Tong Zhang

专题命中幻觉与鲁棒性：vision language model(abstract)；分类 cs.CV、cs.LG

Comments NeurIPS 2024; Qizhou Wang, Yong Lin, and Yongqiang Chen contributed equally; Project page: https://counteranimal.github.io

2403.07241 2024-11-05 cs.CV cs.LG 62%

Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotations

Chenyu You, Yifei Min, Weicheng Dai, Jasjeet S. Sekhon, Lawrence Staib, James S. Duncan

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Accepted by CVPR 2024

2410.22194 2024-10-30 cs.AI cs.CL cs.CV 62%

ADAM: An Embodied Causal Agent in Open-World Environments

Shu Yu, Chaochao Lu

专题命中幻觉与鲁棒性：multimodal large language model(abstract)；分类 cs.CV、cs.AI

2410.20265 2024-10-29 cs.CV cs.CY cs.LG 62%

You Never Know: Quantization Induces Inconsistent Biases in Vision-Language Foundation Models

Eric Slyman, Anirudh Kanneganti, Sanghyun Hong, Stefan Lee

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Workshop paper at NeurIPS 2024 RBFM. 6 pages, 3 figures

2410.09365 2024-10-15 cs.CV cs.LG 62%

Debiasing Vison-Language Models with Text-Only Training

Yunfan Yang, Chaoquan Jiang, Zhiyu Lin, Jinlin Xiao, Jiaming Zhang, Jitao Sang

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

2410.03176 2024-10-07 cs.CV cs.AI 62%

Investigating and Mitigating Object Hallucinations in Pretrained Vision-Language (CLIP) Models

Yufang Liu, Tao Ji, Changzhi Sun, Yuanbin Wu, Aimin Zhou

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments EMNLP 2024

2405.02954 2024-10-04 cs.CV cs.LG 62%

Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training

Wenyu Zhang, Li Shen, Chuan-Sheng Foo

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Extension of ICCV paper arXiv:2212.07585; Published at IJCV

2312.10813 2024-09-12 cs.CV cs.CL cs.LG 62%

Towards Efficient Vision-Language Tuning: More Information Density, More Generalizability

Tianxiang Hao, Mengyao Lyu, Hui Chen, Sicheng Zhao, Xiaohan Ding, Jungong Han, Guiguang Ding

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

2409.02882 2024-09-05 cs.CV cs.LG 62%

Benchmarking Spurious Bias in Few-Shot Image Classifiers

Guangtao Zheng, Wenqian Ye, Aidong Zhang

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Accepted to ECCV 2024

2409.01151 2024-09-04 cs.CV cs.LG 62%

Understanding Multimodal Hallucination with Parameter-Free Representation Alignment

Yueqian Wang, Jianxin Liang, Yuxuan Wang, Huishuai Zhang, Dongyan Zhao

专题命中幻觉与鲁棒性：multimodal large language model(abstract)；分类 cs.CV、cs.LG

2408.11866 2024-08-23 cs.CL cs.AI cs.LG q-bio.BM 62%

Crossing New Frontiers: Knowledge-Augmented Large Language Model Prompting for Zero-Shot Text-Based De Novo Molecule Design

Sakhinana Sagar Srinivas, Venkataramana Runkana

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.AI、cs.LG

Comments Paper was accepted at R0-FoMo: Robustness of Few-shot and Zero-shot Learning in Foundation Models, NeurIPS-2023. Please find the links: accepted-papers?authuser=0" target="_blank" rel="noopener">https://sites.google.com/view/r0-fomo/accepted-papers?authuser=0 and https://neurips.cc/virtual/2023/workshop/66517

2408.05446 2024-08-13 cs.CV cs.LG 62%

Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness

Stanislav Fort, Balaji Lakshminarayanan

专题命中幻觉与鲁棒性：vision language model(abstract)；分类 cs.CV、cs.LG

Comments 34 pages, 25 figures, appendix

2407.17060 2024-07-25 cs.CV cs.AI cs.CL eess.IV 62%

High Efficiency Image Compression for Large Visual-Language Models

Binzhe Li, Shurun Wang, Shiqi Wang, Yan Ye

专题命中幻觉与鲁棒性：visual language model(abstract)；分类 cs.CV、cs.AI

2401.14555 2024-06-26 cs.CV cs.LG 62%

Revisiting Active Learning in the Era of Vision Foundation Models

Sanket Rajan Gupte, Josiah Aklilu, Jeffrey J. Nirschl, Serena Yeung-Levy

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.LG

Comments Accepted to TMLR

2406.12663 2024-06-19 cs.CV cs.AI 62%

Do More Details Always Introduce More Hallucinations in LVLM-based Image Captioning?

Mingqian Feng, Yunlong Tang, Zeliang Zhang, Chenliang Xu

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.AI

2406.11331 2024-06-18 cs.CV cs.IR cs.LG 62%

They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias

Salma Abdel Magid, Jui-Hsien Wang, Kushal Kafle, Hanspeter Pfister

专题命中幻觉与鲁棒性：vision language model(abstract)；分类 cs.CV、cs.LG

2405.19334 2024-06-11 cs.AI cs.CL cs.CV cs.MM cs.SD 62%

LLMs Meet Multimodal Generation and Editing: A Survey

Yingqing He, Zhaoyang Liu, Jingye Chen, Zeyue Tian, Hongyu Liu, Xiaowei Chi, Runtao Liu, Ruibin Yuan, Yazhou Xing, Wenhai Wang, Jifeng Dai, Yong Zhang, Wei Xue, Qifeng Liu, Yike Guo, Qifeng Chen

专题命中幻觉与鲁棒性：multimodal large language model(abstract)；分类 cs.CV、cs.AI

Comments 52 Pages with 16 Figures, 12 Tables, and 545 References. GitHub Repository at: https://github.com/YingqingHe/Awesome-LLMs-meet-Multimodal-Generation

2405.16860 2024-05-28 cs.CV cs.AI 62%

Think Before You Act: A Two-Stage Framework for Mitigating Gender Bias Towards Vision-Language Tasks

Yunqi Zhang, Songda Li, Chunyuan Deng, Luyi Wang, Hui Zhao

专题命中幻觉与鲁棒性：vision-language model(abstract)；分类 cs.CV、cs.AI

Comments Accept to NAACL 2024(main)

1. 幻觉与鲁棒性 2272 篇

Understanding and Rectifying Safety Perception Distortion in VLMs

A Multimodal Automated Interpretability Agent

Introspective Planning: Aligning Robots' Uncertainty with Inherent Task Ambiguity

Embodied Red Teaming for Auditing Robotic Foundation Models

Color in Visual-Language Models: CLIP deficiencies

A comparison between humans and AI at recognizing objects in unusual poses

BayesAdapter: enhanced uncertainty estimation in CLIP few-shot adaptation

RAG-Check: Evaluating Multimodal Retrieval Augmented Generation Performance

Data Augmentation for Sparse Multidimensional Learning Performance Data Using Generative AI

RoCOCO: Robustness Benchmark of MS-COCO to Stress-test Image-Text Matching Models

Gaussian Splatting Under Attack: Investigating Adversarial Noise in 3D Objects

Seeing Clearly by Layer Two: Enhancing Attention Heads to Alleviate Hallucination in LVLMs

A Sober Look at the Robustness of CLIPs to Spurious Features

Calibrating Multi-modal Representations: A Pursuit of Group Robustness without Annotations

ADAM: An Embodied Causal Agent in Open-World Environments

You Never Know: Quantization Induces Inconsistent Biases in Vision-Language Foundation Models

Debiasing Vison-Language Models with Text-Only Training

Investigating and Mitigating Object Hallucinations in Pretrained Vision-Language (CLIP) Models

Source-Free Domain Adaptation Guided by Vision and Vision-Language Pre-Training

Towards Efficient Vision-Language Tuning: More Information Density, More Generalizability

Benchmarking Spurious Bias in Few-Shot Image Classifiers

Understanding Multimodal Hallucination with Parameter-Free Representation Alignment

Crossing New Frontiers: Knowledge-Augmented Large Language Model Prompting for Zero-Shot Text-Based De Novo Molecule Design

Ensemble everything everywhere: Multi-scale aggregation for adversarial robustness

High Efficiency Image Compression for Large Visual-Language Models

Revisiting Active Learning in the Era of Vision Foundation Models

Do More Details Always Introduce More Hallucinations in LVLM-based Image Captioning?

They're All Doctors: Synthesizing Diverse Counterfactuals to Mitigate Associative Bias

LLMs Meet Multimodal Generation and Editing: A Survey

Think Before You Act: A Two-Stage Framework for Mitigating Gender Bias Towards Vision-Language Tasks