多模态大模型

Mixed Signals: Decoding VLMs' Reasoning and Underlying Bias in Vision-Language Conflict

Pouya Pezeshkpour, Moin Aminnaseri, Estevam Hruschka

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV、cs.AI

Text Speaks Louder than Vision: ASCII Art Reveals Textual Biases in Vision-Language Models

Zhaochen Wang, Bryan Hooi, Yiwei Wang, Ming-Hsuan Yang, Zi Huang, Yujun Cai

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Under review at COLM 2025

SceneTAP: Scene-Coherent Typographic Adversarial Planner against Vision-Language Models in Real-World Environments

Yue Cao, Yun Xing, Jie Zhang, Di Lin, Tianwei Zhang, Ivor Tsang, Yang Liu, Qing Guo

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

URECA: Unique Region Caption Anything

Sangbeom Lim, Junwan Kim, Heeji Yoon, Jaewoo Jung, Seungryong Kim

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Project page: https://cvlab-kaist.github.io/URECA Code: https://github.com/cvlab-kaist/URECA

Do LLMs Understand Visual Anomalies? Uncovering LLM's Capabilities in Zero-shot Anomaly Detection

Jiaqi Zhu, Shaofeng Cai, Fang Deng, Beng Chin Ooi, Junran Wu

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV、cs.MM

Comments Accepted by MM'24 (Oral)

Can DeepSeek Reason Like a Surgeon? An Empirical Evaluation for Vision-Language Understanding in Robotic-Assisted Surgery

Boyi Ma, Yanguang Zhao, Jie Wang, Guankun Wang, Kun Yuan, Tong Chen, Long Bai, Hongliang Ren

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Comments Technical Report

MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning

Yaming Yang, Dilxat Muhtar, Yelong Shen, Yuefeng Zhan, Jianfeng Liu, Yujing Wang, Hao Sun, Denvy Deng, Feng Sun, Qi Zhang, Weizhu Chen, Yunhai Tong

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CL、cs.AI

Comments 12 Pages, 4 Figures

Advancing Chronic Tuberculosis Diagnostics Using Vision-Language Models: A Multi modal Framework for Precision Analysis

Praveen Shastry, Sowmya Chowdary Muthulur, Naveen Kumarasami, Anandakumar D, Mounigasri M, Keerthana R, Kishore Prasath Venkatesh, Bargava Subramanian, Kalyan Sivasailam, Revathi Ezhumalai, Abitha Marimuthu

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Comments 10 pages , 3 figures

BACON: Improving Clarity of Image Captions via Bag-of-Concept Graphs

Zhantao Yang, Ruili Feng, Keyu Yan, Huangji Wang, Zhicai Wang, Shangwen Zhu, Han Zhang, Jie Xiao, Pingyu Wu, Kai Zhu, Jixuan Chen, Chen-Wei Xie, Yue Yang, Hongyang Zhang, Yu Liu, Fan Cheng

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV、cs.CL

ViLBench: A Suite for Vision-Language Process Reward Modeling

Haoqin Tu, Weitao Feng, Hardy Chen, Hui Liu, Xianfeng Tang, Cihang Xie

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Mind the Gap: Benchmarking Spatial Reasoning in Vision-Language Models

Ilias Stogiannidis, Steven McDonagh, Sotirios A. Tsaftaris

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV、cs.CL

Comments 8 main pages, 4 pages Appendix, 5 figures

RoboFlamingo-Plus: Fusion of Depth and RGB Perception with Vision-Language Models for Enhanced Robotic Manipulation

Sheng Wang

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

MetaToken: Detecting Hallucination in Image Descriptions by Meta Classification

Laura Fieback, Jakob Spiegelberg, Hanno Gottschalk

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.CL

Multi-modality Anomaly Segmentation on the Road

Heng Gao, Zhuolin He, Shoumeng Qiu, Xiangyang Xue, Jian Pu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

TruthLens:A Training-Free Paradigm for DeepFake Detection

Ritabrata Chakraborty, Rajatsubhra Chakraborty, Ali Khaleghi Rahimian, Thomas MacDougall

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

FiVL: A Framework for Improved Vision-Language Alignment through the Lens of Training, Evaluation and Explainability

Estelle Aflalo, Gabriela Ben Melech Stan, Tiep Le, Man Luo, Shachar Rosenman, Sayak Paul, Shao-Yen Tseng, Vasudev Lal

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

SlideChat: A Large Vision-Language Assistant for Whole-Slide Pathology Image Understanding

Ying Chen, Guoan Wang, Yuanfeng Ji, Yanjun Li, Jin Ye, Tianbin Li, Ming Hu, Rongshan Yu, Yu Qiao, Junjun He

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments Accepted by CVPR2025

Text-Guided Image Invariant Feature Learning for Robust Image Watermarking

Muhammad Ahtesham, Xin Zhong

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.MM

Interleaved-Modal Chain-of-Thought

Jun Gao, Yongqi Li, Ziqiang Cao, Wenjie Li

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments CVPR 2025 Main Conference

Self-Introspective Decoding: Alleviating Hallucinations for Large Vision-Language Models

Fushuo Huo, Wenchao Xu, Zhong Zhang, Haozhao Wang, Zhicheng Chen, Peilin Zhao

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments ICLR2025

Surgical-LVLM: Learning to Adapt Large Vision-Language Model for Grounded Visual Question Answering in Robotic Surgery

Guankun Wang, Long Bai, Wan Jun Nah, Jie Wang, Zhaoxi Zhang, Zhen Chen, Jinlin Wu, Mobarakol Islam, Hongbin Liu, Hongliang Ren

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments The manuscript is accepted by ICLR 2025 FM-Wild Workshop

PARIC: Probabilistic Attention Regularization for Language Guided Image Classification from Pre-trained Vison Language Models

Mayank Nautiyal, Stela Arranz Gheorghe, Kristiana Stefa, Li Ju, Ida-Maria Sintorn, Prashant Singh

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Your Large Vision-Language Model Only Needs A Few Attention Heads For Visual Grounding

Seil Kang, Jinyeong Kim, Junhyeok Kim, Seong Jae Hwang

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

CLIPure: Purification in Latent Space via CLIP for Adversarially Robust Zero-Shot Classification

Mingkun Zhang, Keping Bi, Wei Chen, Jiafeng Guo, Xueqi Cheng

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV、cs.AI

Comments accepted by ICLR 2025

Unleashing the Potential of Vision-Language Pre-Training for 3D Zero-Shot Lesion Segmentation via Mask-Attribute Alignment

Yankai Jiang, Wenhui Lei, Xiaofan Zhang, Shaoting Zhang

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV、cs.AI

Comments Accepted as ICLR 2025 conference paper

Compositional Entailment Learning for Hyperbolic Vision-Language Models

Avik Pal, Max van Spengler, Guido Maria D'Amely di Melendugno, Alessandro Flaborea, Fabio Galasso, Pascal Mettes

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV、cs.AI

Comments Accepted as oral paper at ICLR 2025

Attention-Guided Integration of CLIP and SAM for Precise Object Masking in Robotic Manipulation

Muhammad A. Muttaqien, Tomohiro Motoda, Ryo Hanai, Domae Yukiyasu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Graph-Based Captioning: Enhancing Visual Descriptions by Interconnecting Region Captions

Yu-Guan Hsieh, Cheng-Yu Hsieh, Shih-Ying Yeh, Louis Béthune, Hadi Pour Ansari, Pavan Kumar Anasosalu Vasu, Chun-Liang Li, Ranjay Krishna, Oncel Tuzel, Marco Cuturi

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV、cs.AI

Comments 59 pages, 42 figures

FCoT-VL:Advancing Text-oriented Large Vision-Language Models with Efficient Visual Token Compression

Jianjian Li, Junquan Fan, Feng Tang, Gang Huang, Shitao Zhu, Songlin Liu, Nian Xie, Wulong Liu, Yong Liao

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV、cs.AI

Comments 20 pages, 18 figures, 6 tables

Detecting Content Rating Violations in Android Applications: A Vision-Language Approach

D. Denipitiyage, B. Silva, S. Seneviratne, A. Seneviratne, S. Chawla

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV、cs.MM

Comments 11 pages, 8 figures