多模态大模型

EfficientLLaVA:Generalizable Auto-Pruning for Large Vision-language Models

Yinan Liang, Ziwei Wang, Xiuwei Xu, Jie Zhou, Jiwen Lu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

Elevating Visual Question Answering through Implicitly Learned Reasoning Pathways in LVLMs

Liu Jing, Amirul Rahman

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Effectively Leveraging CLIP for Generating Situational Summaries of Images and Videos

Dhruv Verma, Debaditya Roy, Basura Fernando

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments 38 pages, 12 figures. arXiv admin note: text overlap with arXiv:2307.00586

DynRsl-VLM: Enhancing Autonomous Driving Perception with Dynamic Resolution Vision-Language Models

Xirui Zhou, Lianlei Shan, Xiaolin Gui

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Style Evolving along Chain-of-Thought for Unknown-Domain Object Detection

Zihao Zhang, Aming Wu, Yahong Han

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Revealing and Reducing Gender Biases in Vision and Language Assistants (VLAs)

Leander Girrbach, Stephan Alaniz, Yiran Huang, Trevor Darrell, Zeynep Akata

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CL

Comments Accepted at ICLR 2025

Enhancing Vision-Language Pre-training with Rich Supervisions

Yuan Gao, Kunyu Shi, Pengkai Zhu, Edouard Belval, Oren Nuriel, Srikar Appalaraju, Shabnam Ghadar, Vijay Mahadevan, Zhuowen Tu, Stefano Soatto

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted to CVPR 2024

SegAgent: Exploring Pixel Understanding Capabilities in MLLMs by Imitating Human Annotator Trajectories

Muzhi Zhu, Yuzhuo Tian, Hao Chen, Chunluan Zhou, Qingpei Guo, Yang Liu, Ming Yang, Chunhua Shen

专题命中 图文多模态 ：MLLM(abstract)；分类 cs.CV

Comments CVPR2025;Code will be released at \url{https://github.com/aim-uofa/SegAgent}

GPT4Scene: Understand 3D Scenes from Videos with Vision-Language Models

Zhangyang Qi, Zhixiong Zhang, Ye Fang, Jiaqi Wang, Hengshuang Zhao

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Project page: https://gpt4scene.github.io/

AlphaDrive: Unleashing the Power of VLMs in Autonomous Driving via Reinforcement Learning and Reasoning

Bo Jiang, Shaoyu Chen, Qian Zhang, Wenyu Liu, Xinggang Wang

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments Project Page: https://github.com/hustvl/AlphaDrive

Should VLMs be Pre-trained with Image Data?

Sedrick Keh, Jean Mercat, Samir Yitzhak Gadre, Kushal Arora, Igor Vasiljevic, Benjamin Burchfiel, Shuran Song, Russ Tedrake, Thomas Kollar, Ludwig Schmidt, Achal Dave

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments ICLR 2025

Boosting the Generalization and Reasoning of Vision Language Models with Curriculum Reinforcement Learning

Huilin Deng, Ding Zou, Rui Ma, Hongchen Luo, Yang Cao, Yu Kang

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Dynamic Updates for Language Adaptation in Visual-Language Tracking

Xiaohai Li, Bineng Zhong, Qihua Liang, Zhiyi Mo, Jian Nong, Shuxiang Song

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

EVF-SAM: Early Vision-Language Fusion for Text-Prompted Segment Anything Model

Yuxuan Zhang, Tianheng Cheng, Lianghui Zhu, Rui Hu, Lei Liu, Heng Liu, Longjin Ran, Xiaoxin Chen, Wenyu Liu, Xinggang Wang

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments Preprint. Update: (1) better performance and (2) versatile segmentation. Code and models are available at: https://github.com/hustvl/EVF-SAM

LaMP: Language-Motion Pretraining for Motion Generation, Retrieval, and Captioning

Zhe Li, Weihao Yuan, Yisheng He, Lingteng Qiu, Shenhao Zhu, Xiaodong Gu, Weichao Shen, Yuan Dong, Zilong Dong, Laurence T. Yang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

A Benchmark for Multi-Lingual Vision-Language Learning in Remote Sensing Image Captioning

Qing Zhou, Tao Yang, Junyu Gao, Weiping Ni, Junzheng Wu, Qi Wang

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV

Synthetic Data is an Elegant GIFT for Continual Vision-Language Models

Bin Wu, Wuxuan Shi, Jinqiao Wang, Mang Ye

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments This work is accepted by CVPR 2025. Modifications may be performed

Modulating CNN Features with Pre-Trained ViT Representations for Open-Vocabulary Object Detection

Xiangyu Gao, Yu Dai, Benliu Qiu, Lanxiao Wang, Heqian Qiu, Hongliang Li

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

CLIP is Strong Enough to Fight Back: Test-time Counterattacks towards Zero-shot Adversarial Robustness of CLIP

Songlong Xing, Zhengyu Zhao, Nicu Sebe

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted to CVPR 2025

FairSense-AI: Responsible AI Meets Sustainability

Shaina Raza, Mukund Sayeeganesh Chettiar, Matin Yousefabadi, Tahniat Khan, Marcelo Lotif

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CL

VILA-M3: Enhancing Vision-Language Models with Medical Expert Knowledge

Vishwesh Nath, Wenqi Li, Dong Yang, Andriy Myronenko, Mingxin Zheng, Yao Lu, Zhijian Liu, Hongxu Yin, Yucheng Tang, Pengfei Guo, Can Zhao, Ziyue Xu, Yufan He, Greg Heinrich, Yee Man Law, Benjamin Simon, Stephanie Harmon, Stephen Aylward, Marc Edgar, Michael Zephyr, Song Han, Pavlo Molchanov, Baris Turkbey, Holger Roth, Daguang Xu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Language-Assisted Feature Transformation for Anomaly Detection

EungGu Yun, Heonjin Ha, Yeongwoo Nam, Bryan Dongik Lee

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments ICLR 2025

IteRPrimE: Zero-shot Referring Image Segmentation with Iterative Grad-CAM Refinement and Primary Word Emphasis

Yuji Wang, Jingchen Ni, Yong Liu, Chun Yuan, Yansong Tang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments AAAI 2025

MAA: Meticulous Adversarial Attack against Vision-Language Pre-trained Models

Peng-Fei Zhang, Guangdong Bai, Zi Huang

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Few-shot crack image classification using clip based on bayesian optimization

Yingchao Zhang, Cheng Liu

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments 5 pages, 5 figures, 3 tables, submit to the 1st International Workshop on Bayesian Approach in Civil Engineering (IWOBA 2025)

CLIP Under the Microscope: A Fine-Grained Analysis of Multi-Object Representation

Reza Abbasi, Ali Nazari, Aminreza Sefid, Mohammadali Banayeeanzade, Mohammad Hossein Rohban, Mahdieh Soleymani Baghshah

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Accepted at CVPR 2025

A MIMO Wireless Channel Foundation Model via CIR-CSI Consistency

Jun Jiang, Wenjun Yu, Yunfan Li, Yuan Gao, Shugong Xu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 6 pages, 2025 ICMLCN accepted

USER-VLM 360: Personalized Vision Language Models with User-aware Tuning for Social Human-Robot Interactions

Hamed Rahimi, Adil Bahaj, Mouad Abrini, Mahdi Khoramshahi, Mounir Ghogho, Mohamed Chetouani

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.AI

Backdooring Vision-Language Models with Out-Of-Distribution Data

Weimin Lyu, Jiachen Yao, Saumya Gupta, Lu Pang, Tao Sun, Lingjie Yi, Lijie Hu, Haibin Ling, Chao Chen

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments ICLR 2025

Improving Adversarial Transferability in MLLMs via Dynamic Vision-Language Alignment Attack

Chenhe Gu, Jindong Gu, Andong Hua, Yao Qin

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2403.09766