视觉大模型 / VLM - arXivDaily 专题

2411.17762 2025-07-29 cs.CV 83%

MUSE-VL: Modeling Unified VLM through Semantic Discrete Encoding

Rongchang Xie, Chen Du, Ping Song, Chang Liu

专题命中 VLM训练与架构：VLM(title)；vision-language model(abstract)；LLaVA(abstract)；分类 cs.CV

Comments ICCV 2025

2507.11155 2025-07-16 cs.CR cs.AI 83%

Bridging the Gap in Vision Language Models in Identifying Unsafe Concepts Across Modalities

Yiting Qu, Michael Backes, Yang Zhang

机构 * CISPA Helmholtz Center for Information Security（CISPA海德堡信息安全研究中心）

专题命中 VLM训练与架构：vision language model(title)；vision-language model(abstract)；VLM(abstract)；分类 cs.AI

Comments To Appear in the 34th USENIX Security Symposium, August 2025

2412.18675 2025-07-16 cs.CV 83%

TAB: Transformer Attention Bottlenecks enable User Intervention and Debugging in Vision-Language Models

Pooyan Rahmanzadehgervi, Hung Huy Nguyen, Rosanne Liu, Long Mai, Anh Totti Nguyen

机构 * Auburn University（奥本大学）； Google DeepMind, ML Collective（谷歌DeepMind及ML集体）； Adobe Research（Adobe研究）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

2507.10355 2025-07-15 cs.CV 83%

Beyond Graph Model: Reliable VLM Fine-Tuning via Random Graph Adapter

Bo Jiang, Xueyang Ze, Beibei Wang, Xixi Wang, Xixi Wan, Bin Luo

机构 * Anhui Provincial Key Laboratory of Multimodal Cognitive Computation（安徽省级多模态认知计算重点实验室）； School of Computer Science and Technology（计算机科学与技术学院）； Anhui University（安徽大学）

专题命中 VLM训练与架构：VLM(title,abstract)；vision-language model(abstract)；分类 cs.CV

2507.09097 2025-07-15 cs.CV 83%

RadEyeVideo: Enhancing general-domain Large Vision Language Model for chest X-ray analysis with video representations of eye gaze

Yunsoo Kim, Jinge Wu, Honghan Wu

机构 * Institute of Health Informatics（健康信息学研究所）

专题命中 VLM训练与架构：vision language model(title)；vision-language model(abstract)；LLaVA(abstract)；分类 cs.CV

2503.09394 2025-07-15 cs.CV 83%

Bidirectional Prototype-Reward co-Evolution for Test-Time Adaptation of Vision-Language Models

Xiaozhen Qiao, Peng Huang, Jiakang Yuan, Xianda Guo, Bowen Ye, Chaocan Xue, Ye Zheng, Zhe Sun, Xuelong Li

机构 * School of Information Science and Technology, University of Science and Technology of China（信息科学与技术学院，中国科学技术大学）； Institute of Artificial Intelligence (TeleAI), China Telecom（人工智能研究所（TeleAI），中国电信）； College of Future Information Technology, Fudan University（未来信息技术学院，复旦大学）； College of Computer Science, Wuhan University（计算机科学学院，武汉大学）

专题命中 VLM训练与架构：vision-language model(title)；vision language model(abstract)；VLM(abstract)；分类 cs.CV

2503.20612 2025-07-08 cs.CV 83%

IAP: Improving Continual Learning of Vision-Language Models via Instance-Aware Prompting

Hao Fu, Hanbin Zhao, Jiahua Dong, Henghui Ding, Chao Zhang, Hui Qian

机构 * Zhejiang University（浙江大学）； Fudan University（复旦大学）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments Code can be found at https://github.com/FerdinandZJU/IAP

2507.02957 2025-07-08 cs.CV 83%

CS-VLM: Compressed Sensing Attention for Efficient Vision-Language Representation Learning

Andrew Kiruluta, Preethi Raju, Priscilla Burity

机构 * Berkeley（伯克利）

专题命中 VLM训练与架构：VLM(title)；vision-language model(abstract)；grounding(abstract)；分类 cs.CV

2507.00505 2025-07-08 cs.CV 83%

LLaVA-SP: Enhancing Visual Representation with Visual Spatial Tokens for MLLMs

Haoran Lou, Chunxiao Fan, Ziyan Liu, Yuexin Wu, Xinliang Wang

机构 * Beijing University of Posts and Telecommunications（北京邮电大学）； Beihang University（北航）

专题命中 VLM训练与架构：LLaVA(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Accepted to ICCV 2025

2503.21817 2025-07-04 cs.CV 83%

Skip-Vision: Efficient and Scalable Acceleration of Vision-Language Models via Adaptive Token Skipping

Weili Zeng, Ziyuan Huang, Kaixiang Ji, Yichao Yan

机构 * MoE Key Lab of Artificial Intelligence, AI Institute Shanghai Jiao Tong University（人工智能大模型关键实验室，上海交通大学AI研究院）

专题命中 VLM训练与架构：vision-language model(title,abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Accepted by ICCV2025

2506.15318 2025-07-01 cs.CV 83%

OpenPath: Open-Set Active Learning for Pathology Image Classification via Pre-trained Vision-Language Models

Lanfeng Zhong, Xin Liao, Shichuan Zhang, Shaoting Zhang, Guotai Wang

机构 * University of Electronic Science and Technology of China（电子科技大学）； Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； Department of Pathology, West China Second University Hospital, Sichuan University（四川大学病理科西昌第二大学医院部）； Department of Radiation Oncology, Sichuan Cancer Hospital and Institute, University of Electronic Science and Technology of China（四川癌症医院与研究所放射肿瘤科，电子科技大学）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments MICCAI 2025 early accept

2506.22395 2025-06-30 cs.CV 83%

Test-Time Consistency in Vision Language Models

Shih-Han Chou, Shivam Chandhok, James J. Little, Leonid Sigal

机构 * Department of Computer Science, University of British Columbia（不列颠哥伦比亚大学计算机科学系）； Vector Institute for AI（人工智能矢量研究所）； Canada CIFAR AI Chair（加拿大CIFAR人工智能主席）

专题命中 VLM训练与架构：vision language model(title)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2506.21627 2025-06-30 cs.RO cs.AI 83%

FrankenBot: Brain-Morphic Modular Orchestration for Robotic Manipulation with Vision-Language Models

Shiyi Wang, Wenbo Li, Yiteng Chen, Qingyao Wu, Huiping Zhuang

机构 * School of Future Technology, South China University of Technology（未来技术学院，华南理工大学）； School of Software Engineering, South China University of Technology（软件工程学院，华南理工大学）； Shien-Ming Wu School of Intelligent Engineering, South China University of Technology（智能工程学院，华南理工大学）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.AI

Comments 15 pages, 4 figures, under review of NeurIPS

2506.21317 2025-06-27 cs.CV 83%

LLaVA-Pose: Enhancing Human Pose and Action Understanding via Keypoint-Integrated Instruction Tuning

Dewen Zhang, Tahir Hussain, Wangpeng An, Hayaru Shouno

机构 * Department of Informatics, Graduate School of Informatics and Engineering, The University of Electro-Communications（信息学院、信息工程研究生院、东京电波通信大学）

专题命中 VLM训练与架构：LLaVA(title,abstract)；vision-language model(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2409.09306

2506.18378 2025-06-24 eess.IV cs.CV 83%

Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Review

Haoneng Lin, Cheng Xu, Jing Qin

机构 * Center of Smart Health, Hong Kong Polytechnic University, Hong Kong, China（智能健康中心，香港理工大学，中国）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments 34 pages

2506.16691 2025-06-23 cs.CV 83%

LaVi: Efficient Large Vision-Language Models via Internal Feature Modulation

Tongtian Yue, Longteng Guo, Yepeng Tang, Zijia Zhao, Xinxin Zhu, Hua Huang, Jing Liu

机构 * Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）； Institute of Information Science, Beijing Jiaotong University（北京交通大学信息科学研究院）； School of Artificial Intelligence, Beijing Normal University（北京师范大学人工智能学院）

专题命中 VLM训练与架构：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2506.15477 2025-06-19 cs.CV 83%

Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuning

Chunlei Li, Jingyang Hou, Yilei Shi, Jingliang Hu, Xiao Xiang Zhu, Lichao Mou

机构 * MedAI Technology (Wuxi) Co. Ltd.（MedAI技术（无锡）有限公司）； Technical University of Munich（慕尼黑技术大学）

专题命中 VLM训练与架构：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

2506.12822 2025-06-17 cs.LG cs.RO 83%

Enhancing Rating-Based Reinforcement Learning to Effectively Leverage Feedback from Large Vision-Language Models

Tung Minh Luu, Younghwan Lee, Donghoon Lee, Sunho Kim, Min Jun Kim, Chang D. Yoo

机构 * Korea Advanced Institute of Science and Technology (KAIST)（韩国科学技术院）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.LG

Comments Accepted to ICML 2025

2506.12683 2025-06-17 cs.CV q-bio.QM 83%

Evaluating Cell Type Inference in Vision Language Models Under Varying Visual Context

Samarth Singhal, Sandeep Singhal

机构 * University of North Dakota（北达科他大学）

专题命中 VLM训练与架构：vision language model(title)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2505.14361 2025-06-11 cs.CV 83%

Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives

Xingxing Weng, Chao Pang, Gui-Song Xia

机构 * School of Computer Science, Wuhan University（武汉大学计算机学院）； School of Artificial Intelligence, Wuhan University（武汉大学人工智能学院）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted by IEEE Geoscience and Remote Sensing Magazine

Journal ref IEEE Geoscience and Remote Sensing Magazine, Early Access, 2025

2506.07627 2025-06-10 cs.CV 83%

Event-Priori-Based Vision-Language Model for Efficient Visual Understanding

Haotong Qin, Cheng Hu, Michele Magno

机构 * Center for Project-Based Learning D-ITET, ETH Zürich, Switzerland（项目基于学习中心D-ITET，苏黎世联邦理工学院，瑞士）； State Key Laboratory of Industrial Control Technology, Zhejiang University, China（工业控制技术国家重点实验室，浙江大学，中国）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

2505.03420 2025-06-10 cs.MM cs.CV 83%

Mitigating Image Captioning Hallucinations in Vision-Language Models

Fei Zhao, Chengcui Zhang, Runlin Zhang, Tianyang Wang, Xi Li

机构 * Department of Computer Science, The University of Alabama at Birmingham（亚拉巴马大学伯明翰分校计算机科学系）； Department of Computer Science, University of Waterloo（滑铁卢大学计算机科学系）

专题命中 VLM训练与架构：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

Journal ref IEEE International Conference on Multimedia Information Processing and Retrieval (MIPR) 2025

2501.05952 2025-06-10 cs.CV cs.CL 83%

Scalable Vision Language Model Training via High Quality Data Curation

Hongyuan Dong, Zijian Kang, Weijie Yin, Xiao Liang, Chao Feng, Jiao Ran

机构 * ByteDance Douyin Content Group（字节跳动抖音内容团队）

专题命中 VLM训练与架构：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments ACL 2025 Main Conference

2406.09295 2025-06-05 cs.CL cs.CV 83%

AlignMMBench: Evaluating Chinese Multimodal Alignment in Large Vision-Language Models

Yuhang Wu, Wenmeng Yu, Yean Cheng, Yan Wang, Xiaohan Zhang, Jiazheng Xu, Ming Ding, Yuxiao Dong

机构 * Tsinghua University（清华大学）； Zhipu AI（智谱AI）； Peking University（北京大学）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

2506.02708 2025-06-04 cs.CV cs.CL 83%

Iterative Self-Improvement of Vision Language Models for Image Scoring and Self-Explanation

Naoto Tanji, Toshihiko Yamasaki

专题命中 VLM训练与架构：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted to ICIP2025

2506.02557 2025-06-04 cs.CV 83%

Kernel-based Unsupervised Embedding Alignment for Enhanced Visual Representation in Vision-language Models

Shizhan Gong, Yankai Jiang, Qi Dou, Farzan Farnia

专题命中 VLM训练与架构：vision-language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

Comments ICML 2025

2506.01203 2025-06-03 cs.CV 83%

Self-Supervised Multi-View Representation Learning using Vision-Language Model for 3D/4D Facial Expression Recognition

Muzammil Behzad

机构 * King Fahd University of Petroleum and Minerals（国王法赫德石油矿物大学）

专题命中 VLM训练与架构：vision-language model(title,abstract)；VLM(abstract)；分类 cs.CV

2506.01097 2025-06-03 cs.CV 83%

Generic Token Compression in Multimodal Large Language Models from an Explainability Perspective

Lei Lei, Jie Gu, Xiaokang Ma, Chu Tang, Jingmin Chen, Tong Xu

机构 * University of Science and Technology of China（中国科学技术大学）； Rightly Robotics（Rightly机器人公司）； Shanghai Innovation Institute（上海创新研究院）

专题命中 VLM训练与架构：multimodal large language model(title,abstract)；LLaVA(abstract)；分类 cs.CV

2506.00930 2025-06-03 cs.AI cs.CL 83%

Aligning VLM Assistants with Personalized Situated Cognition

Yongqi Li, Shen Zhou, Xiaohu Li, Xin Miao, Jintao Wen, Mayi Xu, Jianhao Chen, Birong Pan, Hankun Kang, Yuanyuan Zhu, Ming Zhong, Tieyun Qian

机构 * School of Computer Science, Wuhan University（武汉大学计算机学院）； Zhongguancun Academy（中关村学院）

专题命中 VLM训练与架构：VLM(title,abstract)；vision-language model(abstract)；分类 cs.AI

Comments Accepted to ACL 2025 (main), camera-ready version

2506.00805 2025-06-03 cs.CV cs.CL 83%

HSCR: Hierarchical Self-Contrastive Rewarding for Aligning Medical Vision Language Models

Songtao Jiang, Yan Zhang, Yeying Jin, Zhihang Tang, Yangyang Wu, Yang Feng, Jian Wu, Zuozhu Liu

机构 * Zhejiang University（浙江大学）； Byte Dance（字节跳动）； National University of Singapore（新加坡国立大学）； Angelalign Inc China（Angelalign中国公司）； Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence（浙江省医学影像人工智能重点实验室）

专题命中 VLM训练与架构：vision language model(title)；vision-language model(abstract)；VLM(abstract)；分类 cs.CV

1. VLM训练与架构 5067 篇

MUSE-VL: Modeling Unified VLM through Semantic Discrete Encoding

Bridging the Gap in Vision Language Models in Identifying Unsafe Concepts Across Modalities

TAB: Transformer Attention Bottlenecks enable User Intervention and Debugging in Vision-Language Models

Beyond Graph Model: Reliable VLM Fine-Tuning via Random Graph Adapter

RadEyeVideo: Enhancing general-domain Large Vision Language Model for chest X-ray analysis with video representations of eye gaze

Bidirectional Prototype-Reward co-Evolution for Test-Time Adaptation of Vision-Language Models

IAP: Improving Continual Learning of Vision-Language Models via Instance-Aware Prompting

CS-VLM: Compressed Sensing Attention for Efficient Vision-Language Representation Learning

LLaVA-SP: Enhancing Visual Representation with Visual Spatial Tokens for MLLMs

Skip-Vision: Efficient and Scalable Acceleration of Vision-Language Models via Adaptive Token Skipping

OpenPath: Open-Set Active Learning for Pathology Image Classification via Pre-trained Vision-Language Models

Test-Time Consistency in Vision Language Models

FrankenBot: Brain-Morphic Modular Orchestration for Robotic Manipulation with Vision-Language Models

LLaVA-Pose: Enhancing Human Pose and Action Understanding via Keypoint-Integrated Instruction Tuning

Taming Vision-Language Models for Medical Image Analysis: A Comprehensive Review

LaVi: Efficient Large Vision-Language Models via Internal Feature Modulation

Multimodal Large Language Models for Medical Report Generation via Customized Prompt Tuning

Enhancing Rating-Based Reinforcement Learning to Effectively Leverage Feedback from Large Vision-Language Models

Evaluating Cell Type Inference in Vision Language Models Under Varying Visual Context

Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives

Event-Priori-Based Vision-Language Model for Efficient Visual Understanding

Mitigating Image Captioning Hallucinations in Vision-Language Models

Scalable Vision Language Model Training via High Quality Data Curation

AlignMMBench: Evaluating Chinese Multimodal Alignment in Large Vision-Language Models

Iterative Self-Improvement of Vision Language Models for Image Scoring and Self-Explanation

Kernel-based Unsupervised Embedding Alignment for Enhanced Visual Representation in Vision-language Models

Self-Supervised Multi-View Representation Learning using Vision-Language Model for 3D/4D Facial Expression Recognition

Generic Token Compression in Multimodal Large Language Models from an Explainability Perspective

Aligning VLM Assistants with Personalized Situated Cognition

HSCR: Hierarchical Self-Contrastive Rewarding for Aligning Medical Vision Language Models