视觉大模型 / VLM

2506.20990 2025-10-27 cs.LG cs.CL cs.CV 84%

SharpZO: Hybrid Sharpness-Aware Vision Language Model Prompt Tuning via Forward-Only Passes

Yifan Yang, Zhen Zhang, Rupak Vignesh Swaminathan, Jing Liu, Nathan Susanj, Zheng Zhang

专题命中 VLM训练与架构：vision language model(title,abstract)；VLM(abstract)；分类 cs.CV、cs.LG

2510.20859 2025-10-27 q-bio.NC 78%

Vision-language models learn the geometry of human perceptual space

Craig Sanders, Billy Dickson, Sahaj Singh Maini, Robert Nosofsky, Zoran Tiganj

专题命中 VLM训练与架构：vision-language model(title,abstract)

2510.21606 2025-10-27 cs.CV 74%

Modest-Align: Data-Efficient Alignment for Vision-Language Models

Jiaxiang Liu, Yuan Wang, Jiawei Du, Joey Tianyi Zhou, Mingkun Xu, Zuozhu Liu

机构 * Guangdong Institute of Intelligence Science and Technology（广东智能科学与技术研究院）； ZJU-Angelalign R&D Center for Intelligence Healthcare（浙大天使align智能医疗研发中心）； Centre for Frontier AI Research (CFAR)（前沿人工智能研究中心）； Agency for Science, Technology and Research (A*STAR)（科技研究局）； Institute of High Performance Computing (IHPC)（高性能计算研究所）

专题命中 VLM训练与架构：vision-language model(title)；分类 cs.CV

2510.21323 2025-10-27 cs.CV cs.LG 73%

VL-SAE: Interpreting and Enhancing Vision-Language Alignment with a Unified Concept Set

Shufan Shen, Junshu Sun, Qingming Huang, Shuhui Wang

机构 * Key Lab of Intell. Info. Process., Inst. of Comput. Tech., CAS（智能信息处理重点实验室，计算技术研究所，中国科学院）； University of Chinese Academy of Sciences（中国科学院大学）

专题命中 VLM训练与架构：vision-language model(abstract)；LLaVA(abstract)；分类 cs.CV、cs.LG

Comments Accepted by NeurIPS 2025

2510.12995 2025-10-27 eess.AS cs.SD 67%

Continuous-Token Diffusion for Speaker-Referenced TTS in Multimodal LLMs

Xinlu He, Swayambhu Nath Ray, Harish Mallidi, Jia-Hong Huang, Ashwin Bellur, Chander Chandak, M. Maruf, Venkatesh Ravichandran

机构 * Worcester Polytechnic Institute（沃斯特理工大学）； Amazon AGI（亚马逊人工智能实验室）

专题命中 VLM训练与架构：multimodal large language model(abstract)；MLLM(abstract)

2510.21551 2025-10-27 cs.LG 57%

Interpretable Multimodal Zero-Shot ECG Diagnosis via Structured Clinical Knowledge Alignment

Jialu Tang, Hung Manh Pham, Ignace De Lathauwer, Henk S. Schipper, Yuan Lu, Dong Ma, Aaqib Saeed

机构 * Eindhoven University of Technology（埃因霍温理工大学）； Singapore Management University（新加坡管理大学）； Maxima Medical Center（马克斯医疗中心）； Erasmus Medical Center（埃因霍温医学院）

专题命中 VLM训练与架构：grounding(abstract)；分类 cs.LG

2509.21359 2025-10-27 cs.CL cs.AI 57%

Influence Guided Context Selection for Effective Retrieval-Augmented Generation

Jiale Deng, Yanyan Shen, Ziyuan Pei, Youmin Chen, Linpeng Huang

机构 * Shanghai Jiao Tong University（上海交通大学）

专题命中 VLM训练与架构：grounding(abstract)；分类 cs.AI

2306.13394 2025-10-27 cs.CV 83%

MME: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models

Chaoyou Fu, Peixian Chen, Yunhang Shen, Yulei Qin, Mengdan Zhang, Xu Lin, Jinrui Yang, Xiawu Zheng, Ke Li, Xing Sun, Yunsheng Wu, Rongrong Ji, Caifeng Shan, Ran He

机构 * State Key Laboratory for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室）； School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）； Tencent Youtu Lab（腾讯优图实验室）； Xiamen University（厦门大学）； CASIA（中国科学院自动化研究所）

专题命中其他VLM ：multimodal large language model(title,abstract)；MLLM(abstract)；分类 cs.CV

Comments NeurIPS DB 2025 Spotlight, Project Page: https://github.com/BradyFU/Awesome-Multimodal-Large-Language-Models/tree/Evaluation

2510.21175 2025-10-27 cs.AI 79%

Memory-Free Continual Learning with Null Space Adaptation for Zero-Shot Vision-Language Models

Yujin Jo, Taesup Kim

专题命中其他VLM ：vision-language model(title,abstract)；分类 cs.AI

2510.21214 2025-10-27 cs.CR 78%

Enhanced MLLM Black-Box Jailbreaking Attacks and Defenses

Xingwei Zhong, Kar Wai Fok, Vrizlynn L. L. Thing

专题命中其他VLM ：MLLM(title)；multimodal large language model(abstract)

2501.01957 2025-10-27 cs.CV cs.SD eess.AS 72%

VITA-1.5: Towards GPT-4o Level Real-Time Vision and Speech Interaction

Chaoyou Fu, Haojia Lin, Xiong Wang, Yi-Fan Zhang, Yunhang Shen, Xiaoyu Liu, Haoyu Cao, Zuwei Long, Heting Gao, Ke Li, Long Ma, Xiawu Zheng, Rongrong Ji, Xing Sun, Caifeng Shan, Ran He

机构 * State Key Laboratory for Novel Software Technology, Nanjing University（南京大学新型软件技术国家重点实验室）； School of Intelligence Science and Technology, Nanjing University（南京大学智能科学与技术学院）； Tencent Youtu Lab（腾讯优图实验室）； XMU（厦门大学）； CASIA（中国科学院自动化研究所）

专题命中其他VLM ：MLLM(abstract,comments)；multimodal large language model(abstract)；分类 cs.CV

Comments NeurIPS 2025 Spotlight, Code 2.4K Stars: https://github.com/VITA-MLLM/VITA

2510.21121 2025-10-27 cs.RO cs.AI 57%

Generalizable Hierarchical Skill Learning via Object-Centric Representation

Haibo Zhao, Yu Qi, Boce Hu, Yizhe Zhu, Ziyan Chen, Heng Tian, Xupeng Zhu, Owen Howell, Haojie Huang, Robin Walters, Dian Wang, Robert Platt

专题命中其他VLM ：vision-language model(abstract)；分类 cs.AI

2506.15745 2025-10-27 eess.IV cs.LG 57%

InfiniPot-V: Memory-Constrained KV Cache Compression for Streaming Video Understanding

Minsoo Kim, Kyuhong Shim, Jungwook Choi, Simyung Chang

专题命中其他VLM ：multimodal large language model(abstract)；分类 cs.LG

Comments NeurIPS 2025

1. VLM训练与架构 7 篇