多模态大模型

Grid Jigsaw Representation with CLIP: A New Perspective on Image Clustering

Zijie Song, Zhenzhen Hu, Richang Hong

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV

Journal ref Multimedia Systems 31, 105 (2025)

ViLa-MIL: Dual-scale Vision-Language Multiple Instance Learning for Whole Slide Image Classification

Jiangbo Shi, Chen Li, Tieliang Gong, Yefeng Zheng, Huazhu Fu

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments CVPR 2024 (Updated version with corrections for typos and errors.)

Lightweight Neural App Control

Filippos Christianos, Georgios Papoudakis, Thomas Coste, Jianye Hao, Jun Wang, Kun Shao

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.AI

Comments ICLR 2025 (spotlight)

Learning without Forgetting for Vision-Language Models

Da-Wei Zhou, Yuanhan Zhang, Yan Wang, Jingyi Ning, Han-Jia Ye, De-Chuan Zhan, Ziwei Liu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted to TPAMI. Code is available at https://github.com/zhoudw-zdw/PROOF

The Breeze 2 Herd of Models: Traditional Chinese LLMs Based on Llama with Vision-Aware and Function-Calling Capabilities

MediaTek Research, :, Chan-Jan Hsu, Chia-Sheng Liu, Meng-Hsi Chen, Muxi Chen, Po-Chun Hsu, Yi-Chang Chen, Da-Shan Shiu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CL

Group-CLIP Uncertainty Modeling for Group Re-Identification

Qingxin Zhang, Haoyan Wei, Yang Qian

专题命中 图文多模态 ：cross-modal(abstract)；分类 cs.CV

HoVLE: Unleashing the Power of Monolithic Vision-Language Models with Holistic Vision-Language Embedding

Chenxin Tao, Shiqian Su, Xizhou Zhu, Chenyu Zhang, Zhe Chen, Jiawen Liu, Wenhai Wang, Lewei Lu, Gao Huang, Yu Qiao, Jifeng Dai

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

What Is Missing in Multilingual Visual Reasoning and How to Fix It

Yueqi Song, Simran Khanuja, Graham Neubig

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CL

Membership Inference Attacks Against Vision-Language Models

Yuke Hu, Zheng Li, Zhihao Liu, Yang Zhang, Zhan Qin, Kui Ren, Chun Chen

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.AI

Comments Accepted by USENIX'25; 22 pages, 28 figures;

Exploring scalable medical image encoders beyond text supervision

Fernando Pérez-García, Harshita Sharma, Sam Bond-Taylor, Kenza Bouzid, Valentina Salvatelli, Maximilian Ilse, Shruthi Bannur, Daniel C. Castro, Anton Schwaighofer, Matthew P. Lungren, Maria Teodora Wetscherek, Noel Codella, Stephanie L. Hyland, Javier Alvarez-Valle, Ozan Oktay

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Journal ref Nature Machine Intelligence (2025)

Vision-Language Model Dialog Games for Self-Improvement

Ksenia Konyushkova, Christos Kaplanis, Serkan Cabi, Misha Denil

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.AI

Vision and Language Reference Prompt into SAM for Few-shot Segmentation

Kosuke Sakurai, Ryotaro Shimizu, Masayuki Goto

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, 2 figures

Benchmarking and Improving Bird's Eye View Perception Robustness in Autonomous Driving

Shaoyuan Xie, Lingdong Kong, Wenwei Zhang, Jiawei Ren, Liang Pan, Kai Chen, Ziwei Liu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

Comments TPAMI 2025; 17 pages, 13 figures, 11 tables; Code at this https URL: https://github.com/Daniel-xsy/RoboBEV

Complementary Subspace Low-Rank Adaptation of Vision-Language Models for Few-Shot Classification

Zhongqi Wang, Jia Dai, Kai Li, Xu Li, Yanmeng Guo, Maosheng Xiang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments Preprint version

AKVQ-VL: Attention-Aware KV Cache Adaptive 2-Bit Quantization for Vision-Language Models

Zunhai Su, Wang Shen, Linge Li, Zhe Chen, Hanyu Wei, Huangqi Yu, Kehong Yuan

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CL

ClawMachine: Learning to Fetch Visual Tokens for Referential Comprehension

Tianren Ma, Lingxi Xie, Yunjie Tian, Boyu Yang, Qixiang Ye

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments ICLR 2025. Code is available at github.com/martian422/ClawMachine

Generalizable Prompt Tuning for Vision-Language Models

Qian Zhang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments in progress

SimLabel: Consistency-Guided OOD Detection with Pretrained Vision-Language Models

Shu Zou, Xinyu Tian, Qinyu Zhao, Zhaoyuan Yang, Jing Zhang

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments 10 pages

Instruction-Guided Fusion of Multi-Layer Visual Features in Large Vision-Language Models

Xu Li, Yi Zheng, Haotian Chen, Xiaolei Chen, Yuxuan Liang, Chenghang Lai, Bin Li, Xiangyang Xue

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Playing Devil's Advocate: Unmasking Toxicity and Vulnerabilities in Large Vision-Language Models

Abdulkadir Erol, Trilok Padhi, Agnik Saha, Ugur Kursuncu, Mehmet Emin Aktas

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.AI

Dynamic Knowledge Integration for Enhanced Vision-Language Reasoning

Julian Perry, Surasakdi Siripong, Thanakorn Phonchai

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CL

3VL: Using Trees to Improve Vision-Language Models' Interpretability

Nir Yellinek, Leonid Karlinsky, Raja Giryes

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

Comments accepted to IEEE TIP

Visual Language Models as Operator Agents in the Space Domain

Alejandro Carrasco, Marco Nedungadi, Enrico M. Zucchelli, Amit Jain, Victor Rodriguez-Fernandez, Richard Linares

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.AI

Comments Updated version of the paper presented in 2025 AIAA SciTech. https://arc.aiaa.org/doi/10.2514/6.2025-1543

The Quest for Visual Understanding: A Journey Through the Evolution of Visual Question Answering

Anupam Pandey, Deepjyoti Bodo, Arpan Phukan, Asif Ekbal

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Simplifying CLIP: Unleashing the Power of Large-Scale Models on Consumer-level Computers

Hongbo Liu

专题命中 图文多模态 ：image-text(abstract)；分类 cs.CV

RSRefSeg: Referring Remote Sensing Image Segmentation with Foundation Models

Keyan Chen, Jiafan Zhang, Chenyang Liu, Zhengxia Zou, Zhenwei Shi

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Mechanistic understanding and validation of large AI models with SemanticLens

Maximilian Dreyer, Jim Berend, Tobias Labarta, Johanna Vielhaben, Thomas Wiegand, Sebastian Lapuschkin, Wojciech Samek

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.AI

Comments 74 pages (18 pages manuscript, 7 pages references, 49 pages appendix)

LogicAD: Explainable Anomaly Detection via VLM-based Text Feature Extraction

Er Jin, Qihui Feng, Yongli Mou, Stefan Decker, Gerhard Lakemeyer, Oliver Simons, Johannes Stegmaier

专题命中 图文多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted for publication at aaai25, project page: https://jasonjin34.github.io/logicad.github.io/

Light-weight Fine-tuning Method for Defending Adversarial Noise in Pre-trained Medical Vision-Language Models

Xu Han, Linghao Jin, Xuezhe Ma, Xiaofeng Liu

专题命中 图文多模态 ：multi-modal(abstract)；分类 cs.CV

AtMan: Understanding Transformer Predictions Through Memory Efficient Attention Manipulation

Björn Deiseroth, Mayukh Deb, Samuel Weinbach, Manuel Brack, Patrick Schramowski, Kristian Kersting

专题命中 图文多模态 ：image-text(abstract)；分类 cs.AI