视觉大模型 / VLM

Next Token Is Enough: Realistic Image Quality and Aesthetic Scoring with Multimodal Large Language Model

Mingxing Li, Rui Wang, Lei Sun, Yancheng Bai, Xiangxiang Chu

专题命中 VLM训练与架构 ：multimodal large language model(title,abstract)；分类 cs.CV

Detecting Offensive Memes with Social Biases in Singapore Context Using Multimodal Large Language Models

Cao Yuxuan, Wu Jiayang, Alistair Cheong Liang Chuen, Bryan Shan Guanrong, Theodore Lee Chong Jen, Sherman Chann Zhi Shen

专题命中 VLM训练与架构 ：multimodal large language model(title)；VLM(abstract)；分类 cs.CV

Comments Accepted at 3rd Workshop on Cross-Cultural Considerations in NLP (C3NLP), co-located with NAACL 2025. This is an extended version with some appendix moved to the main body

Modular Prompt Learning Improves Vision-Language Models

Zhenhan Huang, Tejaswini Pedapati, Pin-Yu Chen, Jianxi Gao

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments 2025 IEEE International Conference on Acoustics, Speech, and Signal Processing

Descriminative-Generative Custom Tokens for Vision-Language Models

Pramuditha Perera, Matthew Trager, Luca Zancato, Alessandro Achille, Stefano Soatto

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Safe Inputs but Unsafe Output: Benchmarking Cross-modality Safety Alignment of Large Vision-Language Model

Siyin Wang, Xingsong Ye, Qinyuan Cheng, Junwen Duan, Shimin Li, Jinlan Fu, Xipeng Qiu, Xuanjing Huang

专题命中 VLM训练与架构 ：vision-language model(title)；LLaVA(abstract)；分类 cs.AI

Journal ref NAACL 2025

When Video Coding Meets Multimodal Large Language Models: A Unified Paradigm for Video Coding

Pingping Zhang, Jinlong Li, Kecheng Chen, Meng Wang, Long Xu, Haoliang Li, Nicu Sebe, Sam Kwong, Shiqi Wang

专题命中 VLM训练与架构 ：multimodal large language model(title,abstract)；分类 cs.CV

Sparsity Meets Similarity: Leveraging Long-Tail Distribution for Dynamic Optimized Token Representation in Multimodal Large Language Models

Gaotong Yu, Yi Chen, Jian Xu

专题命中 VLM训练与架构 ：multimodal large language model(title,abstract)；分类 cs.CV

LoRA-TTT: Low-Rank Test-Time Training for Vision-Language Models

Yuto Kojima, Jiarui Xu, Xueyan Zou, Xiaolong Wang

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Preference VLM: Leveraging VLMs for Scalable Preference-Based Reinforcement Learning

Udita Ghosh, Dripta S. Raychaudhuri, Jiachen Li, Konstantinos Karydis, Amit Roy-Chowdhury

专题命中 VLM训练与架构 ：VLM(title)；vision-language model(abstract)；分类 cs.LG

MINT: Mitigating Hallucinations in Large Vision-Language Models via Token Reduction

Chao Wang, Jianming Yang, Yang Zhou

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments 8 pages, 5 figures, 4 tables

AdaFV: Rethinking of Visual-Language alignment for VLM acceleration

Jiayi Han, Liang Du, Yiwen Wu, Xiangguo Zhou, Hongwei Du, Weibo Zheng

专题命中 VLM训练与架构 ：VLM(title,abstract)；分类 cs.CV

Comments 14 pages, 9 figures

Exploring the Role of Explicit Temporal Modeling in Multimodal Large Language Models for Video Understanding

Yun Li, Zhe Liu, Yajing Kong, Guangrui Li, Jiyuan Zhang, Chao Bian, Feng Liu, Lina Yao, Zhenbang Sun

专题命中 VLM训练与架构 ：multimodal large language model(title,abstract)；分类 cs.CV

On the Feasibility of Vision-Language Models for Time-Series Classification

Vinay Prithyani, Mohsin Mohammed, Richa Gadgil, Ricardo Buitrago, Vinija Jain, Aman Chadha

专题命中 VLM训练与架构 ：vision-language model(title)；vision language model(abstract)；分类 cs.AI

HiMix: Reducing Computational Complexity in Large Vision-Language Models

Xuange Zhang, Dengjie Li, Bo Liu, Zenghao Bao, Yao Zhou, Baisong Yang, Zhongying Liu, Yujie Zhong, Zheng Zhao, Tongtong Yuan

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

MinMo: A Multimodal Large Language Model for Seamless Voice Interaction

Qian Chen, Yafeng Chen, Yanni Chen, Mengzhe Chen, Yingda Chen, Chong Deng, Zhihao Du, Ruize Gao, Changfeng Gao, Zhifu Gao, Yabin Li, Xiang Lv, Jiaqing Liu, Haoneng Luo, Bin Ma, Chongjia Ni, Xian Shi, Jialong Tang, Hui Wang, Hao Wang, Wen Wang, Yuxuan Wang, Yunlan Xu, Fan Yu, Zhijie Yan, Yexin Yang, Baosong Yang, Xian Yang, Guanrou Yang, Tianyu Zhao, Qinglin Zhang, Shiliang Zhang, Nan Zhao, Pei Zhang, Chong Zhang, Jinren Zhou

专题命中 VLM训练与架构 ：multimodal large language model(title,abstract)；分类 cs.AI

Comments Work in progress. Authors are listed in alphabetical order by family name

Enhancing Remote Sensing Vision-Language Models for Zero-Shot Scene Classification

Karim El Khoury, Maxime Zanella, Benoît Gérin, Tiffanie Godelaine, Benoît Macq, Saïd Mahmoudi, Christophe De Vleeschouwer, Ismail Ben Ayed

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted at ICASSP 2025

Multi-Agent Planning Using Visual Language Models

Michele Brienza, Francesco Argenziano, Vincenzo Suriani, Domenico D. Bloisi, Daniele Nardi

专题命中 VLM训练与架构 ：visual language model(title,abstract)；分类 cs.AI

CLIP4STR: A Simple Baseline for Scene Text Recognition with Pre-trained Vision-Language Model

Shuai Zhao, Ruijie Quan, Linchao Zhu, Yi Yang

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted by T-IP. A PyTorch re-implementation is at https://github.com/VamosC/CLIP4STR (Credit on GitHub@VamosC)

Personalized Large Vision-Language Models

Chau Pham, Hoang Phan, David Doermann, Yunjie Tian

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments A simple way to personalize your LLM

LLaVA-SLT: Visual Language Tuning for Sign Language Translation

Han Liang, Chengyu Huang, Yuecheng Xu, Cheng Tang, Weicai Ye, Juze Zhang, Xin Chen, Jingyi Yu, Lan Xu

专题命中 VLM训练与架构 ：LLaVA(title,abstract)；分类 cs.CV

Beyond Human Data: Aligning Multimodal Large Language Models by Iterative Self-Evolution

Wentao Tan, Qiong Cao, Yibing Zhan, Chao Xue, Changxing Ding

专题命中 VLM训练与架构 ：multimodal large language model(title,abstract)；分类 cs.LG

Comments AAAI 2025. The code is available at https://github.com/WentaoTan/SENA

LLaVA Needs More Knowledge: Retrieval Augmented Natural Language Generation with Knowledge Graph for Explaining Thoracic Pathologies

Ameer Hamza, Abdullah, Yong Hyun Ahn, Sungyoung Lee, Seong Tae Kim

专题命中 VLM训练与架构 ：LLaVA(title,abstract)；分类 cs.CV

Comments AAAI2025

UCDR-Adapter: Exploring Adaptation of Pre-Trained Vision-Language Models for Universal Cross-Domain Retrieval

Haoyu Jiang, Zhi-Qi Cheng, Gabriel Moreira, Jiawen Zhu, Jingdong Sun, Bukun Ren, Jun-Yan He, Qi Dai, Xian-Sheng Hua

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted to WACV 2025. Project link: https://github.com/fine68/UCDR2024

Selective State Space Memory for Large Vision-Language Models

Chee Ng, Yuen Fung

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

PVC: Progressive Visual Token Compression for Unified Image and Video Processing in Large Vision-Language Models

Chenyu Yang, Xuan Dong, Xizhou Zhu, Weijie Su, Jiahao Wang, Hao Tian, Zhe Chen, Wenhai Wang, Lewei Lu, Jifeng Dai

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

POINTS1.5: Building a Vision-Language Model towards Real World Applications

Yuan Liu, Le Tian, Xiao Zhou, Xinyu Gao, Kavio Yu, Yang Yu, Jie Zhou

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Driving with InternVL: Oustanding Champion in the Track on Driving with Language of the Autonomous Grand Challenge at CVPR 2024

Jiahan Li, Zhiqi Li, Tong Lu

专题命中 VLM训练与架构 ：InternVL(title,abstract)；分类 cs.CV

Agri-LLaVA: Knowledge-Infused Large Multimodal Assistant on Agricultural Pests and Diseases

Liqiong Wang, Teng Jin, Jinyu Yang, Ales Leonardis, Fangyi Wang, Feng Zheng

专题命中 VLM训练与架构 ：LLaVA(title,abstract)；分类 cs.CV

DPA: Dual Prototypes Alignment for Unsupervised Adaptation of Vision-Language Models

Eman Ali, Sathira Silva, Muhammad Haris Khan

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments Accepted at WACV 2025

HGCLIP: Exploring Vision-Language Models with Graph Representations for Hierarchical Understanding

Peng Xia, Xingtong Yu, Ming Hu, Lie Ju, Zhiyong Wang, Peibo Duan, Zongyuan Ge

专题命中 VLM训练与架构 ：vision-language model(title,abstract)；分类 cs.CV

Comments COLING 2025