视觉大模型 / VLM - arXivDaily 专题

2505.05681 2025-05-12 cs.CV 70%

Fine-Tuning Video-Text Contrastive Model for Primate Behavior Retrieval from Unlabeled Raw Videos

Giulio Cesare Mastrocinque Santo, Patrícia Izar, Irene Delval, Victor de Napole Gregolin, Nina S. T. Hirata

机构 * Institute of Mathematics and Statistics, University of São Paulo (IME-USP)（数学统计研究所，圣保罗大学）； Department of Experimental Psychology, Institute of Psychology, University of São Paulo (IP-USP)（心理学实验部门，心理学研究所，圣保罗大学）； Institute of Biosciences, University of São Paulo (IB-USP)（生物科学研究所，圣保罗大学）

专题命中 VLM训练与架构：vision-language model(abstract)；multimodal large language model(abstract)；分类 cs.CV

2505.04637 2025-05-09 cs.CL cs.AI 70%

Adaptive Token Boundaries: Integrating Human Chunking Mechanisms into Multimodal LLMs

Dongxing Yu

专题命中 VLM训练与架构：visual question answering(abstract)；multimodal large language model(abstract)；分类 cs.AI

2505.02325 2025-05-06 cs.CV 70%

TeDA: Boosting Vision-Lanuage Models for Zero-Shot 3D Object Retrieval via Testing-time Distribution Alignment

Zhichuan Wang, Yang Zhou, Jinhai Xiang, Yulong Wang, Xinwei He

机构 * Huazhong Agricultural University（华中农业大学）

专题命中 VLM训练与架构：vision-language model(abstract)；InternVL(abstract)；分类 cs.CV

Comments Accepted by ICMR 2025

2504.20520 2025-04-30 cs.RO cs.AI 70%

PRISM: Projection-based Reward Integration for Scene-Aware Real-to-Sim-to-Real Transfer with Few Demonstrations

Haowen Sun, Han Wang, Chengzhong Ma, Shaolong Zhang, Jiawei Ye, Xingyu Chen, Xuguang Lan

机构 * National Key Laboratory of Human-Machine Hybrid Augmented Intelligence（人机混合增强智能国家级实验室）； Institute of Artificial Intelligence and Robotics（人工智能与机器人研究院）； Xi’an Jiaotong University（西安交通大学）

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.AI

2504.18856 2025-04-29 cs.CV 70%

Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representation

Shahad Albastaki, Anabia Sohail, Iyyakutti Iyappan Ganapathi, Basit Alawode, Asim Khan, Sajid Javed, Naoufel Werghi, Mohammed Bennamoun, Arif Mahmood

机构 * Department of Computer Science（计算机科学系）； ARIC ； Khalifa University of Science and Technology（科技大学）； Information Technology University of the Punjab（旁遮普信息科技大学）； University of the Western Australia（西澳大学）

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2504.17395 2025-04-25 cs.CV 70%

SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting

Yiming Zhao, Guorong Li, Laiyun Qing, Amin Beheshti, Jian Yang, Michael Sheng, Yuankai Qi, Qingming Huang

机构 * UCAS Beijing China（中国科学院大学北京校区）； Macquarie University（麦考瑞大学）

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2504.16030 2025-04-23 cs.CV 70%

LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale

Joya Chen, Ziyun Zeng, Yiqi Lin, Wei Li, Zejun Ma, Mike Zheng Shou

机构 * Show Lab, National University of Singapore（新加坡国立大学Show实验室）； ByteDance（字节跳动）

专题命中 VLM训练与架构：vision-language model(abstract)；LLaVA(abstract)；分类 cs.CV

Comments CVPR 2025. If any references are missing, please contact joyachen@u.nus.edu

2504.14117 2025-04-22 cs.CL cs.CV 70%

PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models

Nusrat Jahan Prottasha, Upama Roy Chowdhury, Shetu Mohanto, Tasfia Nuzhat, Abdullah As Sami, Md Shamol Ali, Md Shohanur Islam Sobuj, Hafijur Raman, Md Kowsher, Ozlem Ozmen Garibay

机构 * University of Central Florida（佛罗里达中央大学）； Khulna University of Engineering & Technology（库尔纳工程与技术大学）； Delineate Inc.（Delineate公司）； Universiti Tenaga Nasional（国家能源大学）； University of South Florida（佛罗里达州立大学）； Daffodil International University（达夫迪尔国际大学）； Anymate Me（Anymate Me公司）

专题命中 VLM训练与架构：vision language model(abstract)；grounding(abstract)；分类 cs.CV

Comments PEFT Survey paper

2504.12018 2025-04-17 cs.CV 70%

Instruction-augmented Multimodal Alignment for Image-Text and Element Matching

Xinli Yue, JianHui Sun, Junda Lu, Liangchao Yao, Fan Xia, Tianyi Wang, Fengyun Rao, Jing Lyu, Yuetang Deng

专题命中 VLM训练与架构：visual question answering(abstract)；multimodal large language model(abstract)；分类 cs.CV

Comments Accepted to CVPR 2025 Workshop

2504.11838 2025-04-17 cs.CV 70%

A Visual RAG Pipeline for Few-Shot Fine-Grained Product Classification

Bianca Lamm, Janis Keuper

专题命中 VLM训练与架构：vision language model(abstract)；VLM(abstract)；分类 cs.CV

2504.10462 2025-04-15 cs.CV 70%

The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer

Weixian Lei, Jiacong Wang, Haochen Wang, Xiangtai Li, Jun Hao Liew, Jiashi Feng, Zilong Huang

专题命中 VLM训练与架构：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.CV

2412.04332 2025-04-14 cs.CV 70%

Liquid: Language Models are Scalable and Unified Multi-modal Generators

Junfeng Wu, Yi Jiang, Chuofan Ma, Yuliang Liu, Hengshuang Zhao, Zehuan Yuan, Song Bai, Xiang Bai

专题命中 VLM训练与架构：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.CV

Comments Technical report. Project page: https://foundationvision.github.io/Liquid/

2504.06666 2025-04-10 cs.CV 70%

Patch Matters: Training-free Fine-grained Image Caption Enhancement via Local Perception

Ruotian Peng, Haiying He, Yake Wei, Yandong Wen, Di Hu

专题命中 VLM训练与架构：LLaVA(abstract)；multimodal large language model(abstract)；分类 cs.CV

2409.06481 2025-04-08 cs.CV 70%

NeIn: Telling What You Don't Want

Nhat-Tan Bui, Dinh-Hieu Hoang, Quoc-Huy Trinh, Minh-Triet Tran, Truong Nguyen, Susan Gauch

专题命中 VLM训练与架构：vision-language model(abstract)；LLaVA(abstract)；分类 cs.CV

Comments Accepted to CVPR 2025 Workshop SyntaGen. Project page: https://tanbuinhat.github.io/NeIn/

2412.17811 2025-04-04 cs.CV 70%

ChatGarment: Garment Estimation, Generation and Editing via Large Language Models

Siyuan Bian, Chenghao Xu, Yuliang Xiu, Artur Grigorev, Zhen Liu, Cewu Lu, Michael J. Black, Yao Feng

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments CVPR 2025

2407.12957 2025-04-04 cs.RO cs.LG 70%

R+X: Retrieval and Execution from Everyday Human Videos

Georgios Papagiannis, Norman Di Palo, Pietro Vitiello, Edward Johns

专题命中 VLM训练与架构：vision language model(abstract)；VLM(abstract)；分类 cs.LG

Comments Published at the IEEE International Conference on Robotics and Automation (ICRA) 2025

2504.01786 2025-04-03 cs.GR cs.LG 70%

BlenderGym: Benchmarking Foundational Model Systems for Graphics Editing

Yunqi Gu, Ian Huang, Jihyeon Je, Guandao Yang, Leonidas Guibas

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.LG

Comments CVPR 2025 Accepted

2503.23959 2025-04-02 cs.CV 70%

Local Information Matters: Inference Acceleration For Grounded Conversation Generation Models Through Adaptive Local-Aware Token Pruning

Bizhe Bai, Jianjian Cao, Yadan Luo, Tao Chen

专题命中 VLM训练与架构：LLaVA(abstract)；grounding(abstract)；分类 cs.CV

2503.23508 2025-04-01 cs.CV 70%

Re-Aligning Language to Visual Objects with an Agentic Workflow

Yuming Chen, Jiangyan Feng, Haodong Zhang, Lijun Gong, Feng Zhu, Rui Zhao, Qibin Hou, Ming-Ming Cheng, Yibing Song

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments 33 pages, 20 figures, 17 tables, ICLR 2025

2503.16930 2025-03-24 cs.CV 70%

Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networks

Haijin Zeng, Xiangming Wang, Yongyong Chen, Jingyong Su, Jie Liu

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments CVPR 2025

2407.01509 2025-03-21 cs.CV cs.CL 70%

MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs

Yusu Qian, Hanrong Ye, Jean-Philippe Fauconnier, Peter Grasch, Yinfei Yang, Zhe Gan

专题命中 VLM训练与架构：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted at ICLR 2025

2503.12866 2025-03-18 cs.CV 70%

SCAP: Transductive Test-Time Adaptation via Supportive Clique-based Attribute Prompting

Chenyu Zhang, Kunlun Xu, Zichen Liu, Yuxin Peng, Jiahuan Zhou

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted by CVPR 2025

2503.12329 2025-03-18 cs.CV cs.CL 70%

CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era

Kanzhi Cheng, Wenpo Song, Jiaxin Fan, Zheng Ma, Qiushi Sun, Fangzhi Xu, Chenyang Yan, Nuo Chen, Jianbing Zhang, Jiajun Chen

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2404.10757 2025-03-18 astro-ph.IM astro-ph.SR cs.CL cs.LG 70%

Deep Learning and LLM-based Methods Applied to Stellar Lightcurve Classification

Yu-Yang Li, Yu Bai, Cunshi Wang, Mengwei Qu, Ziteng Lu, Roberto Soria, Jifeng Liu

专题命中 VLM训练与架构：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.LG

Comments 35 pages, 20 figures

Journal ref Intell Comput. 2025;4:0110

2503.10731 2025-03-17 cs.CV 70%

Leveraging Vision-Language Embeddings for Zero-Shot Learning in Histopathology Images

Md Mamunur Rahaman, Ewan K. A. Millar, Erik Meijering

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2408.12928 2025-03-17 cs.CV 70%

ParGo: Bridging Vision-Language with Partial and Global Views

An-Lan Wang, Bin Shan, Wei Shi, Kun-Yu Lin, Xiang Fei, Guozhi Tang, Lei Liao, Can Huang, Jingqun Tang, Wei-Shi Zheng

专题命中 VLM训练与架构：multimodal large language model(abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted by AAAI 2025

2503.10322 2025-03-14 cs.CV 70%

Towards Fast, Memory-based and Data-Efficient Vision-Language Policy

Haoxuan Li, Sixu Yan, Yuhan Li, Xinggang Wang

专题命中 VLM训练与架构：vision language model(abstract)；VLM(abstract)；分类 cs.CV

Comments 11 pages, 7 figures, 6 tables

2503.09871 2025-03-14 cs.CV 70%

LuciBot: Automated Robot Policy Learning from Generated Videos

Xiaowen Qiu, Yian Wang, Jiting Cai, Zhehuan Chen, Chunru Lin, Tsun-Hsuan Wang, Chuang Gan

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

2503.07906 2025-03-12 cs.CV 70%

Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning

Qinghao Ye, Xianhan Zeng, Fu Li, Chunyuan Li, Haoqi Fan

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments Accepted by ICLR 2025

2411.15922 2025-03-12 eess.IV cs.CV 70%

PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation

Chia-Ming Lee, Ching-Heng Cheng, Yu-Fan Lin, Yi-Ching Cheng, Wo-Ting Liao, Fu-En Yang, Yu-Chiang Frank Wang, Chih-Chung Hsu

专题命中 VLM训练与架构：vision-language model(abstract)；VLM(abstract)；分类 cs.CV

Comments Project page: https://chingheng0808.github.io/prompthsiP/static.html

1. VLM训练与架构 5084 篇

Fine-Tuning Video-Text Contrastive Model for Primate Behavior Retrieval from Unlabeled Raw Videos

Adaptive Token Boundaries: Integrating Human Chunking Mechanisms into Multimodal LLMs

TeDA: Boosting Vision-Lanuage Models for Zero-Shot 3D Object Retrieval via Testing-time Distribution Alignment

PRISM: Projection-based Reward Integration for Scene-Aware Real-to-Sim-to-Real Transfer with Few Demonstrations

Multi-Resolution Pathology-Language Pre-training Model with Text-Guided Visual Representation

SDVPT: Semantic-Driven Visual Prompt Tuning for Open-World Object Counting

LiveCC: Learning Video LLM with Streaming Speech Transcription at Scale

PEFT A2Z: Parameter-Efficient Fine-Tuning Survey for Large Language and Vision Models

Instruction-augmented Multimodal Alignment for Image-Text and Element Matching

A Visual RAG Pipeline for Few-Shot Fine-Grained Product Classification

The Scalability of Simplicity: Empirical Analysis of Vision-Language Learning with a Single Transformer

Liquid: Language Models are Scalable and Unified Multi-modal Generators

Patch Matters: Training-free Fine-grained Image Caption Enhancement via Local Perception

NeIn: Telling What You Don't Want

ChatGarment: Garment Estimation, Generation and Editing via Large Language Models

R+X: Retrieval and Execution from Everyday Human Videos

BlenderGym: Benchmarking Foundational Model Systems for Graphics Editing

Local Information Matters: Inference Acceleration For Grounded Conversation Generation Models Through Adaptive Local-Aware Token Pruning

Re-Aligning Language to Visual Objects with an Agentic Workflow

Vision-Language Gradient Descent-driven All-in-One Deep Unfolding Networks

MIA-Bench: Towards Better Instruction Following Evaluation of Multimodal LLMs

SCAP: Transductive Test-Time Adaptation via Supportive Clique-based Attribute Prompting

CapArena: Benchmarking and Analyzing Detailed Image Captioning in the LLM Era

Deep Learning and LLM-based Methods Applied to Stellar Lightcurve Classification

Leveraging Vision-Language Embeddings for Zero-Shot Learning in Histopathology Images

ParGo: Bridging Vision-Language with Partial and Global Views

Towards Fast, Memory-based and Data-Efficient Vision-Language Policy

LuciBot: Automated Robot Policy Learning from Generated Videos

Painting with Words: Elevating Detailed Image Captioning with Benchmark and Alignment Learning

PromptHSI: Universal Hyperspectral Image Restoration with Vision-Language Modulated Frequency Adaptation