视觉大模型 / VLM - arXivDaily 专题

2507.09747 2025-10-07 cs.NE 50%

BrainFLORA: Uncovering Brain Concept Representation via Multimodal Neural Embeddings

Dongyang Li, Haoyang Qin, Mingyang Wu, Chen Wei, Quanying Liu

专题命中其他VLM ：multimodal large language model(abstract)

Comments ACM MM 2025

2506.09047 2025-10-06 cs.CL 50%

Same Task, Different Circuits: Disentangling Modality-Specific Mechanisms in VLMs

Yaniv Nikankin, Dana Arad, Yossi Gandelsman, Yonatan Belinkov

机构 * Technion – Israel Institute of Technology（技术学院 – 以色列理工学院）； UC Berkeley（加州大学伯克利分校）

专题命中其他VLM ：vision-language model(abstract)

2507.04952 2025-09-30 cs.CL cs.SE 50%

ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation

Chenchen Zhang, Yuhang Li, Can Xu, Jiaheng Liu, Ao Liu, Changzhi Zhou, Ken Deng, Dengpeng Wu, Guanhua Huang, Kejiao Li, Qi Yi, Ruibin Xiong, Shihui Hu, Yue Zhang, Yuhao Jiang, Zenan Xu, Yuanxing Zhang, Wiggin Zhou, Chayse Zhou, Fengzong Lian

机构 * Tencent Hunyuan Team（腾讯文脉团队）

专题命中其他VLM ：MLLM(abstract)

2507.04415 2025-09-23 cs.CL 50%

MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mind

Emilio Villa-Cueva, S M Masrur Ahmed, Rendi Chevi, Jan Christian Blaise Cruz, Kareem Elzeky, Fermin Cristobal, Alham Fikri Aji, Skyler Wang, Rada Mihalcea, Thamar Solorio

机构 * MBZUAI ； University of Houston（德克萨斯大学休斯顿分校）； McGill University（麦吉尔大学）； University of Michigan（密歇根大学）

专题命中其他VLM ：multimodal large language model(abstract)

2505.24456 2025-09-23 cs.CL 50%

CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation

Emilio Villa-Cueva, Sholpan Bolatzhanova, Diana Turmakhan, Kareem Elzeky, Henok Biadglign Ademtew, Alham Fikri Aji, Vladimir Araujo, Israel Abebe Azime, Jinheon Baek, Frederico Belcavello, Fermin Cristobal, Jan Christian Blaise Cruz, Mary Dabre, Raj Dabre, Toqeer Ehsan, Naome A Etori, Fauzan Farooqui, Jiahui Geng, Guido Ivetta, Thanmay Jayakumar, Soyeong Jeong, Zheng Wei Lim, Aishik Mandal, Sofia Martinelli, Mihail Minkov Mihaylov, Daniil Orel, Aniket Pramanick, Sukannya Purkayastha, Israfel Salazar, Haiyue Song, Tiago Timponi Torrent, Debela Desalegn Yadeta, Injy Hamed, Atnafu Lambebo Tonja, Thamar Solorio

机构 * MBZUAI（人工智能研究所）

专题命中其他VLM ：vision language model(abstract)

2509.15211 2025-09-19 cs.CL 50%

What's the Best Way to Retrieve Slides? A Comparative Study of Multimodal, Caption-Based, and Hybrid Retrieval Techniques

Petros Stylianos Giouroukis, Dimitris Dimitriadis, Dimitrios Papadopoulos, Zhenwen Shao, Grigorios Tsoumakas

机构 * Aristotle University of Thessaloniki（亚里士多德大学）

专题命中其他VLM ：vision-language model(abstract)

2509.14171 2025-09-19 cs.CL 50%

AssoCiAm: A Benchmark for Evaluating Association Thinking while Circumventing Ambiguity

Yifan Liu, Wenkuan Zhao, Shanshan Zhong, Jinghui Qin, Mingfu Liang, Zhongzhan Huang, Wushao Wen

机构 * Sun Yat-sen University（中山大学）； Guangdong University of Technology（广东工业大学）； Northwestern University（西北大学）

专题命中其他VLM ：multimodal large language model(abstract)

Comments Accepted by EMNLP 2025 main track

2504.16405 2025-09-18 cs.MM 50%

EEmo-Bench: A Benchmark for Multi-modal Large Language Models on Image Evoked Emotion Assessment

Lancheng Gao, Ziheng Jia, Yunhao Zeng, Wei Sun, Yiming Zhang, Wei Zhou, Guangtao Zhai, Xiongkuo Min

专题命中其他VLM ：MLLM(abstract)

2509.11065 2025-09-16 cs.SE cs.PL 50%

ViScratch: Using Large Language Models and Gameplay Videos for Automated Feedback in Scratch

Yuan Si, Daming Li, Hanyuan Shi, Jialu Zhang

专题命中其他VLM ：vision-language model(abstract)

2508.15241 2025-09-16 math.OC math.DS 50%

Differential Stochastic Variational Inequalities with Parametric Optimization

Xiaojun Chen, Jian Guo, Guan Wang

专题命中其他VLM ：multimodal large language model(abstract)

Comments 35 pages, 5 figures

2506.04077 2025-09-12 cs.CL cs.SD eess.AS 50%

A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions

Chung-Chun Wang, Jhen-Ke Lin, Hao-Chien Lu, Hong-Yun Lin, Berlin Chen

机构 * National Taiwan Normal University（台湾国立台湾师范大学）

专题命中其他VLM ：multimodal large language model(abstract)

Comments submitted to the ISCA SLaTE-2025 Workshop

2508.21801 2025-09-01 cs.IR 50%

DMGIN: How Multimodal LLMs Enhance Large Recommendation Models for Lifelong User Post-click Behaviors

Zhuoxing Wei, Qingchen Xie, Qi Liu

专题命中其他VLM ：MLLM(abstract)

Comments 8 pages, 5 figures

2508.20660 2025-08-29 eess.AS cs.SD 50%

CodecBench: A Comprehensive Benchmark for Acoustic and Semantic Evaluation

Ruifan Deng, Yitian Gong, Qinghui Gao, Luozhijie Jin, Qinyuan Cheng, Zhaoye Fei, Shimin Li, Xipeng Qiu

机构 * Fudan University（复旦大学）； Shanghai Innovation Institute（上海创新研究院）

专题命中其他VLM ：multimodal large language model(abstract)

2508.02173 2025-08-05 cs.HC 50%

EchoLadder: Progressive AI-Assisted Design of Immersive VR Scenes

Zhuangze Hou, Jingze Tian, Nianlong Li, Farong Ren, Can Liu

专题命中其他VLM ：vision-language model(abstract)

Comments To appear at UIST 2025

2508.01092 2025-08-05 cs.HC 50%

DescribePro: Collaborative Audio Description with Human-AI Interaction

Maryam Cheema, Sina Elahimanesh, Samuel Martin, Pooyan Fazli, Hasti Seifi

专题命中其他VLM ：multimodal large language model(abstract)

Comments ASSETS 25 19 pages, 8 figures

2507.01857 2025-07-03 cs.RO 50%

TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Types

Yuhao Lin, Yi-Lin Wei, Haoran Liao, Mu Lin, Chengyi Xing, Hao Li, Dandan Zhang, Mark Cutkosky, Wei-Shi Zheng

机构 * School of Computer Science and Engineering, Sun Yat-sen University, China（中山大学计算机科学与工程学院）； Stanford University, USA（斯坦福大学）； Imperial College London, UK（伦敦帝国理工学院）

专题命中其他VLM ：MLLM(abstract)

Comments Project Page: https://isee-laboratory.github.io/TypeTele

2506.18711 2025-06-24 cs.HC 50%

LLM-enhanced Interactions in Human-Robot Collaborative Drawing with Older Adults

Marianne Bossema, Somaya Ben Allouch, Aske Plaat, Rob Saunders

专题命中其他VLM ：multimodal large language model(abstract)

2506.16716 2025-06-23 cs.HC 50%

V-CASS: Vision-context-aware Expressive Speech Synthesis for Enhancing User Understanding of Videos

Qixin Wang, Songtao Zhou, Zeyu Jin, Chenglin Guo, Shikun Sun, Xiaoyu Qin

专题命中其他VLM ：vision-language model(abstract)

Comments Accepted by IJCNN 2025

2506.14445 2025-06-18 cs.IR 50%

Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval

Ruofan Hu, Yan Xia, Minjie Hong, Jieming Zhu, Bo Chen, Xiaoda Yang, Minghui Fang, Tao Jin

专题命中其他VLM ：multimodal large language model(abstract)

Comments Accepted by Interspeech 2025

2409.19510 2025-06-17 cs.CL 50%

Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning

Yexing Du, Youcheng Pan, Ziyang Ma, Bo Yang, Yifan Yang, Keqi Deng, Xie Chen, Yang Xiang, Ming Liu, Bing Qin

机构 * Harbin Institute of Technology（哈尔滨工业大学）； Pengcheng Laboratory（鹏城实验室）； Shanghai Jiao Tong University（上海交通大学）； University of Cambridge（剑桥大学）

专题命中其他VLM ：multimodal large language model(abstract)

Comments Accepted in ACL 2025 (Main)

2506.03360 2025-06-05 cs.CL cs.CY cs.SI 50%

A Multimodal, Multilingual, and Multidimensional Pipeline for Fine-grained Crowdsourcing Earthquake Damage Evaluation

Zihui Ma, Lingyao Li, Juan Li, Wenyue Hua, Jingxiao Liu, Qingyuan Feng, Yuki Miura

机构 * New York University（纽约大学）； University of South Florida（佛罗里达州立大学）； Google LLC（谷歌公司）； University of California, Santa Barbara（加州大学圣巴巴拉分校）； Massachusetts Institute of Technology（麻省理工学院）

专题命中其他VLM ：multimodal large language model(abstract)

2505.21389 2025-05-28 cs.CL 50%

AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs

Xuanwen Ding, Chengjun Pan, Zejun Li, Jiwen Zhang, Siyuan Wang, Zhongyu Wei

机构 * Fudan University（复旦大学）； University of Southern California（南加州大学）； Shanghai Innovation Institute（上海创新研究院）

专题命中其他VLM ：multimodal large language model(abstract)

2505.10714 2025-05-27 cs.CL 50%

GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?

Bowen Jiang, Yangxinyu Xie, Xiaomeng Wang, Jiashu He, Joshua Bergerson, John K Hutchison, Jordan Branham, Camillo J Taylor, Tanwi Mallick

专题命中其他VLM ：vision-language model(abstract)

2502.17599 2025-03-14 cs.CL 50%

MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference

Zhongwei Wan, Hui Shen, Xin Wang, Che Liu, Zheda Mai, Mi Zhang

专题命中其他VLM ：multimodal large language model(abstract)

Comments NAACL 2025 Main

2410.11354 2025-03-06 cs.HC 50%

What Social Media Use Do People Regret? An Analysis of 34K Smartphone Screenshots with Multimodal LLM

Longjie Guo, Yue Fu, Xiran Lin, Xuhai "Orson" Xu, Yung-Ju Chang, Alexis Hiniker

专题命中其他VLM ：multimodal large language model(abstract)

Comments Accepted as a CHI 2025 Full Paper

2503.01358 2025-03-04 cs.HC 50%

RemiHaven: Integrating "In-Town" and "Out-of-Town" Peers to Provide Personalized Reminiscence Support for Older Drifters

Xuechen Zhang, Changyang He, Peng Zhang, Hansu Gu, Ning Gu, Qi Shen, Zhan Hu, Tun Lu

专题命中其他VLM ：multimodal large language model(abstract)

2405.13576 2025-02-25 cs.CL cs.IR 50%

FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Research

Jiajie Jin, Yutao Zhu, Guanting Dong, Yuyao Zhang, Xinyu Yang, Chenghao Zhang, Tong Zhao, Zhao Yang, Zhicheng Dou, Ji-Rong Wen

专题命中其他VLM ：multimodal large language model(abstract)

Comments The paper is accepted by WWW2025 Resource Track

2502.13766 2025-02-20 cs.CL 50%

GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking

Florian Schneider, Carolin Holtermann, Chris Biemann, Anne Lauscher

专题命中其他VLM ：vision-language model(abstract)

2502.12852 2025-02-19 cs.CL 50%

MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching

Fabian David Schmidt, Florian Schneider, Chris Biemann, Goran Glavaš

专题命中其他VLM ：vision-language model(abstract)

2412.18940 2025-02-17 cs.HC 50%

Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations

Yewon Kim, Sung-Ju Lee, Chris Donahue

专题命中其他VLM ：multimodal large language model(abstract)

Comments Published as a conference paper at CHI 2025. Project page: https://yewon-kim.com/amuse

1. 其他VLM 1583 篇

BrainFLORA: Uncovering Brain Concept Representation via Multimodal Neural Embeddings

Same Task, Different Circuits: Disentangling Modality-Specific Mechanisms in VLMs

ArtifactsBench: Bridging the Visual-Interactive Gap in LLM Code Generation Evaluation

MOMENTS: A Comprehensive Multimodal Benchmark for Theory of Mind

CaMMT: Benchmarking Culturally Aware Multimodal Machine Translation

What's the Best Way to Retrieve Slides? A Comparative Study of Multimodal, Caption-Based, and Hybrid Retrieval Techniques

AssoCiAm: A Benchmark for Evaluating Association Thinking while Circumventing Ambiguity

EEmo-Bench: A Benchmark for Multi-modal Large Language Models on Image Evoked Emotion Assessment

ViScratch: Using Large Language Models and Gameplay Videos for Automated Feedback in Scratch

Differential Stochastic Variational Inequalities with Parametric Optimization

A Novel Data Augmentation Approach for Automatic Speaking Assessment on Opinion Expressions

DMGIN: How Multimodal LLMs Enhance Large Recommendation Models for Lifelong User Post-click Behaviors

CodecBench: A Comprehensive Benchmark for Acoustic and Semantic Evaluation

EchoLadder: Progressive AI-Assisted Design of Immersive VR Scenes

DescribePro: Collaborative Audio Description with Human-AI Interaction

TypeTele: Releasing Dexterity in Teleoperation by Dexterous Manipulation Types

LLM-enhanced Interactions in Human-Robot Collaborative Drawing with Older Adults

V-CASS: Vision-context-aware Expressive Speech Synthesis for Enhancing User Understanding of Videos

Vela: Scalable Embeddings with Voice Large Language Models for Multimodal Retrieval

Making LLMs Better Many-to-Many Speech-to-Text Translators with Curriculum Learning

A Multimodal, Multilingual, and Multidimensional Pipeline for Fine-grained Crowdsourcing Earthquake Damage Evaluation

AutoJudger: An Agent-Driven Framework for Efficient Benchmarking of MLLMs

GeoGrid-Bench: Can Foundation Models Understand Multimodal Gridded Geo-Spatial Data?

MEDA: Dynamic KV Cache Allocation for Efficient Multimodal Long-Context Inference

What Social Media Use Do People Regret? An Analysis of 34K Smartphone Screenshots with Multimodal LLM

RemiHaven: Integrating "In-Town" and "Out-of-Town" Peers to Provide Personalized Reminiscence Support for Older Drifters

FlashRAG: A Modular Toolkit for Efficient Retrieval-Augmented Generation Research

GIMMICK -- Globally Inclusive Multimodal Multitask Cultural Knowledge Benchmarking

MVL-SIB: A Massively Multilingual Vision-Language Benchmark for Cross-Modal Topical Matching

Amuse: Human-AI Collaborative Songwriting with Multimodal Inspirations