多模态大模型

LightEMMA: Lightweight End-to-End Multimodal Model for Autonomous Driving

Zhijie Qiao, Haowei Li, Zhong Cao, Henry X. Liu

机构 * Department of Civil and Environmental Engineering, University of Michigan（土木与环境工程系，密歇根大学） ； University of Michigan Transportation Research Institute（密歇根大学交通研究所） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

CLAPS: A CLIP-Unified Auto-Prompt Segmentation for Multi-Modal Retinal Imaging

Zhihao Zhao, Yinzheng Zhao, Junjie Yang, Xiangtong Yao, Quanmin Liang, Shahrooz Faghihroohi, Kai Huang, Nassir Navab, M. Ali Nasseri

机构 * Technical University of Munich（慕尼黑技术大学） ； Sun Yat-Sen University（中山大学） 纠错

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments BIBM

BadPromptFL: A Novel Backdoor Threat to Prompt-based Federated Learning in Multimodal Models

Maozhen Zhang, Mengnan Zhao, Wei Wang, Bo Wang

机构 * School of Information and Communication Engineering, Dalian University of Technology（信息与通信工程学院，大连理工大学） ； School of Computer Science and Technology, Anhui University（计算机科学与技术学院，安徽大学） ； New Laboratory of Pattern Recognition (NLPR) State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS) Institute of Automation, Chinese Academy of Sciences (CASIA)（模式识别新实验室（NLPR）多模态人工智能系统国家重点实验室（MAIS）自动化研究所，中国科学院（CASIA）） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

OVGrasp: Open-Vocabulary Grasping Assistance via Multimodal Intent Detection

Chen Hu, Shan Luo, Letizia Gionfrida

机构 * Department of Informatics, King's College London（伦敦国王学院信息学院） ； Department of Engineering, King's College London（伦敦国王学院工程学院） ； John A. Paulson School of Engineering and Applied Sciences, Harvard University（哈佛大学约翰·A·保罗森工程与应用科学学院） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

ChordPrompt: Orchestrating Cross-Modal Prompt Synergy for Multi-Domain Incremental Learning in CLIP

Zhiyuan Wang, Bokui Chen

机构 * Tsinghua Shenzhen International Graduate School, Tsinghua University, China（清华大学深圳国际研究生院，清华大学，中国） 纠错

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.AI

Comments Accepted by the European Conference on Machine Learning and Principles and Practice of Knowledge Discovery in Databases (ECML-PKDD 2025)

Scale, Don't Fine-tune: Guiding Multimodal LLMs for Efficient Visual Place Recognition at Test-Time

Jintao Cheng, Weibin Li, Jiehao Luo, Xiaoyu Tang, Zhijian He, Jin Wu, Yao Zou, Wei Zhang

机构 * Hong Kong University of Science（香港科学与技术大学） ； South China Normal University, Shanwei, Guangdong, China（华南师范大学，汕尾，广东，中国） ； Shenzhen Technology University, Shenzhen, Guangdong, China（深圳科技大学，深圳，广东，中国） ； University of Science（科学大学） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

FedMVP: Federated Multimodal Visual Prompt Tuning for Vision-Language Models

Mainak Singha, Subhankar Roy, Sarthak Mehrotra, Ankit Jha, Moloud Abdar, Biplab Banerjee, Elisa Ricci

机构 * University of Trento（特伦托大学） ； University of Bergamo（贝拉姆奥大学） ； Indian Institute of Technology Bombay（印度班加罗尔理工学院） ； LNMIIT Jaipur（斋普尔LNMIIT） ； The University of Queensland（昆士兰大学） ； Fondazione Bruno Kessler（布鲁诺·凯塞勒基金会） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted in ICCV 2025

ZoomEye: Enhancing Multimodal LLMs with Human-Like Zooming Capabilities through Tree-Based Image Exploration

Haozhan Shen, Kangjia Zhao, Tiancheng Zhao, Ruochen Xu, Zilun Zhang, Mingwei Zhu, Jianwei Yin

机构 * Zhejiang University（浙江大学） ； Om AI Research（Om AI 研究所） ； Binjiang Institute of Zhejiang University（浙江大学滨江研究院） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by EMNLP-2025 Main. Project page: https://szhanz.github.io/zoomeye/

ABC: Achieving Better Control of Multimodal Embeddings using VLMs

Benjamin Schneider, Florian Kerschbaum, Wenhu Chen

机构 * University of Waterloo（滑铁卢大学） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments TMLR 2025

M3PO: Multimodal-Model-Guided Preference Optimization for Visual Instruction Following

Ruirui Gao, Emily Johnson, Bowen Tan, Yanfei Qian

机构 * University of Massachusetts, Amherst（马萨诸塞大学阿姆赫斯特分校） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Exploring Multimodal AI Reasoning for Meteorological Forecasting from Skew-T Diagrams

ChangJae Lee, Heecheol Yang, Jonghak Choi

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 24 pages, 3 figures, 9 tables

Infusing fine-grained visual knowledge to Vision-Language Models

Nikolaos-Antonios Ypsilantis, Kaifeng Chen, André Araujo, Ondřej Chum

机构 * VRG, FEE, Czech Technical University in Prague（捷克布拉格技术大学） 纠错

专题命中 图文多模态 ：multimodal(abstract,comments)；cross-modal(abstract)；image-text(abstract)；分类 cs.CV

Comments ICCVW 2025 accepted paper. Workshop name: "What is Next in Multimodal Foundation Models?"

DiFaR: Enhancing Multimodal Misinformation Detection with Diverse, Factual, and Relevant Rationales

Herun Wan, Jiaying Wu, Minnan Luo, Xiangzheng Kong, Zihan Ma, Zhi Zeng

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Hierarchical Cross-modal Prompt Learning for Vision-Language Models

Hao Zheng, Shunzhi Yang, Zhuoxin He, Jinfeng Yang, Zhenhua Huang

机构 * South China Normal University（华南师范大学） ； Shenzhen Polytechnic University（深圳职业技术大学） 纠错

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICCV2025

ContextGuard-LVLM: Enhancing News Veracity through Fine-grained Cross-modal Contextual Consistency Verification

Sihan Ma, Qiming Wu, Ruotong Jiang, Frank Burns

机构 * Inner Mongolia University of Science & Technology（内蒙古科技大学） ； Federal University of Rio de Janeiro（里约热内卢联邦大学） 纠错

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Fine-Grained Image-Text Correspondence with Cost Aggregation for Open-Vocabulary Part Segmentation

Jiho Choi, Seonho Lee, Minhyun Lee, Seungho Lee, Hyunjung Shim

机构 * KAIST, Republic of Korea（韩国科学技术院） ； Samsung Electronics, Republic of Korea（三星电子） 纠错

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments CVPR 2025

StructVRM: Aligning Multimodal Reasoning with Structured and Verifiable Reward Models

Xiangxiang Zhang, Jingxuan Wei, Donghong Zhong, Qi Chen, Caijun Jia, Cheng Tan, Jinming Gu, Xiaobo Qin, Zhiping Liu, Liang Hu, Tong Sun, Yuchen Wu, Zewei Sun, Chenwei Lou, Hua Zheng, Tianyang Zhan, Changbao Wang, Shuangzhi Wu, Zefa Lin, Chang Guo, Sihang Yuan, Riwei Chen, Shixiong Zhao, Yingping Zhang, Gaowei Wu, Bihui Yu, Jiahui Wu, Zhehui Zhao, Qianqian Liu, Ruofeng Tang, Xingyue Huang, Bing Zhao, Mengyang Zhang, Youqiang Zhou

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.AI

Dual-Stream Attention with Multi-Modal Queries for Object Detection in Transportation Applications

Noreen Anwar, Guillaume-Alexandre Bilodeau, Wassim Bouachir

机构 * LITIV, Polytechnique Montréal（Polytechnique Montréal 的 LITIV） ； Data Science Laboratory, Université du Québec (TELUQ)（Université du Québec (TELUQ) 的 Data Science Laboratory） 纠错

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 10 pages

Dual Prompt Learning for Adapting Vision-Language Models to Downstream Image-Text Retrieval

Yifan Wang, Tao Wang, Chenwei Tang, Caiyang Yu, Zhengqing Zang, Mengmi Zhang, Shudong Huang, Jiancheng Lv

机构 * College of Computer Science, Sichuan University（四川大学计算机学院） ； Engineering Research Center of Machine Learning and Industry Intelligence, Ministry of Education, Chengdu, China（教育部机器学习与产业智能工程研究中心） ； Deep NeuroCognition Lab, I2R and CFAR, Agency for Science, Technology and Research, Singapore（深度神经认知实验室，I2R和CFAR，科技研究局，新加坡） 纠错

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Comments 10 pages, 7figures

GLDesigner: Leveraging Multi-Modal LLMs as Designer for Enhanced Aesthetic Text Glyph Layouts

Junwen He, Yifan Wang, Lijun Wang, Huchuan Lu, Jun-Yan He, Chenyang Li, Hanyuan Chen, Jin-Peng Lan, Bin Luo, Yifeng Geng

机构 * Dalian University of Technology（大连理工大学） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 图文多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments ACM Multimedia 2025

MuSciClaims: Multimodal Scientific Claim Verification

Yash Kumar Lal, Manikanta Bandham, Mohammad Saqib Hasan, Apoorva Kashi, Mahnaz Koupaee, Niranjan Balasubramanian

机构 * Stony Brook University（石溪大学） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

LMM-Det: Make Large Multimodal Models Excel in Object Detection

Jincheng Li, Chunyu Xie, Ji Ao, Dawei Leng, Yuhui Yin

机构 * AI Research（360人工智能研究院） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted at ICCV 2025

Pixels to Principles: Probing Intuitive Physics Understanding in Multimodal Language Models

Mohamad Ballout, Serwan Jassim, Elia Bruni

机构 * Institute of Cognitive Science, University of Osnabrück（认知科学研究所，奥斯纳布吕克大学） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CL

Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment

Angelos Zavras, Dimitrios Michail, Begüm Demir, Ioannis Papoutsis

机构 * organization= Orion Lab, National Observatory of Athens \& National Technical University of Athens , country= Greece ； organization= Department of Informatics \& Telematics, Harokopio University of Athens , country= Greece ； organization= Faculty of Electrical Engineering ； organization= BIFOLD - Berlin Institute for the Foundations of Learning 纠错

专题命中 图文多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments Accepted at the ISPRS Journal of Photogrammetry and Remote Sensing. Our code implementation and weights for all experiments are publicly available at https://github.com/Orion-AI-Lab/MindTheModalityGap

CoSMo: A Multimodal Transformer for Page Stream Segmentation in Comic Books

Marc Serra Ortega, Emanuele Vivoli, Artemis Llabrés, Dimosthenis Karatzas

机构 * Computer Vision Center and Universitat Autònoma de Barcelona（计算机视觉中心和巴塞罗那自治大学） ； MICC, University of Florence, Italy（佛罗伦萨大学MICC） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV

RT-OVAD: Real-Time Open-Vocabulary Aerial Object Detection via Image-Text Collaboration

Guoting Wei, Xia Yuan, Yu Liu, Zhenhao Shang, Xizhe Xue, Peng Wang, Kelu Yao, Chunxia Zhao, Haokui Zhang, Rong Xiao

机构 * Nanjing University of Science and Technology（南京理工大学） ； Northwestern Polytechnical University（西北工业大学） ； Zhejiang Lab（浙江实验室） ； Intellifusion Inc.（Intellifusion公司） 纠错

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

SVLA: A Unified Speech-Vision-Language Assistant with Multimodal Reasoning and Speech Generation

Ngoc Dung Huynh, Mohamed Reda Bouadjenek, Imran Razzak, Hakim Hacid, Sunil Aryal

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.MM

Comments 21 pages

Image-text matching for large-scale book collections

Artemis Llabrés, Arka Ujjal Dey, Dimosthenis Karatzas, Ernest Valveny

机构 * Computer Vision Center, UAB（计算机视觉中心，巴塞罗那大学） 纠错

专题命中 图文多模态 ：image-text(title,abstract)；分类 cs.CV

Journal ref Document Analysis Systems, Lecture Notes in Computer Science, vol. 14994, pp. 89-102, Springer, 2024

E-FreeM2: Efficient Training-Free Multi-Scale and Cross-Modal News Verification via MLLMs

Van-Hoang Phan, Long-Khanh Pham, Dang Vu, Anh-Duy Tran, Minh-Son Dao

专题命中 图文多模态 ：cross-modal(title)；multimodal(abstract)；分类 cs.MM

Comments Accepted to AsiaCCS 2025 @ SCID

PostAlign: Multimodal Grounding as a Corrective Lens for MLLMs

Yixuan Wu, Yang Zhang, Jian Wu, Philip Torr, Jindong Gu

机构 * University of Oxford（牛津大学） ； Zhejiang University（浙江大学） ； National University of Singapore（新加坡国立大学） 纠错

专题命中 图文多模态 ：multimodal(title,abstract)；分类 cs.CV