多模态大模型 - arXivDaily 专题

2506.18369 2025-10-13 cs.CV 83%

RePIC: Reinforced Post-Training for Personalizing Multi-Modal Language Models

Yeongtak Oh, Dohyun Chung, Juhyeon Shin, Sangha Park, Johan Barthelemy, Jisoo Mok, Sungroh Yoon

专题命中图文多模态：multi-modal(title,abstract)；MLLM(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2025

2510.07567 2025-10-10 cs.CV 83%

Cross-Modal Attention Guided Unlearning in Vision-Language Models

Karuna Bhaila, Aneesh Komanduri, Minh-Hao Van, Xintao Wu

专题命中图文多模态：cross-modal(title,abstract)；multi-modal(abstract)；分类 cs.CV

2508.07216 2025-10-08 cs.CV 83%

Bridging Semantic Logic Gaps: A Cognition Inspired Multimodal Boundary Preserving Network for Image Manipulation Localization

Songlin Li, Zhiqing Guo, Yuanman Li, Zeyu Li, Yunfeng Diao, Gaobo Yang, Liejun Wang

机构 * School of Computer Science and Technology, Xinjiang University（新疆大学计算机科学与技术学院）； School of Electronic and Information Engineering, Shenzhen University（深圳大学电子与信息工程学院）； College of Computer Science and Electronic Engineering, Hunan University（湖南大学计算机科学与电子工程学院）； School of Computer Science and Information Engineering, Hefei University of Technology（合肥工业大学计算机科学与信息工程学院）

专题命中图文多模态：multimodal(title,abstract)；image-text(abstract)；分类 cs.CV

2510.02608 2025-10-07 cs.AI 83%

Mitigating Modal Imbalance in Multimodal Reasoning

Chen Henry Wu, Neil Kale, Aditi Raghunathan

专题命中图文多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.AI

Comments 10 pages, 10 figures, CoLM 2025

2509.23673 2025-09-30 cs.CV cs.AI cs.CL cs.MM 83%

RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks

Amit Agarwal, Hitesh Laxmichand Patel, Srikant Panda, Hansa Meghwani, Jyotika Singh, Karan Dua, Paul Li, Tao Sheng, Sujith Ravi, Dan Roth

机构 * Oracle AI

专题命中图文多模态：multimodal(title,abstract)；分类 cs.CV、cs.CL、cs.AI

Comments Accepted in EMNLP 2025

2508.12587 2025-09-25 cs.CV 83%

Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models

Tan-Hanh Pham, Chris Ngo

机构 * Harvard Medical School, Harvard University（哈佛医学院、哈佛大学）； Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital（阿提尼乌拉A.马丁努斯生物医学成像中心、麻省总医院）； Knovel Engineering Lab, Singapore（Knovel工程实验室、新加坡）

专题命中图文多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CV

2509.08742 2025-09-11 q-fin.CP cs.AI 83%

FinZero: Launching Multi-modal Financial Time Series Forecast with Large Reasoning Model

Yanlong Wang, Jian Xu, Fei Ma, Hongkang Zhang, Hang Yu, Tiantian Gao, Yu Wang, Haochen You, Shao-Lun Huang, Danny Dongning Sun, Xiao-Ping Zhang

机构 * Tsinghua University（清华大学）； Pengcheng Laboratory（鹏城实验室）； Guangming Laboratory（光明实验室）； Ant Group（蚂蚁集团）； Columbia University（哥伦比亚大学）； Southern University of Science and Technology（南方科技大学）

专题命中图文多模态：multi-modal(title)；multimodal(abstract)；image-text(abstract)；分类 cs.AI

2509.08715 2025-09-11 cs.CV 83%

BcQLM: Efficient Vision-Language Understanding with Distilled Q-Gated Cross-Modal Fusion

Sike Xiang, Shuang Chen, Amir Atapour-Abarghouei

机构 * Department of Computer Science, Durham University（计算机科学系，杜伦大学）

专题命中图文多模态：cross-modal(title)；multimodal(abstract)；MLLM(abstract)；分类 cs.CV

2509.01644 2025-09-03 cs.CV 83%

OpenVision 2: A Family of Generative Pretrained Visual Encoders for Multimodal Learning

Yanqing Liu, Xianhang Li, Letian Zhang, Zirui Wang, Zeyu Zheng, Yuyin Zhou, Cihang Xie

机构 * University of California Santa Cruz（加州大学圣克鲁兹分校）； Apple（苹果公司）； University of California Berkeley（加州大学伯克利分校）

专题命中图文多模态：multimodal(title,abstract)；multimodal foundation model(abstract)；分类 cs.CV

2509.00039 2025-09-03 cs.CV 83%

AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Models

Yuqi Li, Chuanguang Yang, Junhao Dong, Zhengtao Yao, Haoyan Xu, Zeyu Dong, Hansheng Zeng, Zhulin An, Yingli Tian

专题命中图文多模态：multimodal(title)；multi-modal(abstract)；image-text(abstract)；分类 cs.CV

Comments 9 pages

2405.11793 2025-08-27 cs.CV 83%

MM-Retinal: Knowledge-Enhanced Foundational Pretraining with Fundus Image-Text Expertise

Ruiqi Wu, Chenran Zhang, Jianle Zhang, Yi Zhou, Tao Zhou, Huazhu Fu

机构 * School of Computer Science and Engineering, Southeast University, China（东南大学计算机科学与工程学院）； Key Laboratory of New Generation Artificial Intelligence Technology and Its Interdisciplinary Applications, Ministry of Education, China（教育部新一代人工智能技术及其交叉应用重点实验室）； Nanjing University of Science and Technology, Nanjing, China（南京理工大学）； Agency for Science, Technology and Research (A*STAR), Singapore（新加坡科技研究局）

专题命中图文多模态：image-text(title,abstract)；multi-modal(abstract)；分类 cs.CV

Comments Early Accepted by The International Conference on Medical Image Computing and Computer Assisted Intervention(MICCAI)2024

2508.17037 2025-08-26 cs.CV 83%

F4-ITS: Fine-grained Feature Fusion for Food Image-Text Search

Raghul Asokan

机构 * HyperVerge

专题命中图文多模态：image-text(title,abstract)；multi-modal(abstract)；分类 cs.CV

2508.16762 2025-08-26 cs.CL cs.CY 83%

Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation

Arka Mukherjee, Shreya Ghosh

机构 * KIIT Deemed University（KIIT大学）； Indian Institute of Technology (IIT) Bhubaneswar（印度理工学院（Bhubaneswar分校））

专题命中图文多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CL

Comments Accepted at ASI @ ICCV 2025

2508.07414 2025-08-13 cs.CL cs.LG 83%

Grounding Multilingual Multimodal LLMs With Cultural Knowledge

Jean de Dieu Nyandwi, Yueqi Song, Simran Khanuja, Graham Neubig

机构 * Carnegie Mellon University（卡内基梅隆大学）

专题命中图文多模态：multimodal(title,abstract)；MLLM(abstract)；分类 cs.CL

2508.05167 2025-08-08 cs.CV 83%

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems

Qi Guo, Xiaojun Jia, Shanmin Pang, Simeng Qin, Lin Wang, Ju Jia, Yang Liu, Qing Guo

专题命中图文多模态：multimodal(title,abstract)；MLLM(abstract)；分类 cs.CV

2508.04175 2025-08-07 cs.CV 83%

AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimization

Jingyi Liao, Yongyi Su, Rong-Cheng Tu, Zhao Jin, Wenhao Sun, Yiting Li, Dacheng Tao, Xun Xu, Xulei Yang

专题命中图文多模态：multimodal(title,abstract)；MLLM(abstract)；分类 cs.CV

2502.12513 2025-08-06 cs.CV 83%

RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm

Tiancheng Gu, Kaicheng Yang, Chaoyi Zhang, Yin Xie, Xiang An, Ziyong Feng, Dongnan Liu, Weidong Cai, Jiankang Deng

机构 * The University of Sydney（悉尼大学）； DeepGlint ； Imperial College London（伦敦帝国学院）

专题命中图文多模态：multimodal(title,abstract)；image-text(abstract)；分类 cs.CV

Comments 15 pages, 12 figures, Accepted by ACM MM2025, Webpage: https://garygutc.github.io/RealSyn

2508.01254 2025-08-05 cs.CV 83%

Self-Enhanced Image Clustering with Cross-Modal Semantic Consistency

Zihan Li, Wei Sun, Jing Hu, Jianhua Yin, Jianlong Wu, Liqiang Nie

专题命中图文多模态：cross-modal(title,abstract)；image-text(abstract)；分类 cs.CV

2507.22431 2025-07-31 cs.CV 83%

HQ-CLIP: Leveraging Large Vision-Language Models to Create High-Quality Image-Text Datasets and CLIP Models

Zhixiang Wei, Guangting Wang, Xiaoxiao Ma, Ke Mei, Huaian Chen, Yi Jin, Fengyun Rao

机构 * University of Science and Technology of China（中国科学技术大学）； WeChat Vision, Tencent Inc.（腾讯公司）

专题命中图文多模态：image-text(title,abstract)；cross-modal(abstract)；分类 cs.CV

2507.22074 2025-07-31 cs.LG cs.CL 83%

CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs

Yangshu Yuan, Heng Chen, Xinyi Jiang, Christian Ng, Kexin Qiu

机构 * Singapore Institute of Management（新加坡管理学院）

专题命中图文多模态：multimodal(title,abstract)；multi-modal(abstract)；分类 cs.CL

2502.15910 2025-07-24 cs.CL 83%

Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models

Zheyuan Liu, Guangyao Dou, Xiangchi Yuan, Chunhui Zhang, Zhaoxuan Tan, Meng Jiang

机构 * University of Notre Dame（诺丁汉大学）； University of Pennsylvania（宾夕法尼亚大学）； Georgia Institute of Technology（佐治亚理工学院）； Dartmouth College（达特茅斯学院）

专题命中图文多模态：multimodal(title,abstract)；MLLM(abstract)；分类 cs.CL

Comments ACL 2025 Main Conference

2503.06312 2025-07-23 cs.CV 83%

DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observation

Zhitong Xiong, Yi Wang, Weikang Yu, Adam J Stewart, Jie Zhao, Nils Lehmann, Thomas Dujardin, Zhenghang Yuan, Pedram Ghamisi, Xiao Xiang Zhu

机构 * Technical University of Munich（慕尼黑技术大学）； Helmholtz-Zentrum Dresden-Rossendorf（德累斯顿-罗斯托克亥姆霍尔茨中心）

专题命中图文多模态：multimodal(title,abstract)；image-text(abstract)；分类 cs.CV

Comments code & weights: https://github.com/xiong-zhitong/DOFA-CLIP

2507.08410 2025-07-14 cs.CV 83%

Multi-modal Mutual-Guidance Conditional Prompt Learning for Vision-Language Models

Shijun Yang, Xiang Zhang, Wanqing Zhao, Hangzai Luo, Sheng Zhong, Jinye Peng, Jianping Fan

机构 * School of Information and Technology, Northwest University（信息与技术学院，西北大学）

专题命中图文多模态：multi-modal(title,abstract)；cross-modal(abstract)；分类 cs.CV

Comments 21 pages, 8 figures

2507.00926 2025-07-02 cs.MM cs.LG 83%

HyperFusion: Hierarchical Multimodal Ensemble Learning for Social Media Popularity Prediction

Liliang Ye, Yunyao Zhang, Yafeng Wu, Yi-Ping Phoebe Chen, Junqing Yu, Wei Yang, Zikai Song

机构 * Huazhong University of Science and Technology（华中科技大学）； La Trobe University（拉特罗布大学）

专题命中图文多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.MM

2503.19564 2025-07-01 cs.LG cs.AI 83%

FedMM-X: A Trustworthy and Interpretable Framework for Federated Multi-Modal Learning in Dynamic Environments

Sree Bhargavi Balija

机构 * University of California, San Diego（加州大学圣地亚哥分校）

专题命中图文多模态：multi-modal(title,abstract)；cross-modal(abstract)；分类 cs.AI

2506.12724 2025-06-17 cs.CV 83%

Dynamic Modality Scheduling for Multimodal Large Models via Confidence, Uncertainty, and Semantic Consistency

Hiroshi Tanaka, Anika Rao, Hana Satou, Michael Johnson, Sofia García

专题命中图文多模态：multimodal(title,abstract)；image-text(abstract)；分类 cs.CV

2402.04416 2025-06-11 cs.CV cs.LG 83%

Multimodal Unsupervised Domain Generalization by Retrieving Across the Modality Gap

Christopher Liao, Christian So, Theodoros Tsiligkaridis, Brian Kulis

机构 * Boston University（波士顿大学）； MIT Lincoln Laboratory（麻省理工学院林肯实验室）

专题命中图文多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CV

2506.01307 2025-06-03 cs.CR cs.AI 83%

Align is not Enough: Multimodal Universal Jailbreak Attack against Multimodal Large Language Models

Youze Wang, Wenbo Hu, Yinpeng Dong, Jing Liu, Hanwang Zhang, Richang Hong

机构 * School of Computer Science and Information Engineering, Hefei University of Technology（合肥工业大学计算机科学与信息工程学院）； Tsinghua University（清华大学）； Institute of automation, Chinese academy of science（中国科学院自动化研究所）； School of Computer Science and Engineering, Nanyang Technological University（南洋理工大学计算机科学与工程学院）

专题命中图文多模态：multimodal(title,abstract)；image-text(abstract)；分类 cs.AI

2506.00903 2025-06-03 cs.CV 83%

Leveraging CLIP Encoder for Multimodal Emotion Recognition

Yehun Song, Sunyoung Cho

机构 * Agency for Defense Development（国防发展机构）； Sookmyung Women’s University（苏镜女子大学）

专题命中图文多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.CV

Comments Accepted at IEEE/CVF WACV 2025, pp.6115-6124, 2025

Journal ref Proceedings of the Winter Conference on Applications of Computer Vision (WACV), 2025, pp.6115-6124

2308.12636 2025-06-03 cs.MM 83%

Exploring Transferability of Multimodal Adversarial Samples for Vision-Language Pre-training Models with Contrastive Learning

Youze Wang, Wenbo Hu, Yinpeng Dong, Hanwang Zhang, Hang Su, Richang Hong

专题命中图文多模态：multimodal(title,abstract)；image-text(abstract)；分类 cs.MM

1. 图文多模态 4682 篇

RePIC: Reinforced Post-Training for Personalizing Multi-Modal Language Models

Cross-Modal Attention Guided Unlearning in Vision-Language Models

Bridging Semantic Logic Gaps: A Cognition Inspired Multimodal Boundary Preserving Network for Image Manipulation Localization

Mitigating Modal Imbalance in Multimodal Reasoning

RCI: A Score for Evaluating Global and Local Reasoning in Multimodal Benchmarks

Multimodal Chain of Continuous Thought for Latent-Space Reasoning in Vision-Language Models

FinZero: Launching Multi-modal Financial Time Series Forecast with Large Reasoning Model

BcQLM: Efficient Vision-Language Understanding with Distilled Q-Gated Cross-Modal Fusion

OpenVision 2: A Family of Generative Pretrained Visual Encoders for Multimodal Learning

AMMKD: Adaptive Multimodal Multi-teacher Distillation for Lightweight Vision-Language Models

MM-Retinal: Knowledge-Enhanced Foundational Pretraining with Fundus Image-Text Expertise

F4-ITS: Fine-grained Feature Fusion for Food Image-Text Search

Toward Socially Aware Vision-Language Models: Evaluating Cultural Competence Through Multimodal Story Generation

Grounding Multilingual Multimodal LLMs With Cultural Knowledge

PhysPatch: A Physically Realizable and Transferable Adversarial Patch Attack for Multimodal Large Language Models-based Autonomous Driving Systems

AD-FM: Multimodal LLMs for Anomaly Detection via Multi-Stage Reasoning and Fine-Grained Reward Optimization

RealSyn: An Effective and Scalable Multimodal Interleaved Document Transformation Paradigm

Self-Enhanced Image Clustering with Cross-Modal Semantic Consistency

HQ-CLIP: Leveraging Large Vision-Language Models to Create High-Quality Image-Text Datasets and CLIP Models

CIMR: Contextualized Iterative Multimodal Reasoning for Robust Instruction Following in LVLMs

Modality-Aware Neuron Pruning for Unlearning in Multimodal Large Language Models

DOFA-CLIP: Multimodal Vision-Language Foundation Models for Earth Observation

Multi-modal Mutual-Guidance Conditional Prompt Learning for Vision-Language Models

HyperFusion: Hierarchical Multimodal Ensemble Learning for Social Media Popularity Prediction

FedMM-X: A Trustworthy and Interpretable Framework for Federated Multi-Modal Learning in Dynamic Environments

Dynamic Modality Scheduling for Multimodal Large Models via Confidence, Uncertainty, and Semantic Consistency

Multimodal Unsupervised Domain Generalization by Retrieving Across the Modality Gap

Align is not Enough: Multimodal Universal Jailbreak Attack against Multimodal Large Language Models

Leveraging CLIP Encoder for Multimodal Emotion Recognition

Exploring Transferability of Multimodal Adversarial Samples for Vision-Language Pre-training Models with Contrastive Learning