AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

2025-09-08 至 2025-09-08 共收录 38 篇信号源：cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6 篇

2509.04938 2025-09-08 cs.MM 83%

An Emotion Recognition Framework via Cross-modal Alignment of EEG and Eye Movement Data

Jianlu Wang, Yanan Wang, Tong Liu

专题命中多模态训练与对齐：cross-modal(title,abstract)；multimodal(abstract)；分类 cs.MM

2503.20309 2025-09-08 cs.CV 83%

Instruction-Oriented Preference Alignment for Enhancing Multi-Modal Comprehension Capability of MLLMs

Zitian Wang, Yue Liao, Kang Rong, Fengyun Rao, Yibo Yang, Si Liu

机构 * Beihang University（北航大学）； National University of Singapore（国立新加坡大学）； King Abdullah University of Science and Technology（国王 Abdullah 科学与技术大学）

专题命中多模态训练与对齐：multi-modal(title,abstract)；multimodal(abstract)；分类 cs.CV

Comments Accepted by ICCV 2025

2505.17114 2025-09-08 cs.CL cs.CV cs.LG cs.MM 80%

RAVEN: Query-Guided Representation Alignment for Question Answering over Audio, Video, Embedded Sensors, and Natural Language

Subrata Biswas, Mohammad Nur Hossain Khan, Bashima Islam

专题命中多模态训练与对齐：multimodal(abstract)；multi-modal(abstract)；cross-modal(abstract)；分类 cs.CV、cs.CL、cs.MM

2509.04480 2025-09-08 cs.CL cs.LG 79%

Discrete Prompt Tuning via Recursive Utilization of Black-box Multimodal Large Language Model for Personalized Visual Emotion Recognition

Ryo Takahashi, Naoki Saito, Keisuke Maeda, Takahiro Ogawa, Miki Haseyama

机构 * Graduate School of Information Science（信息科学研究生学校）； Technology, Hokkaido University, Sapporo 060-0814, Japan（技术，北海道大学，札幌060-0814，日本）； Office of Institutional Research, Hokkaido University, Sapporo 060-0808, Japan（机构研究办公室，北海道大学，札幌060-0808，日本）； Faculty of Information Science（信息科学学院）

专题命中多模态训练与对齐：multimodal(title,abstract)；分类 cs.CL

Comments 11 pages, 4 figures

2408.11813 2025-09-08 cs.CV 70%

SEA: Supervised Embedding Alignment for Token-Level Visual-Textual Integration in MLLMs

Yuanyang Yin, Yaqi Zhao, Yajie Zhang, Yuanxing Zhang, Ke Lin, Jiahao Wang, Xin Tao, Pengfei Wan, Wentao Zhang, Feng Zhao

机构 * University of Science and Technology of China（中国科学技术大学）； Peking University（北京大学）； Kuaishou Technology（快手科技）

专题命中多模态训练与对齐：multimodal(abstract)；cross-modal(abstract)；分类 cs.CV

2509.05000 2025-09-08 cs.CV 57%

Dual-Domain Perspective on Degradation-Aware Fusion: A VLM-Guided Robust Infrared and Visible Image Fusion Framework

Tianpei Zhang, Jufeng Zhao, Yiming Zhu, Guangmang Cui

专题命中多模态训练与对齐：cross-modal(abstract)；分类 cs.CV

2. 其他多模态 2 篇

2509.02281 2025-09-08 cs.LG cs.MM 83%

Balanced Multimodal Learning: An Unidirectional Dynamic Interaction Perspective

Shijie Wang, Li Zhang, Xinyan Liang, Yuhua Qian, Shen Hu

机构 * Institute of Big Data Science and Industry（大数据科学与产业研究院）； Key Laboratory of Evolutionary Science Intelligence of Shanxi Province（山西省进化智能科学重点实验室）； Shanxi University（山西大学）

专题命中其他多模态：multimodal(title,abstract)；cross-modal(abstract)；分类 cs.MM

2509.05034 2025-09-08 cs.CV cs.AI 62%

Towards Efficient Pixel Labeling for Industrial Anomaly Detection and Localization

Jingqi Wu, Hanxi Li, Lin Yuanbo Wu, Hao Chen, Deyin Liu, Peng Wang

机构 * Jiangxi Normal University（江西师范大学）； Southern University of Science and Technology（南方科技大学）； Swansea University（斯旺西大学）； Zhejiang University（浙江大学）； Anhui University（安徽大学）； Northwestern Polytechnical University（西北工业大学）

专题命中其他多模态：cross-modal(abstract)；分类 cs.CV、cs.AI