AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

2025-09-11 至 2025-09-11 共收录 38 篇信号源：cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态评测 10 篇

2509.08003 2025-09-11 cs.CV 57%

An Explainable Deep Neural Network with Frequency-Aware Channel and Spatial Refinement for Flood Prediction in Sustainable Cities

Shahid Shafi Dar, Bharat Kaurav, Arnav Jain, Chandravardhan Singh Raghaw, Mohammad Zia Ur Rehman, Nagendra Kumar

机构 * Indian Institute of Technology Indore（印度印度理工学院印度尔）

专题命中多模态评测：cross-modal(abstract)；分类 cs.CV

2. 多模态训练与对齐 5 篇

2404.04256 2025-09-11 cs.CV 79%

Sigma: Siamese Mamba Network for Multi-Modal Semantic Segmentation

Zifu Wan, Pingping Zhang, Yuhao Wang, Silong Yong, Simon Stepputtis, Katia Sycara, Yaqi Xie

机构 * Robotics Institute, Carnegie Mellon University（机器人研究所，卡内基梅隆大学）

专题命中多模态训练与对齐：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by WACV 2025. Project page: https://zifuwan.github.io/Sigma/

2509.08311 2025-09-11 cs.CV 70%

SimCroP: Radiograph Representation Learning with Similarity-driven Cross-granularity Pre-training

Rongsheng Wang, Fenghe Tang, Qingsong Yao, Rui Yan, Xu Zhang, Zhen Huang, Haoran Lai, Zhiyang He, Xiaodong Tao, Zihang Jiang, Shaohua Kevin Zhou

机构 * School of Biomedical Engineering, Division of Life Sciences ； Medicine, University of Science ； Technology of China (USTC), Hefei Anhui, 230026, China Center for Medical Imaging, Robotics, Analytic Computing \& Learning (MIRACLE), Suzhou Institute for Advance Research, USTC, 215123, China Stanford University, Palo Alto, California, 94025, United States Jiangsu Provincial Key Laboratory of Multimodal Digital Twin Technology, Suzhou Key Laboratory of Precision ； Intelligent Chemistry, USTC Anhui IFLYTEK CO., Ltd.

专题命中多模态训练与对齐：multimodal(abstract)；multi-modal(abstract)；分类 cs.CV

Comments Accepted by MICCAI 2025

2508.09016 2025-09-11 cs.CL cs.LG 57%

A Survey on Training-free Alignment of Large Language Models

Birong Pan, Yongqi Li, Weiyu Zhang, Wenpeng Lu, Mayi Xu, Shen Zhou, Yuanyuan Zhu, Ming Zhong, Tieyun Qian

机构 * School of Computer Science, Wuhan University, Wuhan, China（武汉大学计算机学院）； Faculty of Computer Science and Technology, Qilu University of Technology, Shandong, China（青岛科技大学计算机科学与技术学院）； Zhongguancun Academy, Beijing, China（中关村学院）

专题命中多模态训练与对齐：multimodal(abstract)；分类 cs.CL

Comments Accepted to EMNLP 2025 (findings), camera-ready version

2501.11260 2025-09-11 cs.RO cs.CV 57%

A Survey of World Models for Autonomous Driving

Tuo Feng, Wenguan Wang, Yi Yang

机构 * Collaborative Innovation Center of Artificial Intelligence (CCAI), Zhejiang University（人工智能协同创新中心（CCAI）、浙江大学）

专题命中多模态训练与对齐：multimodal(abstract)；分类 cs.CV

Comments Ongoing project. Paper list: https://github.com/FengZicai/AwesomeWMAD Benchmark: https://github.com/FengZicai/WMAD-Benchmarks

2509.08174 2025-09-11 physics.optics cond-mat.mtrl-sci 50%

Comparing Machine Learning and Physics-Based Nanoparticle Geometry Determinations Using Far-Field Spectral Properties

Mengqi Sun, Zixu Huang, Muammer Y. Yaman, Maxim Ziatdinov, Sergei V. Kalinin, David S. Ginger

专题命中多模态训练与对齐：multimodal(abstract)

3. 其他多模态 2 篇

2509.07577 2025-09-11 cs.AI 57%

Towards explainable decision support using hybrid neural models for logistic terminal automation

Riccardo D'Elia, Alberto Termine, Francesco Flammini

机构 * University of Applied Sciences and Arts of Southern Switzerland（应用科学与艺术大学（南瑞士））； Dalle Molle Institute for Artificial Intelligence（达勒莫勒人工智能研究所）； University of Florence（佛罗伦萨大学）； Department of Mathematics and Computer Science Ulisse Dini（数学与计算机科学系（乌利塞·迪尼））

专题命中其他多模态：multimodal(abstract)；分类 cs.AI

2411.07427 2025-09-11 cond-mat.supr-con cond-mat.mtrl-sci 50%

Diverse Manifestations of Electron-Phonon Coupling in a Kagome Superconductor

Jing-Yang You, Chih-En Hsu, Mauro Del Ben, Zhenglu Li

专题命中其他多模态：multimodal(abstract)

Journal ref Phys. Rev. Lett. 134, 106401 (2025)