arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

2025-09-12 至 2025-09-12 共收录 40 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 9 篇

2509.09114 2025-09-12 cs.IR 82%

Modality Alignment with Multi-scale Bilateral Attention for Multimodal Recommendation

Kelin Ren, Chan-Yang Ju, Dong-Ho Lee

专题命中 多模态训练与对齐 :multimodal(title,abstract);cross-modal(abstract)

Comments Accepted by CIKM 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.09290 2025-09-12 cs.CV cs.AI 82%

Modality-Agnostic Input Channels Enable Segmentation of Brain lesions in Multimodal MRI with Sequences Unavailable During Training

Anthony P. Addison, Felix Wagner, Wentian Xu, Natalie Voets, Konstantinos Kamnitsas

机构 * Department of Engineering Science, University of Oxford, Oxford, UK(工程科学系,牛津大学,牛津,英国) Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK(牛津大学临床神经科学系,牛津,英国)

专题命中 多模态训练与对齐 :multimodal(title,abstract);分类 cs.CV、cs.AI

Comments Accepted to MICCAI 2025, for the following workshop: ML-CDS 2025: Multimodal Learning and Fusion Across Scales for Clinical Decision Support

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.09064 2025-09-12 cs.CV 79%

Enhancing 3D Medical Image Understanding with Pretraining Aided by 2D Multimodal Large Language Models

Qiuhui Chen, Xuancheng Yao, Huping Ye, Yi Hong

机构 * School of Computer Science, Shanghai Jiao Tong University(上海交通大学计算机科学学院)

专题命中 多模态训练与对齐 :multimodal(title,abstract);分类 cs.CV

Comments Accepted by IEEE Journal of Biomedical and Health Informatics (JBHI)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.14707 2025-09-12 cs.CY 71%

Information Fusion in Multimodal IoT Systems for physical activity level monitoring

Mohsen Shirali, Zahra Ahmadi, Jose-Luis Bayo-Monton, Zoe Valero-Ramon, Carlos Fernandez-Llatas

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.06465 2025-09-12 cs.LG cs.CE q-bio.BM 67%

CAME-AB: Cross-Modality Attention with Mixture-of-Experts for Antibody Binding Site Prediction

Hongzong Li, Jiahao Ma, Zhanpeng Shi, Rui Xiao, Fanming Jin, Ye-Fan Hu, Hangjun Che, Jian-Dong Huang

机构 * Generative AI Research and Development Center The Hong Kong University of Science and Technology(生成式人工智能研究与发展中心 香港科学大学) MILES The University of Hong Kong(MILES 香港大学) College of Veterinary Medicine Jilin University(吉林大学兽医学院) School of Chemistry and Chemical Engineering South China University of Technology(华南理工大学化学与化工学院) School of Biomedical Sciences The University of Hong Kong(香港大学生物医学科学学院) Computational Immunology Centre BayVax Biotech Limited(计算免疫学中心 BayVax 生物技术有限公司) College of Electronic and Information Engineering Southwest University(西南大学电子与信息工程学院)

专题命中 多模态训练与对齐 :multimodal(abstract);cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2508.05211 2025-09-12 cs.CV 57%

VFlowOpt: A Token Pruning Framework for LMMs with Visual Information Flow-Guided Optimization

Sihan Yang, Runsen Xu, Chenhang Cui, Tai Wang, Dahua Lin, Jiangmiao Pang

机构 * Shanghai AI Laboratory(上海人工智能实验室) The Chinese University of Hong Kong(香港中文大学) National University of Singapore(新加坡国立大学)

专题命中 多模态训练与对齐 :multimodal(abstract);分类 cs.CV

Comments Accepted by ICCV 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.08830 2025-09-12 eess.SP cs.LG 50%

A Masked Representation Learning to Model Cardiac Functions Using Multiple Physiological Signals

Seong-A Park, Jong-Eui Chae, Sungdong Kim, Hyung-Chul Lee, Hyun-Lim Yang

机构 * Seoul National University Hospital(首尔国立大学医院) Seoul National University(首尔国立大学) KAIST AI(韩国科学技术院人工智能研究所)

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 16 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏

2. 其他多模态 3 篇

2406.04158 2025-09-12 cs.CV eess.IV 79%

Deep Learning-based Cross-modal Reconstruction of Vehicle Target from Sparse 3D SAR Image

Da Li, Guoqiang Zhao, Chen Yao, Kaiqiang Zhu, Houjun Sun, Jiacheng Bao, Maokun Li

专题命中 其他多模态 :cross-modal(title,abstract);分类 cs.CV

Comments This work has been submitted to the IEEE for possible publication

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.08953 2025-09-12 cs.HC 78%

Characterizing Multimodal Interaction in Visualization Authoring Tools

Astrid van den Brandt, Sehi L'Yi, Huyen N. Nguyen, Anna Vilanova, Nils Gehlenborg

专题命中 其他多模态 :multimodal(title,abstract)

Comments 5 pages, 2 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.09304 2025-09-12 physics.optics cond-mat.mes-hall cond-mat.quant-gas physics.atom-ph 50%

Non-Abelian Electric Field and Zitterbewegung on a Photonic Frequency Chain

Shu Yang, Bengy Tsz Tsun Wong, Yi Yang

专题命中 其他多模态 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏