arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 6942 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6942 篇

2511.14988 2025-11-20 cs.RO 50%

An Alignment-Based Approach to Learning Motions from Demonstrations

Alex Cuellar, Christopher K Fourie, Julie A Shah

机构 * Massachusetts Institute of Technology(麻省理工学院)

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 8 pages, 8 figures, originally published in the IEEE Robotics and Automation Letters

Journal ref IEEE Robotics and Automation Letters, vol. 10, no. 11, pp. 11912-11919, Nov. 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.13327 2025-11-18 cs.RO 50%

ZeroDexGrasp: Zero-Shot Task-Oriented Dexterous Grasp Synthesis with Prompt-Based Multi-Stage Semantic Reasoning

Juntao Jian, Yi-Lin Wei, Chengjie Mou, Yuhao Lin, Xing Zhu, Yujun Shen, Wei-Shi Zheng, Ruizhen Hu

机构 * Shenzhen University(深圳大学) Sun Yat-sen University(中山大学) Ant Group(蚂蚁集团)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.12778 2025-11-18 cs.RO 50%

DR. Nav: Semantic-Geometric Representations for Proactive Dead-End Recovery and Navigation

Vignesh Rajagopal, Kasun Weerakoon Kulathun Mudiyanselage, Gershom Devake Seneviratne, Pon Aswin Sankaralingam, Mohamed Elnoor, Jing Liang, Rohan Chandra, Dinesh Manocha

机构 * Dept. of Computer Science at the University of Virginia(弗吉尼亚大学计算机科学系) Dept. of Computer Science at the University of Maryland College Park(马里兰大学学院市计算机科学系)

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2505.12729 2025-11-18 eess.SP 50%

Bridging the Modality Gap: Enhancing Channel Prediction with Semantically Aligned LLMs and Knowledge Distillation

Zhaoyang Li, Qianqian Yang, Zehui Xiong, Zhiguo Shi, Tony Q. S. Quek

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.11673 2025-11-18 cs.LG 50%

Synergistic Feature Fusion for Latent Lyrical Classification: A Gated Deep Learning Architecture

M. A. Gameiro

机构 * Independent Researcher(独立研究者)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.10935 2025-11-17 cs.SD cs.LG q-bio.NC 50%

CAT-Net: A Cross-Attention Tone Network for Cross-Subject EEG-EMG Fusion Tone Decoding

Yifan Zhuang, Calvin Huang, Zepeng Yu, Yongjie Zou, Jiawei Ju

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments This is the extended version with technical appendices. The version of record appears in AAAI-26. Please cite the AAAI version

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.09725 2025-11-14 physics.plasm-ph cs.LG physics.data-an 50%

The Data Fusion Labeler (dFL): Challenges and Solutions to Data Harmonization, Labeling, and Provenance in Fusion Energy

Craig Michoski, Matthew Waller, Brian Sammuli, Zeyu Li, Tapan Ganatma Nakkina, Raffi Nazikian, Sterling Smith, David Orozco, Dongyang Kuang, Martin Foltin, Erik Olofsson, Mike Fredrickson, Jerry Louis-Jeune, David R. Hatch, Todd A. Oliver, Mitchell Clark, Steph-Yves Louis

机构 * University of Texas, Austin, TX, USA(德克萨斯大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2507.02909 2025-11-14 cs.LG 50%

Fine-grained Token Allocation Via Operation Pruning for Efficient MLLMs

Aoming Liu, Reuben Tan, Boqing Gong, Bryan A. Plummer

机构 * Boston University(波士顿大学) Microsoft Research(微软研究院)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.11639 2025-11-12 cs.IR 50%

OneRec-Think: In-Text Reasoning for Generative Recommendation

Zhanyu Liu, Shiyao Wang, Xingmei Wang, Rongzhou Zhang, Jiaxin Deng, Honghui Bao, Jinghao Zhang, Wuchao Li, Pengfei Zheng, Xiangyu Wu, Yifei Hu, Qigen Hu, Xinchen Luo, Lejian Ren, Zixing Zhang, Qianqian Wang, Kuo Cai, Yunfan Wu, Hongtao Cheng, Zexuan Cheng, Lu Ren, Huanjie Wang, Yi Su, Ruiming Tang, Kun Gai, Guorui Zhou

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.07081 2025-11-11 cs.RO 50%

HDCNet: A Hybrid Depth Completion Network for Grasping Transparent and Reflective Objects

Guanghu Xie, Mingxu Li, Songwei Wu, Yang Liu, Zongwu Xie, Baoshi Cao, Hong Liu

机构 * State Key Laboratory of Robotics and Systems, Harbin Institute of Technology(机器人系统国家重点实验室,哈尔滨工业大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.05796 2025-11-11 cs.CR 50%

Securing UAV Communications by Fusing Cross-Layer Fingerprints

Yong Huang, Ruihao Li, Mingyang Chen, Feiyang Zhao, Dalong Zhang, Wanqing Tu

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments To appear in the IEEE Internet of Things Journal

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.05726 2025-11-11 cs.LG q-bio.QM 50%

GastroDL-Fusion: A Dual-Modal Deep Learning Framework Integrating Protein-Ligand Complexes and Gene Sequences for Gastrointestinal Disease Drug Discovery

Ziyang Gao, Annie Cheung, Yihao Ou

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.03488 2025-11-06 cs.LG 50%

NAP: Attention-Based Late Fusion for Automatic Sleep Staging

Alvise Dei Rossi, Julia van der Meer, Markus H. Schmidt, Claudio L. A. Bassetti, Luigi Fiorillo, Francesca Faraci

机构 * Faculty of Informatics, Università della Svizzera Italiana(信息学院,瑞士意大利大学) Inst. of Digital Tech. for Personalized Healthcare, SUPSI(个性化医疗数字技术研究所,SUPSI) Sleep Wake Epilepsy Center, Department of Neurology, Inselspital University of Bern(睡眠觉醒癫痫中心,神经科,伯恩大学医院) Faculty of Informatics Università della Svizzera Italiana(信息学院,瑞士意大利大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2511.02597 2025-11-05 cs.LO 50%

The mu-calculus' Alternation Hierarchy is Strict over Non-Trivial Fusion Logics

Leonardo Pacheco

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments In Proceedings FICS 2024, arXiv:2511.00626

Journal ref EPTCS 435, 2025, pp. 93-103

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.27674 2025-11-03 physics.ed-ph 50%

Teaching competencies in physics for engineering education: A qualitative analysis from teaching practice

Vanessa Cruz Molina, Daniel Sanchez Guzman, Teodoro Rivera Montalvo, Ricardo Garcia-Salcedo

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 18 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.26886 2025-11-03 cond-mat.mtrl-sci 50%

MaterialsGalaxy: A Platform Fusing Experimental and Theoretical Data in Condensed Matter Physics

Tiannian Zhu, Zhong Fang, Quansheng Wu, Hongming Weng

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments 18 pages, 5 figures. Accepted for publication in Chinese Physics B (24 October 2025)

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.10650 2025-11-03 stat.ML cs.LG stat.AP stat.CO stat.ME 50%

Generative Adversarial Networks for High-Dimensional Item Factor Analysis: A Deep Adversarial Learning Algorithm

Nanyu Luo, Feng Ji

机构 * University of Toronto(多伦多大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.26146 2025-10-31 cs.LG 50%

maxVSTAR: Maximally Adaptive Vision-Guided CSI Sensing with Closed-Loop Edge Model Adaptation for Robust Human Activity Recognition

Kexing Liu

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.22304 2025-10-29 q-bio.BM 50%

ODesign: A World Model for Biomolecular Interaction Design

Odin Zhang, Xujun Zhang, Haitao Lin, Cheng Tan, Qinghan Wang, Yuanle Mo, Qiantai Feng, Gang Du, Yuntao Yu, Zichang Jin, Ziyi You, Peicong Lin, Yijie Zhang, Yuyang Tao, Shicheng Chen, Jack Xiaoyu Chen, Chenqing Hua, Weibo Zhao, Runze Ma, Yunpeng Xia, Kejun Ying, Jun Li, Yundian Zeng, Lijun Lang, Peichen Pan, Hanqun Cao, Zihao Song, Bo Qiang, Jiaqi Wang, Pengfei Ji, Lei Bai, Jian Zhang, Chang-yu Hsieh, Pheng Ann Heng, Siqi Sun, Tingjun Hou, Shuangjia Zheng

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.23449 2025-10-28 cs.LG 50%

Schrodinger Neural Network and Uncertainty Quantification: Quantum Machine

M. M. Hammad

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 29 pages, 16 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.22239 2025-10-28 eess.IV cs.LG q-bio.QM 50%

Synthetic-to-Real Transfer Learning for Chromatin-Sensitive PWS Microscopy

Jahidul Arafat, Sanjaya Poudel

机构 * Department of Computer Science and Software Engineering, Auburn University, Alabama, USA(计算机科学与软件工程系,阿伯茨罕大学,阿拉巴马州,美国)

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 24 pages, 5 figures and 4 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.23801 2025-10-27 cs.RO 50%

High-Precision Climbing Robot Localization Using Planar Array UWB/GPS/IMU/Barometer Integration

Shuning Zhang, Zhanchen Zhu, Xiangyu Chen, Yunheng Wang, Xu Jiang, Peibo Duan, Renjing Xu

机构 * Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)) Department of Data Science and AI, Monash University(数据科学与人工智能系,墨尔本大学) Department of Data Science and Artificial Intelligence, Faculty of Infomation Technology, Monash University(数据科学与人工智能系,信息科技学院,墨尔本大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.20615 2025-10-24 cs.LG 50%

MS-BART: Unified Modeling of Mass Spectra and Molecules for Structure Elucidation

Yang Han, Pengyu Wang, Kai Yu, Xin Chen, Lu Chen

机构 * X-LANCE Lab, School of Computer Science MoE Key Lab of Artificial Intelligence, SJTU AI Institute Shanghai Jiao Tong University, Shanghai, China(X-LANCE实验室,计算机科学学院,人工智能教育部重点实验室,上海交通大学人工智能研究院,上海,中国) Suzhou Laboratory, Suzhou, China(苏州实验室,苏州,中国) Shanghai Innovation Institute, Shanghai, China(上海创新研究院,上海,中国) Jiangsu Key Lab of Language Computing, Suzhou, China(江苏省语言计算重点实验室,苏州,中国)

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments NeurIPS 2025, We provide the data and code at https://github.com/OpenDFM/MS-BART

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.15422 2025-10-20 stat.ML cs.LG 50%

Information Theory in Open-world Machine Learning Foundations, Frameworks, and Future Direction

Lin Wang

机构 * Shenzhen Key Laboratory of Neuropsychiatric Modulation(深圳心理行为调控重点实验室) Shenzhen-Hong Kong Institute of Brain Science(深圳-香港脑科学研究院) Shenzhen Institutes of Advanced Technology(深圳先进技术研究院) Chinese Academy of Sciences(中国科学院)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.12971 2025-10-16 cs.RO 50%

Actron3D: Learning Actionable Neural Functions from Videos for Transferable Robotic Manipulation

Anran Zhang, Hanzhi Chen, Yannick Burkhardt, Yao Zhong, Johannes Betz, Helen Oleynikova, Stefan Leutenegger

机构 * ETH Zurich(苏黎世联邦理工学院) Technical University of Munich(慕尼黑技术大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 8 pages, 5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.12087 2025-10-15 cs.GR 50%

Can Representation Gaps Be the Key to Enhancing Robustness in Graph-Text Alignment?

Heng Zhang, Tianyi Zhang, Yuling Shi, Xiaodong Gu, Yaomin Shen, Zijian Zhang, Yilei Yuan, Hao Zhang, Jin Huang

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.10731 2025-10-14 cs.RO cs.LG 50%

Controllable Generative Trajectory Prediction via Weak Preference Alignment

Yongxi Cao, Julian F. Schumann, Jens Kober, Joni Pajarinen, Arkady Zgonnikov

机构 * Aalto University(阿alto大学) TU Delft(代尔夫特理工大学)

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.18837 2025-10-14 cs.SI 50%

Sentiment and Social Signals in the Climate Crisis: A Survey on Analyzing Social Media Responses to Extreme Weather Events

Pouya Shaeri, Yasaman Mohammadpour, Alimohammad Beigi, Ariane Middel

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Accepted and Published in SBP-BRiMS 2025. 18th International Conference on Social Computing, Behavioral-Cultural Modeling & Prediction and Behavior Representation in Modeling and Simulation

详情

展开后加载摘要…

URL PDF HTML 收藏
2510.09435 2025-10-13 cs.LG cs.IR 50%

Cross-attention Secretly Performs Orthogonal Alignment in Recommendation Models

Hyunin Lee, Yong Zhang, Hoang Vu Nguyen, Xiaoyi Liu, Namyong Park, Christopher Jung, Rong Jin, Yang Wang, Zhigang Wang, Somayeh Sojoudi, Xue Feng

机构 * Meta

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 19 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2509.25641 2025-10-13 physics.med-ph 50%

Semi-Supervised Radiomics for Glioblastoma IDH Mutation: Limited Labels, Data Sensitivity, and SHAP Interpretation

Amir Hossein Pouria, Shahram Taeb, Somayeh Sadat Mehrnia, Sajad Jabarzadeh Ghandilu, Mehrdad Oveisi, Arman Rahmim, Mohammad R. Salmanpour

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 13 Pages and 4 Figures

详情

展开后加载摘要…

URL PDF HTML 收藏