arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 6942 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6942 篇

2504.13112 2025-04-18 cs.LG 50%

Hadamard product in deep learning: Introduction, Advances and Challenges

Grigorios G Chrysos, Yongtao Wu, Razvan Pascanu, Philip Torr, Volkan Cevher

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Accepted in IEEE T-PAMI

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.07257 2025-04-18 cs.AR cs.ET 50%

The Dawn of AI-Native EDA: Opportunities and Challenges of Large Circuit Models

Lei Chen, Yiqi Chen, Zhufei Chu, Wenji Fang, Tsung-Yi Ho, Ru Huang, Yu Huang, Sadaf Khan, Min Li, Xingquan Li, Yu Li, Yun Liang, Jinwei Liu, Yi Liu, Yibo Lin, Guojie Luo, Zhengyuan Shi, Guangyu Sun, Dimitrios Tsaras, Runsheng Wang, Ziyi Wang, Xinming Wei, Zhiyao Xie, Qiang Xu, Chenhao Xue, Junchi Yan, Jun Yang, Bei Yu, Mingxuan Yuan, Evangeline F. Y. Young, Xuan Zeng, Haoyi Zhang, Zuodong Zhang, Yuxiang Zhao, Hui-Ling Zhen, Ziyang Zheng, Binwu Zhu, Keren Zhu, Sunan Zou

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments The authors are ordered alphabetically. Contact: qxu@cse[dot]cuhk[dot]edu[dot]hk, gluo@pku[dot]edu[dot]cn, yuan.mingxuan@huawei[dot]com

Journal ref Large Circuit Models: Opportunities and Challenges. Science China Information Science, 2024, 67(10): 200402

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.03307 2025-04-10 cs.IR 50%

Intent Representation Learning with Large Language Model for Recommendation

Yu Wang, Lei Sang, Yi Zhang, Yiwen Zhang

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Accepted by SIGIR 2025 Full Paper

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.03226 2025-04-10 cs.LG 50%

FuseMoE: Mixture-of-Experts Transformers for Fleximodal Fusion

Xing Han, Huy Nguyen, Carl Harris, Nhat Ho, Suchi Saria

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Published in NeurIPS 2024; 45 pages, 10 tables, 13 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2504.04097 2025-04-08 eess.SY cs.RO cs.SY 50%

Risk-Aware Robot Control in Dynamic Environments Using Belief Control Barrier Functions

Shaohang Han, Matti Vahs, Jana Tumova

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.18380 2025-04-01 cs.RO 50%

UKF-Based Sensor Fusion for Joint-Torque Sensorless Humanoid Robots

Ines Sorrentino, Giulio Romualdi, Daniele Pucci

专题命中 多模态训练与对齐 :multimodal(abstract)

Journal ref 2024 IEEE International Conference on Robotics and Automation (ICRA)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.21346 2025-03-28 cs.LG stat.CO stat.ML 50%

Scalable Expectation Estimation with Subtractive Mixture Models

Lena Zellinger, Nicola Branchini, Víctor Elvira, Antonio Vergari

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.07065 2025-03-26 cs.RO 50%

CAHSOR: Competence-Aware High-Speed Off-Road Ground Navigation in SE(3)

Anuj Pokhrel, Aniket Datar, Mohammad Nazeri, Xuesu Xiao

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.15801 2025-03-21 cs.LG 50%

Disentangling Uncertainties by Learning Compressed Data Representation

Zhiyu An, Zhibo Hou, Wan Du

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments Accepted by the 7th Annual Learning for Dynamics & Control Conference (L4DC) 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2407.03992 2025-03-20 eess.IV 50%

Medical Image Fusion for High-Level Analysis: A Mutual Enhancement Framework for Unaligned PAT and MRI

Yutian Zhong, Jinchuan He, Zhichao Liang, Shuangyang Zhang, Qianjin Feng, Lijun Lu, Li Qi

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.09019 2025-03-18 cs.LG 50%

Tensor Networks Meet Neural Networks: A Survey and Future Perspectives

Maolin Wang, Yu Pan, Zenglin Xu, Guangxi Li, Xiangli Yang, Danilo Mandic, Andrzej Cichocki

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.12726 2025-03-18 eess.SY cs.SY 50%

Indoor Fusion Positioning Based on "IMU-Ultrasonic-UWB" and Factor Graph Optimization Method

Fengyun Zhang, Jia Li, Xiaoqing Zhang, Shukai Duan, Shuang-Hua Yang

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2503.08112 2025-03-12 physics.optics 50%

In-situ dynamic spatial reconfiguration of nanoplasmonics using photothermal-shock tweezers

Runlin Zhu, Zhaoqi Gu, Tianci Shen, Yifei Liu, Zhangxing Shi, Shuangyi Linghu, Fuxing Gu

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 16 pages, 6 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2410.09156 2025-03-06 cs.LG stat.ML 50%

On Discriminative Probabilistic Modeling for Self-Supervised Representation Learning

Bokun Wang, Yunwen Lei, Yiming Ying, Tianbao Yang

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments To appear in ICLR 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.08448 2025-02-13 cs.LG stat.ML 50%

Monge SAM: Robust Reparameterization-Invariant Sharpness-Aware Minimization Based on Loss Geometry

Albert Kjøller Jacobsen, Georgios Arvanitidis

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2502.03664 2025-02-07 cs.IR cs.LG 50%

Contrastive Learning for Cold Start Recommendation with Adaptive Feature Fusion

Jiacheng Hu, Tai An, Zidong Yu, Junliang Du, Yuanshuai Luo

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.17143 2025-01-30 math.NA cs.NA physics.comp-ph physics.data-an 50%

Approximation of High-Dimensional Gibbs Distributions with Functional Hierarchical Tensors

Nan Sheng, Xun Tang, Haoxuan Chen, Lexing Ying

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.16015 2025-01-28 eess.SP 50%

BMAR: Barometric and Motion-based Alignment and Refinement for Offline Signal Synchronization across Devices

Manuel Meier, Christian Holz

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments Accepted at IMWUT Vol. 7 No. 2

详情

展开后加载摘要…

URL PDF HTML 收藏
2408.14255 2025-01-28 eess.IV 50%

MSFMamba: Multi-Scale Feature Fusion State Space Model for Multi-Source Remote Sensing Image Classification

Feng Gao, Xuepeng Jin, Xiaowei Zhou, Junyu Dong, Qian Du

专题命中 多模态训练与对齐 :cross-modal(abstract)

Comments IEEE TGRS 2025

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.14745 2025-01-28 cs.DC cs.LG 50%

AI-Driven Health Monitoring of Distributed Computing Architecture: Insights from XGBoost and SHAP

Xiaoxuan Sun, Yue Yao, Xiaoye Wang, Pochun Li, Xuan Li

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2501.13541 2025-01-24 eess.SP 50%

A Dual-Polarization Feature Fusion Network for Radar Automatic Target Recognition Based On HRRP Sequence

Yangbo Zhou, Sen Liu, Hong-Wei Gao, Hai lin, Guohua Wei, Xiaoqing Wang, Xiao-Min Pan

专题命中 多模态训练与对齐 :multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.04319 2024-12-31 cs.LG cs.HC cs.RO 50%

CaptAinGlove: Capacitive and Inertial Fusion-Based Glove for Real-Time on Edge Hand Gesture Recognition for Drone Control

Hymalai Bello, Sungho Suh, Daniel Geißler, Lala Ray, Bo Zhou, Paul Lukowicz

专题命中 多模态训练与对齐 :multimodal(abstract)

Journal ref 2024 Springer, Cham

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.01207 2024-12-30 cs.LG 50%

Towards General Industrial Intelligence: A Survey of Continual Large Models in Industrial IoT

Jiao Chen, Jiayi He, Fangfang Chen, Zuohong Lv, Jianhua Tang, Weihua Li, Zuozhu Liu, Howard H. Yang, Guangjie Han

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2409.11376 2024-12-05 cs.LG 50%

Towards Time Series Reasoning with LLMs

Winnie Chow, Lauren Gardiner, Haraldur T. Hallgrímsson, Maxwell A. Xu, Shirley You Ren

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments Oral Presentation at 2024 NeurIPS Workshop on Time Series in the Age of Large Models

详情

展开后加载摘要…

URL PDF HTML 收藏
2412.01108 2024-12-03 cs.LG q-bio.BM 50%

Multi-Scale Representation Learning for Protein Fitness Prediction

Zuobai Zhang, Pascal Notin, Yining Huang, Aurélie Lozano, Vijil Chenthamarakshan, Debora Marks, Payel Das, Jian Tang

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.11828 2024-11-28 cs.LG 50%

Federated Learning for Time-Series Healthcare Sensing with Incomplete Modalities

Adiba Orzikulova, Jaehyun Kwak, Jaemin Shin, Sung-Ju Lee

专题命中 多模态训练与对齐 :multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.15179 2024-11-26 cs.LG stat.ML 50%

Random Forest-Supervised Manifold Alignment

Jake S. Rhodes, Adam G. Rustad

专题命中 多模态训练与对齐 :multimodal(abstract)

Comments 4 pages, 3 figures, Accepted at MMAI 2024 (BigData 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.12185 2024-11-20 cs.RO 50%

LiV-GS: LiDAR-Vision Integration for 3D Gaussian Splatting SLAM in Outdoor Environments

Renxiang Xiao, Wei Liu, Yushuai Chen, Liang Hu

专题命中 多模态训练与对齐 :cross-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.09201 2024-11-15 cs.AR eess.SP 50%

Noncontact Multi-Point Vital Sign Monitoring with mmWave MIMO Radar

Wei Ren, Jiannong Cao, Huansheng Yi, Kaiyue Hou, Miaoyang Hu, Jianqi Wang, Fugui Qi

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments 15 pages

详情

展开后加载摘要…

URL PDF HTML 收藏
2411.04750 2024-11-08 astro-ph.IM astro-ph.GA astro-ph.SR 50%

SpectraFM: Tuning into Stellar Foundation Models

Nolan Koblischke, Jo Bovy

专题命中 多模态训练与对齐 :multi-modal(abstract)

Comments Accepted at the NeurIPS 2024 Workshop on Foundation Models for Science

详情

展开后加载摘要…

URL PDF HTML 收藏