arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 6903 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 多模态训练与对齐 6903 篇

2208.02565 2024-07-23 cs.HC cs.CY stat.OT 71%

Teaching Visual Accessibility in Introductory Data Science Classes with Multi-Modal Data Representations

JooYoung Seo, Mine Dogucu

专题命中 多模态训练与对齐 :multi-modal(title)

Comments 17 pages, 6 figures

Journal ref Journal of Data Science Volume 21, Issue 2 (2023)

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.11335 2024-06-26 cs.CR 71%

Multimodal Security of Iris and Fingerprint with Bloom Filters

R. Sridevi, P. Shobana

专题命中 多模态训练与对齐 :multimodal(title)

Comments Volume 8, Issue 10, 2020, Aegaeum Journal

Journal ref Aegaeum Journal Volume 8 Issue 10 (2020) 402-410

详情

展开后加载摘要…

URL PDF HTML 收藏
2209.07689 2024-06-11 eess.SP 71%

A Unified Multi-Task Semantic Communication System for Multimodal Data

Guangyi Zhang, Qiyu Hu, Zhijin Qin, Yunlong Cai, Guanding Yu, Xiaoming Tao

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.17810 2024-03-27 eess.SP 71%

Environment Reconstruction based on Multi-User Selection and Multi-Modal Fusion in ISAC

Bo Lin, Chuanbin Zhao, Feifei Gao, Geoffrey Ye Li

专题命中 多模态训练与对齐 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2401.13287 2024-03-20 physics.med-ph 71%

Simplified Shielded MEG-MRI Multimodal System with Scalar-mode Optically Pumped Magnetometers as MEG Sensors

Yosuke Ito, Hiroyuki Ueda, Takenori Oida, Takahiro Moriya, Akinori Saito, Motohiro Suyama

专题命中 多模态训练与对齐 :multimodal(title)

Comments 11 pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.15963 2024-02-28 cs.LG 71%

Multimodal and multicontrast image fusion via deep generative models

Giovanna Maria Dimitri, Simeon Spasov, Andrea Duggento, Luca Passamonti, Pietro Li`o, Nicola Toschi

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2307.06235 2023-10-10 cs.LG q-bio.BM 71%

Multimodal Molecular Pretraining via Modality Blending

Qiying Yu, Yudi Zhang, Yuyan Ni, Shikun Feng, Yanyan Lan, Hao Zhou, Jingjing Liu

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2304.00003 2023-04-04 eess.IV 71%

Multimodal Information Fusion For The Diagnosis Of Diabetic Retinopathy

Yihao Li, Hassan Al Hajj, Pierre-Henri Conze, Mostafa EI Habib Daho, Sophie Bonnin, Hugang Ren, Niranchana Manivannan, Stephanie Magazzeni, Ramin Tadayoni, Mathieu Lamard, Gwenole Quellec

专题命中 多模态训练与对齐 :multimodal(title)

Comments Abstract

详情

展开后加载摘要…

URL PDF HTML 收藏
1904.01775 2023-02-09 cs.LG eess.SP 71%

Multimodal Representation Learning using Deep Multiset Canonical Correlation

Krishna Somandepalli, Naveen Kumar, Ruchir Travadi, Shrikanth Narayanan

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2211.04185 2022-12-05 cs.RO 71%

Coupled Modeling and Fusion Control for a Multi-modal Deformable Land-air Robot

Xinyu Zhang, Yuanhao Huang, Kangyao Huang, Ziqi Zhao, Jingwei Li, Huaping Liu, Jun Li

专题命中 多模态训练与对齐 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2210.10365 2022-10-20 cs.RO 71%

A sensor-to-pattern calibration framework for multi-modal industrial collaborative cells

Daniela Rato, Miguel Oliveira, Vítor Santos, Manuel Gomes, Angel Sappa

专题命中 多模态训练与对齐 :multi-modal(title)

Comments Journal of Manufacturing Systems

Journal ref Journal of Manufacturing Systems 64 (2022) 497-507

详情

展开后加载摘要…

URL PDF HTML 收藏
2205.08982 2022-05-19 cs.IR 71%

Attention-based Multimodal Feature Representation Model for Micro-video Recommendation

Mohan Hasama, Jing Li

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2110.02259 2021-10-07 cs.CR 71%

Multi-Modal Attack Detection for Cyber-Physical Additive Manufacturing

Shih-Yuan Yu, Arnav Vaibhav Malawade, Mohammad Abdullah Al Faruque

专题命中 多模态训练与对齐 :multi-modal(title)

Journal ref TC-CPS Newsletter Volume 05, Issue 01 (Mar. 2020)

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.06452 2021-08-17 cs.LG cs.SI 71%

AdaGNN: A multi-modal latent representation meta-learner for GNNs based on AdaBoosting

Qinyi Zhu, Yiou Xiao

专题命中 多模态训练与对齐 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2108.06437 2021-08-17 cs.HC 71%

VR Sickness Prediction from Integrated HMD's Sensors using Multimodal Deep Fusion Network

Rifatul Islam, Kevin Desai, John Quarles

专题命中 多模态训练与对齐 :multimodal(title)

Comments Manuscript to be published at the 2021 IEEE International Symposium on Mixed and Augmented Reality (ISMAR)

详情

展开后加载摘要…

URL PDF HTML 收藏
2107.05124 2021-07-13 cs.IR cs.LG cs.NE 71%

Transformers with multi-modal features and post-fusion context for e-commerce session-based recommendation

Gabriel de Souza P. Moreira, Sara Rabhi, Ronay Ak, Md Yasin Kabir, Even Oldridge

专题命中 多模态训练与对齐 :multi-modal(title)

Comments In Proceedings of SIGIR eCom'21 - SIGIR eCommerce Workshop Data Challenge 2021. https://sigir-ecom.github.io/

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.02209 2021-05-05 gr-qc astro-ph.HE 71%

New effective precession spin for modeling multimodal gravitational waveforms in the strong-field regime

Lucy M. Thomas, Patricia Schmidt, Geraint Pratten

专题命中 多模态训练与对齐 :multimodal(title)

Comments Matches version published in Phys. Rev. D. 23 pages (incl. appendices and bibliography), 17 figures

Journal ref Phys. Rev. D 103, 083022 (2021)

详情

展开后加载摘要…

URL PDF HTML 收藏
2103.12241 2021-05-04 cs.RO 71%

Multimodal Data Fusion for Power-On-and-Go Robotic Systems in Retail

Shubham Sonawani, Kailas Maneparambil, Heni Ben Amor

专题命中 多模态训练与对齐 :multimodal(title)

Comments POGO Workshop, RSS 2020

详情

展开后加载摘要…

URL PDF HTML 收藏
2009.12656 2021-03-24 cs.LG 71%

Bidirectional Representation Learning from Transformers using Multimodal Electronic Health Record Data to Predict Depression

Yiwen Meng, William Speier, Michael K. Ong, Corey W. Arnold

专题命中 多模态训练与对齐 :multimodal(title)

Comments in IEEE Journal of Biomedical and Health Informatics (2021)

详情

展开后加载摘要…

URL PDF HTML 收藏
2012.04078 2020-12-09 cs.HC cs.RO 71%

Supporting User Autonomy with Multimodal Fusion to Detect when a User Needs Assistance from a Social Robot

Alex Reneau, Jason R. Wilson

专题命中 多模态训练与对齐 :multimodal(title)

Comments 9 pages, 5 figures, 3 tables, AI-HRI FSS

详情

展开后加载摘要…

URL PDF HTML 收藏
2011.14966 2020-12-01 cs.LG 71%

Depression Status Estimation by Deep Learning based Hybrid Multi-Modal Fusion Model

Hrithwik Shalu, Harikrishnan P, Hari Sankar CN, Akash Das, Saptarshi Majumder, Arnhav Datar, Subin Mathew MS, Anugyan Das, Juned Kadiwala

专题命中 多模态训练与对齐 :multi-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
2008.10726 2020-08-26 cs.LG eess.SP 71%

Unsupervised Multi-Modal Representation Learning for Affective Computing with Multi-Corpus Wearable Data

Kyle Ross, Paul Hungler, Ali Etemad

专题命中 多模态训练与对齐 :multi-modal(title)

Comments 16 pages,5 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
1912.06879 2020-05-20 cs.LG eess.SP stat.ML 71%

Sensor Fusion using Backward Shortcut Connections for Sleep Apnea Detection in Multi-Modal Data

Tom Van Steenkiste, Dirk Deschrijver, Tom Dhaene

专题命中 多模态训练与对齐 :multi-modal(title)

Comments Paper presented at ML4H (Machine Learning for Health) workshop at NeurIPS 2019. https://ml4health.github.io/2019/

详情

展开后加载摘要…

URL PDF HTML 收藏
2004.12081 2020-04-28 cs.HC eess.SP 71%

A novel multimodal approach for hybrid brain-computer interface

Zhe Sun, Zihao Huang, Feng Duan, Yu Liu

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1910.14564 2019-11-25 math.PR math.OC 71%

Statistical Estimation of the Poincar{é} constant and Application to Sampling Multimodal Distributions

Loucas Pillaud-Vivien, Francis Bach, Tony Lelièvre, Alessandro Rudi, Gabriel Stoltz

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1908.03306 2019-08-12 q-bio.BM 71%

Cross-Modal Fusion Between Data in SAXS and Cryo-EM for Biomolecular Structure Determination

Shengnan Lyu, Christian Wülker, Yuqing Pan, Amitesh S. Jayaraman, Jianhao Zheng, Yilin Cai, Gregory S. Chirikjian

专题命中 多模态训练与对齐 :cross-modal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1809.03684 2019-03-11 cs.CE 71%

Visual Attention Model for Cross-sectional Stock Return Prediction and End-to-End Multimodal Market Representation Learning

Ran Zhao, Yuntian Deng, Mark Dredze, Arun Verma, David Rosenberg, Amanda Stent

专题命中 多模态训练与对齐 :multimodal(title)

Comments Accepted as full paper in the 32nd International FLAIRS Conference

详情

展开后加载摘要…

URL PDF HTML 收藏
1810.12954 2018-11-01 q-bio.NC 71%

Alternating Diffusion Map Based Fusion of Multimodal Brain Connectivity Networks for IQ Prediction

Li Xiao, Julia M. Stephen, Tony W. Wilson, Vince D. Calhoun, Yu-Ping Wang

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏
1505.07717 2016-08-24 cs.IT math.IT 71%

Exploring multimodal data fusion through joint decompositions with flexible couplings

Rodrigo Cabral Farias, Jeremy Emile Cohen, Pierre Comon

专题命中 多模态训练与对齐 :multimodal(title)

Comments 15 pages, 7 figures, revised version

详情

展开后加载摘要…

URL PDF HTML 收藏
1409.5050 2015-06-22 physics.optics cond-mat.mtrl-sci 71%

Multimodal Plasmonics in Fused Colloidal Networks

Alexandre Teulle, M. Bosman, C. Girard, Kargal L. Gurunatha, Mei Li, Stephen Mann, Erik Dujardin

专题命中 多模态训练与对齐 :multimodal(title)

详情

展开后加载摘要…

URL PDF HTML 收藏