arXivDaily arXiv每日学术速递 周一至周五更新

AI 大模型

多模态大模型

跨文本、图像、视频、音频等模态的大模型与学习方法。

共收录 4895 信号源:cs.CV, cs.CL, cs.AI, cs.MM, eess.AS

1. 其他多模态 4895 篇

2406.06448 2024-06-11 cs.HC 78%

How is the Pilot Doing: VTOL Pilot Workload Estimation by Multimodal Machine Learning on Psycho-physiological Signals

Jong Hoon Park, Lawrence Chen, Ian Higgins, Zhaobo Zheng, Shashank Mehrotra, Kevin Salubre, Mohammadreza Mousaei, Steven Willits, Blain Levedahl, Timothy Buker, Eliot Xing, Teruhisa Misu, Sebastian Scherer, Jean Oh

专题命中 其他多模态 :multimodal(title,abstract)

Comments 8 pages, 7 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.02658 2024-06-06 cs.NE 78%

Maintaining Diversity Provably Helps in Evolutionary Multimodal Optimization

Shengjie Ren, Zhijia Qiu, Chao Bian, Miqing Li, Chao Qian

专题命中 其他多模态 :multimodal(title,abstract)

Comments arXiv admin note: text overlap with arXiv:2406.02118

详情

展开后加载摘要…

URL PDF HTML 收藏
2406.02312 2024-06-05 eess.SY cs.SY physics.app-ph 78%

Multimodal Resonance in Strongly Coupled Inductor Arrays

Robert R. Hughes, James Treisman, Alexis Hernandez Arroyo, Anthony J. Mulholland

专题命中 其他多模态 :multimodal(title);multi-modal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.18497 2024-05-30 cs.IT math.IT 78%

Capacity Results for Non-Ergodic Multi-Modal Broadcast Channels with Controllable Statistics

Alireza Vahid, Shih-Chun Lin

专题命中 其他多模态 :multi-modal(title,abstract)

Comments under review

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.17906 2024-05-29 physics.optics 78%

Laser-scanning optical-frequency-comb microscopy for multimodal imaging

Shimpei Kajiwara, Eiji Hase, Shota Nakano, Keishiro Ootani, Tomoya Okabe, Hidenori Koresawa, Akifumi Asahara, Kazumichi Yoshii, Hirotsugu Yamamoto, Kaoru Minoshima, Takeshi Yasui, Takeo Minamikawa

专题命中 其他多模态 :multimodal(title,abstract)

Comments 11 pages, 8 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.13023 2024-05-24 cs.HC 78%

A Machine Learning Approach for Predicting Upper Limb Motion Intentions with Multimodal Data in Virtual Reality

Pavan Uttej Ravva, Pinar Kullu, Mohammad Fahim Abrar, Roghayeh Leila Barmaki

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.12431 2024-05-22 cs.DC 78%

Data Sharing at the Edge of the Network: A Disturbance Resilient Multi-modal ITS

Igor Mikolasek, Saeedeh Ghanadbashi, Nima Afraz, Fatemeh Golpayegani

专题命中 其他多模态 :multi-modal(title);multimodal(abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.11788 2024-05-21 cs.LG 78%

TinyLLaVA Factory: A Modularized Codebase for Small-scale Large Multimodal Models

Junlong Jia, Ying Hu, Xi Weng, Yiming Shi, Miao Li, Xingjian Zhang, Baichuan Zhou, Ziyu Liu, Jie Luo, Lei Huang, Ji Wu

专题命中 其他多模态 :multimodal(title,abstract)

Comments Our codebase is made public at https://github.com/TinyLLaVA/TinyLLaVA_Factory with documentation available at https://tinyllava-factory.readthedocs.io/en/latest/

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03920 2024-05-08 cs.CL cs.AI cs.MM 78%

A Roadmap for Multilingual, Multimodal Domain Independent Deception Detection

Dainis Boumber, Rakesh M. Verma, Fatima Zahra Qachfar

专题命中 其他多模态 :multimodal(title);分类 cs.CL、cs.AI、cs.MM

Comments 6 pages, 1 figure, shorter version in SIAM International Conference on Data Mining (SDM) 2024

Journal ref Proc. SDM 2024, 396-399

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.03829 2024-05-08 q-bio.NC 78%

Unsupervised Machine Learning Identifies Latent Ultradian States in Multi-Modal Wearable Sensor Signals

Christopher Thornton, Billy C. Smith, Guillermo M. Besne, Bethany Little, Yujiang Wang

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2405.01243 2024-05-03 physics.comp-ph physics.data-an 78%

Multimodal reconstruction of TbCo thin film structure with Basyeian analysis of polarised neutron reflectivity

P. S. Savchenkov, K. V. Nikolaev, V. I. Bodnarchuk, A. N. Pirogov, A. V. Belushkin, S. N. Yakunin

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.18631 2024-04-30 cs.LG 78%

Feature importance to explain multimodal prediction models. A clinical use case

Jorn-Jan van de Beld, Shreyasi Pathak, Jeroen Geerdink, Johannes H. Hegeman, Christin Seifert

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted at World Conference on Explainable Artificial Intelligence; 19 pages, 2 figures, 7 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2312.09744 2024-04-25 cs.LG cond-mat.mtrl-sci 78%

Bridging the Semantic-Numerical Gap: A Numerical Reasoning Method of Cross-modal Knowledge Graph for Material Property Prediction

Guangxuan Song, Dongmei Fu, Zhongwei Qiu, Zijiang Yang, Jiaxin Dai, Lingwei Ma, Dawei Zhang

专题命中 其他多模态 :cross-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2302.03165 2024-04-24 math.OC 78%

The Impact of Congestion and Dedicated Lanes on On-Demand Multimodal Transit Systems

Jason Lu, Anthony Trasatti, Hongzhao Guan, Kevin Dalmeijer, Pascal Van Hentenryck

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2306.01163 2024-04-16 cs.SI cs.IR 78%

A Multi-Modal Latent-Features based Service Recommendation System for the Social Internet of Things

Amar Khelloufi, Huansheng Ning, Abdenacer Naouri, Abdelkarim Ben Sada, Attia Qammar, Abdelkader Khalil, Sahraoui Dhelim, Lingfeng Mao

专题命中 其他多模态 :multi-modal(title,abstract)

Comments Published in IEEE Transactions on Computational Social Systems

详情

展开后加载摘要…

URL PDF HTML 收藏
2310.15301 2024-04-15 cs.LG 78%

ADMarker: A Multi-Modal Federated Learning System for Monitoring Digital Biomarkers of Alzheimer's Disease

Xiaomin Ouyang, Xian Shuai, Yang Li, Li Pan, Xifan Zhang, Heming Fu, Sitong Cheng, Xinyan Wang, Shihua Cao, Jiang Xin, Hazel Mok, Zhenyu Yan, Doris Sau Fung Yu, Timothy Kwok, Guoliang Xing

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2404.05885 2024-04-10 cs.SI math.OC 78%

Design of Transit-Centric Multimodal Urban Mobility System with Autonomous Mobility-on-Demand

Xiaotong Guo, Jinhua Zhao

专题命中 其他多模态 :multimodal(title,abstract)

Comments 31 Pages, 11 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2311.12011 2024-04-04 nucl-th 78%

Multimodal fission from self-consistent calculations

Daniel Lay, Eric Flynn, Sylvester Agbemava, Kyle Godbey, Witold Nazarewicz, Samuel A. Giuliani, Jhilam Sadhukhan

专题命中 其他多模态 :multimodal(title,abstract)

Journal ref Phys. Rev. C 109, 044306 (2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.13066 2024-03-21 eess.SP 78%

Multimodal wearable EEG, EMG and accelerometry measurements improve the accuracy of tonic-clonic seizure detection in-hospital

Jingwei Zhang, Lauren Swinnen, Christos Chatzichristos, Victoria Broux, Renee Proost, Katrien Jansen, Benno Mahler, Nicolas Zabler, Nino Epitashvilli, Matthias Dümpelmann, Andreas Schulze-Bonhage, Elisabeth Schriewer, Ummahan Ermis, Stefan Wolking, Florian Linke, Yvonne Weber, Mkael Symmonds, Arjune Sen, Andrea Biondi, Mark P. Richardson, Abuhaiba Sulaiman, Ana Isabel Silva, Francisco Sales, Gergely Vértes, Wim Van Paesschen, Maarten De Vos

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.12719 2024-03-20 cs.LG 78%

Bilevel Hypergraph Networks for Multi-Modal Alzheimer's Diagnosis

Angelica I. Aviles-Rivero, Chun-Wun Cheng, Zhongying Deng, Zoe Kourtzi, Carola-Bibiane Schönlieb

专题命中 其他多模态 :multi-modal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2301.03414 2024-03-19 math.OC 78%

Multimodal Transportation Pricing Alliance Design: Large-Scale Optimization for Rapid Gains

Kayla Cummings, Vikrant Vaze, Özlem Ergun, Cynthia Barnhart

专题命中 其他多模态 :multimodal(title,abstract)

Comments v1 Submitted to Transportation Science 8 Jan 2023. v2 Submitted to Transportation Science 17 March 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.05002 2024-03-12 cs.RO 78%

LHMap-loc: Cross-Modal Monocular Localization Using LiDAR Point Cloud Heat Map

Xinrui Wu, Jianbo Xu, Puyuan Hu, Guangming Wang, Hesheng Wang

专题命中 其他多模态 :cross-modal(title,abstract)

Comments Accepted by 2024 IEEE International Conference on Robotics and Automation (ICRA 2024)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.04974 2024-03-12 cs.RO 78%

Embracing Large Language and Multimodal Models for Prosthetic Technologies

Sharmita Dey, Arndt F. Schilling

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.06027 2024-03-12 cs.LG eess.SP 78%

Multimodal deep learning approach to predicting neurological recovery from coma after cardiac arrest

Felix H. Krones, Ben Walker, Guy Parsons, Terry Lyons, Adam Mahdi

专题命中 其他多模态 :multimodal(title,abstract)

Comments 5 figures, 2 tables

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17188 2024-03-12 cs.IR 78%

PromptMM: Multi-Modal Knowledge Distillation for Recommendation with Prompt-Tuning

Wei Wei, Jiabin Tang, Yangqin Jiang, Lianghao Xia, Chao Huang

专题命中 其他多模态 :multi-modal(title,abstract)

Comments WWW 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2303.14718 2024-03-12 cs.RO 78%

Design and Control of a Small Humanoid Equipped with Flight Unit and Wheels for Multimodal Locomotion

Kazuki Sugihara, Moju Zhao, Takuzumi Nishio, Tasuku Makabe, Kei Okada, Masayuki Inaba

专题命中 其他多模态 :multimodal(title,abstract)

Comments 8 pages, 17 figures. Accepted by IEEE Robotics and Automation Letters

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17269 2024-03-11 cs.LG 78%

Curriculum Learning Meets Directed Acyclic Graph for Multimodal Emotion Recognition

Cam-Van Thi Nguyen, Cao-Bach Nguyen, Quang-Thuy Ha, Duc-Trong Le

专题命中 其他多模态 :multimodal(title,abstract)

Comments Accepted by LREC-COLING 2024

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.03775 2024-03-07 physics.optics cs.ET 78%

Photonic-electronic spiking neuron with multi-modal and multi-wavelength excitatory and inhibitory operation for high-speed neuromorphic sensing and computing

Weikang Zhang, Matěj Hejda, Qusay Raghib Ali Al-Taai, Dafydd Owen-Newns, Bruno Romeira, José M. L. Figueiredo, Joshua Robertson, Edward Wasige, Antonio Hurtado

专题命中 其他多模态 :multi-modal(title,abstract)

Comments 12 pages, 9 figures

详情

展开后加载摘要…

URL PDF HTML 收藏
2403.01524 2024-03-05 physics.app-ph physics.ins-det 78%

Aerosol Jet Printing of High-Temperature Multimodal Sensors for Strain and Temperature Sensing

Md. Omarsany Bappy, Qiang Jiang, Stephanie Atampugre, Yanliang Zhang

专题命中 其他多模态 :multimodal(title,abstract)

详情

展开后加载摘要…

URL PDF HTML 收藏
2402.17806 2024-02-29 cs.LG cond-mat.mtrl-sci stat.ML 78%

Material Microstructure Design Using VAE-Regression with Multimodal Prior

Avadhut Sardeshmukh, Sreedhar Reddy, BP Gautham, Pushpak Bhattacharyya

专题命中 其他多模态 :multimodal(title);multi-modal(abstract)

Comments 12 pages main paper, 9 pages appendix. 10 tables and 11 figures. Accepted for publication in PAKDD 2024

详情

展开后加载摘要…

URL PDF HTML 收藏