多模态大模型

UT-OSANet: A Multimodal Deep Learning model for Evaluating and Classifying Obstructive Sleep Apnea

UT-OSANet: 一种用于评估和分类阻塞性睡眠呼吸暂停的多模态深度学习模型

Zijian Wang, Xiaoyu Bao, Chenhao Zhao, Jihui Zhang, Sizhi Ai, Yuanqing Li

专题命中 视频多模态 ：multimodal(title)；cross-modal(abstract)

AI总结 UT-OSANet是一种多模态深度学习模型，用于高精度评估和分类阻塞性睡眠呼吸暂停，通过多种输入模态和灵活训练策略实现事件层面的诊断。

Comments 12 pages,8 figures

NeuroLingua: A Language-Inspired Hierarchical Framework for Multimodal Sleep Stage Classification Using EEG and EOG

Mahdi Samaee, Mehran Yazdi, Daniel Massicotte

专题命中 视频多模态 ：multimodal(title,abstract)

A cross-modal pre-training framework with video data for improving performance and generalization of distributed acoustic sensing

Junyi Duan, Jiageng Chen, Zuyuan He

专题命中 视频多模态 ：cross-modal(title,abstract)

xHAP: Cross-Modal Attention for Haptic Feedback Estimation in the Tactile Internet

Georgios Kokkinis, Alexandros Iosifidis, Qi Zhang

专题命中 视频多模态 ：cross-modal(title,abstract)

Comments 12 pages, 13 figures, 3 tables, 2 algorithms

HiMaCon: Discovering Hierarchical Manipulation Concepts from Unlabeled Multi-Modal Data

Ruizhe Liu, Pei Zhou, Qian Luo, Li Sun, Jun Cen, Yibing Song, Yanchao Yang

机构 * HKU Musketeers Foundation Institute of Data Science（香港大学数据科学学院） ； The University of Hong Kong（香港大学） ； DAMO Academy（达摩院） ； Alibaba Group（阿里巴巴集团） 纠错

专题命中 视频多模态 ：multi-modal(title)；cross-modal(abstract)

Comments Accepted at 39th Conference on Neural Information Processing Systems (NeurIPS 2025)

MM-2FSK: Multimodal Frequency Shift Keying for Ultra-Efficient and Robust High-Resolution MIMO Radar Imaging

Vanessa Wirth, Johanna Bräunig, Martin Vossiek, Tim Weyrich, Marc Stamminger

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 9 pages

Enhancing Heavy Rain Nowcasting with Multimodal Data: Integrating Radar and Satellite Observations

Rama Kassoumeh, David Rügamer, Henning Oppel

机构 * Bochum Institute of Technology（波恩技术学院） ； LMU Munich（慕尼黑大学） ； Munich Center for Machine Learning（慕尼黑机器学习中心） ； Okeanos Smart Data Solutions GmbH（Okeanos智能数据解决方案有限公司） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments accepted to ICMLA 2025

Cross-Modal Temporal Fusion for Financial Market Forecasting

Yunhua Pei, John Cartlidge, Anandadeep Mandal, Daniel Gold, Enrique Marcilio, Riccardo Mazzon

机构 * School of Computer Science, University of Bristol, Bristol, UK（布里斯托大学计算机科学学院） ； School of Engineering Mathematics and Technology, University of Bristol, Bristol, UK（布里斯托大学工程数学与技术学院） ； School of Engineering Mathematics（工程数学学院） ； Technology, University of Bristol, Bristol, UK（技术学院） ； Business School, University of Birmingham, Birmingham, UK（伯明翰大学商学院） ； Stratiphy Limited, London, UK（Stratiphy公司） 纠错

专题命中 视频多模态 ：cross-modal(title,abstract)

Comments 10 pages, 4 figures, manuscript accepted to PAIS at ECAI-2025 European Conference on Artificial Intelligence, October 25-30, 2025, Bologna, Italy

Journal ref Frontiers in Artificial Intelligence and Applications, vol. 413, ECAI 2025, pp. 5360 - 5367

Unlocking Dynamic Luminescent Mapping of pH with Sustainable Lignin-Derived Carbon Dots with Multimodal Readout Capacity

Maja Szymczak, Jan Hočevar, Jernej Iskra, Darja Lisjak, Jelena Papan Djaniš, Lukasz Marciniak, Karolina Elzbieciak-Piecka

专题命中 视频多模态 ：multimodal(title,abstract)

LLM-Integrated Bayesian State Space Models for Multimodal Time-Series Forecasting

Sungjun Cho, Changho Shin, Suenggwan Jo, Xinya Yan, Shourjo Aditya Chaudhuri, Frederic Sala

机构 * Department of Computer Sciences University of Wisconsin-Madison（计算机科学系威斯康星大学麦迪逊分校） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 15 pages, 8 figures

Scalable Multi-modal Model Predictive Control via Duality-based Interaction Predictions

Hansung Kim, Siddharth H. Nair, Francesco Borrelli

机构 * Model Predictive Control Laboratory, UC Berkeley（模型预测控制实验室，伯克利大学） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments Accepted at IEEE Intelligent Vehicles Symposium 2024

AccidentBench: Benchmarking Multimodal Understanding and Reasoning in Vehicle Accidents and Beyond

Shangding Gu, Xiaohan Wang, Donghao Ying, Haoyu Zhao, Runing Yang, Ming Jin, Boyi Li, Marco Pavone, Serena Yeung-Levy, Jun Wang, Dawn Song, Costas Spanos

机构 * UC Berkeley（伯克利大学） ； Stanford（斯坦福大学） ； UCL（伦敦大学学院） ； Virginia Tech（弗吉尼亚理工学院） ； Nvidia（英伟达公司） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Spiking Neural Networks for Mental Workload Classification with a Multimodal Approach

Jiahui An, Sara Irina Fabrikant, Giacomo Indiveri, Elisa Donati

机构 * Institute of Neuroinformatics, University of Zurich（神经信息学研究所，苏黎世大学） ； ETH Zurich（苏黎世联邦理工学院） ； Digital Society Initiative, University of Zurich（数字社会倡议，苏黎世大学） ； Department of Geography（地理系） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 8 pages

GluMind: Multimodal Parallel Attention and Knowledge Retention for Robust Cross-Population Blood Glucose Forecasting

Ebrahim Farahmand, Reza Rahimi Azghan, Nooshin Taheri Chatrudi, Velarie Yaa Ansu-Baidoo, Eric Kim, Gautham Krishna Gudur, Mohit Malu, Owen Krueger, Edison Thomaz, Giulia Pedrielli, Pavan Turaga, Hassan Ghasemzadeh

机构 * Arizona State University（亚利桑那州立大学） ； University of Miami（迈阿密大学） ； The University of Texas at Austin（德克萨斯大学奥斯汀分校） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

ClassMind: Scaling Classroom Observation and Instructional Feedback with Multimodal AI

Ao Qu, Yuxi Wen, Jiayi Zhang, Yunge Wen, Yibo Zhao, Alok Prakash, Andrés F. Salazar-Gómez, Paul Pu Liang, Jinhua Zhao

专题命中 视频多模态 ：multimodal(title,abstract)

TACTFL: Temporal Contrastive Training for Multi-modal Federated Learning with Similarity-guided Model Aggregation

Guanxiong Sun, Majid Mirmehdi, Zahraa Abdallah, Raul Santos-Rodriguez, Ian Craddock, Telmo de Menezes e Silva Filho

专题命中 视频多模态 ：multi-modal(title,abstract)

Diffusion-Based Approximate MPC: Fast and Consistent Imitation of Multi-Modal Action Distributions

Pau Marquez Julbe, Julian Nubert, Henrik Hose, Sebastian Trimpe, Katherine J. Kuchenbecker

机构 * Max Planck ETH CLS（马克斯·普朗克-ETH CLS） ； German Research Foundation（德国研究基金会） ； Max Planck Institute for Intelligent Systems（马克斯·普朗克智能系统研究所） ； ETH Zürich（苏黎世联邦理工学院） ； Institute for Data Science in Mechanical Engineering (DSME)（机械工程数据科学研究所） ； RWTH Aachen University（亚琛工业大学） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)

Multi-modal Adaptive Estimation for Temporal Respiratory Disease Outbreak

Hong Liu, Kerui Cen, Yanxing Chen, Zige Liu, Dong Chen, Zifeng Yang, Chitin Hon

机构 * Respiratory Disease AI Laboratory in Epidemic Intelligence and Applications of Medical Big Data Instruments, Macau University of Science and Technology（呼吸疾病人工智能实验室（流行病智能与医学大数据应用）） ； Faculty of Innovation Engineering, Macau University of Science and Technology（创新工程学院） ； Institute of Systems Engineering, Macau University of Science and Technology（系统工程研究所） ； School of Business, Macau University of Science and Technology（商学院） ； State Key Laboratory of Respiratory Disease, National Clinical Research Center for Respiratory Disease, Guangzhou Institute of Respiratory Health, The First Affiliated Hospital of Guangzhou Medical University（呼吸疾病国家重点实验室、呼吸疾病临床研究中心、广州呼吸健康研究院、广州医学院第一附属医院） ； Guangzhou National Laboratory（广州国家实验室） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)

Video2Roleplay: A Multimodal Dataset and Framework for Video-Guided Role-playing Agents

Xueqiao Zhang, Chao Zhang, Jingtao Xu, Yifan Zhu, Xin Shi, Yi Yang, Yawei Luo

机构 * Zhejiang University（浙江大学） 纠错

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.CL、cs.MM

Comments Accepted at EMNLP2025 Main

FlowAct: A Proactive Multimodal Human-robot Interaction System with Continuous Flow of Perception and Modular Action Sub-systems

Timothée Dhaussy, Bassam Jabaian, Fabrice Lefèvre

机构 * Laboratoire Informatique d'Avignon, Avignon University, France（阿维尼翁信息实验室，阿维尼翁大学，法国） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments Paper accepted at ICPRAM 2025

Attention, Action, and Memory: How Multi-modal Interfaces and Cognitive Load Alter Information Retention

Omar Elgohary, Zhu-Tien

专题命中 视频多模态 ：multi-modal(title,abstract)

ThumbnailTruth: A Multi-Modal LLM Approach for Detecting Misleading YouTube Thumbnails Across Diverse Cultural Settings

Wajiha Naveed, Zartash Afzal Uzmi, Zafar Ayyub Qazi

专题命中 视频多模态 ：multi-modal(title,abstract)

Temporal Interest-Driven Multimodal Personalized Content Generation

Tian Miao

专题命中 视频多模态 ：multimodal(title,abstract)

COBRA: Multimodal Sensing Deep Learning Framework for Remote Chronic Obesity Management via Wrist-Worn Activity Monitoring

Zhengyang Shen, Bo Gao, Mayue Shi

机构 * Department of Electrical and Electronic Engineering, Imperial College London, London SW7 2AZ, UK（帝国理工学院电子与电气工程系） ； Institute of Biomedical Engineering, Department of Engineering Science, University of Oxford, Oxford OX3 7DQ, UK（牛津大学生物医学工程研究所） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 19 pages, 4 figures. *Correspondence: m.shi16@imperial.ac.uk. Accepted by the IUPESM World Congress on Medical Physics and Biomedical Engineering 2025

Short-Form Video Recommendations with Multimodal Embeddings: Addressing Cold-Start and Bias Challenges

Andrii Dzhoha, Katya Mirylenka, Egor Malykh, Marco-Andrea Buchmann, Francesca Catino

机构 * Zalando SE Berlin Germany（泽尔安多德国分公司） ； Zalando Switzerland AG Zürich Switzerland（泽尔安多瑞士分公司） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Counterfactual Reward Model Training for Bias Mitigation in Multimodal Reinforcement Learning

Sheryl Mathew, N Harshit

专题命中 视频多模态 ：multimodal(title,abstract)

MultiPark: Multimodal Parking Transformer with Next-Segment Prediction

Han Zheng, Zikang Zhou, Guli Zhang, Zhepei Wang, Kaixuan Wang, Peiliang Li, Shaojie Shen, Ming Yang, Tong Qin

机构 * Shanghai Jiao Tong University（上海交通大学） ； Zhuoyu Technology, Co., Ltd.（珠海宇科技有限公司） ； Department of Electronic and Computer Engineering, Hong Kong University of Science and Technology（香港理工大学电子与计算机工程系） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Multimodal learning enables instant ionizing radiation alerts on unmodified mobile phones for real-world emergency response

Yanfeng Xie, Xingzhi Cheng

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 17 pages, 9 figures

MambaITD: An Efficient Cross-Modal Mamba Network for Insider Threat Detection

Kaichuan Kong, Dongjie Liu, Xiaobo Jin, Zhiying Li, Guanggang Geng, Jian Weng

机构 * College of Cyber Security（网络安全学院） ； Jinan University（济南大学） ； Department of Electrical and Electronic Engineering（电子与电气工程系） ； Xi’an Jiaotong-Liverpool University（西安交通大学利物浦大学） 纠错

专题命中 视频多模态 ：cross-modal(title,abstract)

Comments Submitted to the 2025 IEEE International Conference on Data Mining (ICDM)

Efficient rare event estimation for multimodal and high-dimensional system reliability via subset adaptive importance sampling

Sara Helal, Victor Elvira

专题命中 视频多模态 ：multimodal(title,abstract)