多模态大模型

A Coalition Game for On-demand Multi-modal 3D Automated Delivery System

Farzan Moosavi, Bilal Farooq

机构 * Laboratory of Innovations in Transportation (LiTrans), Toronto Metropolitan University, Toronto, Canada（创新交通实验室（LiTrans），多伦多 Metropolitan 大学，多伦多，加拿大） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)

UniPhyNet: A Unified Network For Multimodal Physiological Raw Signal Classification

Renxiang Qiu, Raghavendra Selvan

机构 * Department of Computer Science, University of Copenhagen（计算机科学系，哥本哈根大学） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments Accepted to be presented at the 35th IEEE International Workshop on Machine Learning for Signal Processing (IEEE MLSP 2025). Source code available at https://github.com/HughYau/UniPhyNet

Estimating Markers of Driving Stress through Multimodal Physiological Monitoring

Kleanthis Avramidis, Emily Zhou, Tiantian Feng, Hossein Hamidi Shishavan, Frederico Marcolino Quintao Severgnini, Danny J. Lohan, Paul Schmalenberg, Ercan M. Dede, Shrikanth Narayanan

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 11 pages, 7 figures, 3 tables. This work has been submitted to the IEEE for possible publication

Eyes on the Road, Mind Beyond Vision: Context-Aware Multi-modal Enhanced Risk Anticipation

Jiaxun Zhang, Haicheng Liao, Yumu Xie, Chengyue Wang, Yanchen Guan, Bin Rao, Zhenning Li

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments Accepted by ACMMM2025

Deep Survival Analysis in Multimodal Medical Data: A Parametric and Probabilistic Approach with Competing Risks

Alba Garrido, Alejandro Almodóvar, Patricia A. Apellániz, Juan Parras, Santiago Zazo

机构 * Information Processing and Telecommunications Center, ETSI Telecomunicación, Universidad Politécnica de Madrid, Spain（信息处理与电信中心，电信工程学院，马德里理工大学，西班牙） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 29 pages, 9 Figures

Multimodal signatures of asymptotic (A)dS Kalb-Ramond black holes: Constraints through the shadow, weak deflection angle, and topological photon spheres

Reggie C. Pantig, Ali Övgün

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 15 pages, 4 figures

Journal ref Annals of Physics 480 (2025) 170104

Mind Your Vision: Multimodal Estimation of Refractive Disorders Using Electrooculography and Eye Tracking

Xin Wei, Huakun Liu, Yutaro Hirao, Monica Perusquia-Hernandez, Katsutoshi Masai, Hideaki Uchiyama, Kiyoshi Kiyokawa

机构 * Nara Institute of Science and Technology（奈良科学技術大學） ； Kyushu University（九州大學） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

MissionGNN: Hierarchical Multimodal GNN-based Weakly Supervised Video Anomaly Recognition with Mission-Specific Knowledge Graph Generation

Sanggeon Yun, Ryozo Masukawa, Minhyoung Na, Mohsen Imani

专题命中 视频多模态 ：multimodal(title,abstract)

Comments Accepted to WACV 2025

Unveiling the Potential of Vision-Language-Action Models with Open-Ended Multimodal Instructions

Wei Zhao, Gongsheng Li, Zhefei Gong, Pengxiang Ding, Han Zhao, Donglin Wang

机构 * Westlake University（西湖大学） ； Zhejiang University（浙江大学） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)

Adaptive Gen-AI Guidance in Virtual Reality: A Multimodal Exploration of Engagement in Neapolitan Pizza-Making

Ka Hei Carrie Lau, Sema Sen, Philipp Stark, Efe Bozkir, Enkelejda Kasneci

专题命中 视频多模态 ：multimodal(title,abstract)

Exact Set Packing in Multimodal Transportation with Ridesharing System for First/Last Mile

Qian-Ping Gu, Jiajian Leo Liang

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 29 pages, 9 tables, 2 figures, and

MSCRS: Multi-modal Semantic Graph Prompt Learning Framework for Conversational Recommender Systems

Yibiao Wei, Jie Zou, Weikang Guo, Guoqing Wang, Xing Xu, Yang Yang

专题命中 视频多模态 ：multi-modal(title,abstract)

EDRF: Enhanced Driving Risk Field Based on Multimodal Trajectory Prediction and Its Applications

Junkai Jiang, Zeyu Han, Yuning Wang, Mengchi Cai, Qingwen Meng, Qing Xu, Jianqiang Wang

专题命中 视频多模态 ：multimodal(title,abstract)

DML-RAM: Deep Multimodal Learning Framework for Robotic Arm Manipulation using Pre-trained Models

Sathish Kumar, Swaroop Damodaran, Naveen Kumar Kuruba, Sumit Jha, Arvind Ramanathan

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 7 pages , 4 figures

PrefMMT: Modeling Human Preferences in Preference-based Reinforcement Learning with Multimodal Transformers

Dezhong Zhao, Ruiqi Wang, Dayoon Suh, Taehyeon Kim, Ziqin Yuan, Byung-Cheol Min, Guohua Chen

专题命中 视频多模态 ：multimodal(title,abstract)

CrossA11y: Identifying Video Accessibility Issues via Cross-modal Grounding

Xingyu "Bruce" Liu, Ruolin Wang, Dingzeyu Li, Xiang 'Anthony' Chen, Amy Pavel

专题命中 视频多模态 ：cross-modal(title,abstract)

Deep Multi-modal Neural Receiver for 6G Vehicular Communication

Osama Saleem, Mohammed Alfaqawi, Pierre Merdrignac, Abdelaziz Bensrhair, Soheyb Ribouh

专题命中 视频多模态 ：multi-modal(title,abstract)

Can AI Prompt Humans? Multimodal Agents Prompt Players' Game Actions and Show Consequences to Raise Sustainability Awareness

Qinshi Zhang, Ruoyu Wen, Latisha Besariani Hendra, Zijian Ding, Ray LC

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 25 pages, 11 figures

Resistive memory-based zero-shot liquid state machine for multimodal event data learning

Ning Lin, Shaocong Wang, Yi Li, Bo Wang, Shuhui Shi, Yangu He, Woyu Zhang, Yifei Yu, Yue Zhang, Xinyuan Zhang, Kwunhang Wong, Songqi Wang, Xiaoming Chen, Hao Jiang, Xumeng Zhang, Peng Lin, Xiaoxin Xu, Xiaojuan Qi, Zhongrui Wang, Dashan Shang, Qi Liu, Ming Liu

专题命中 视频多模态 ：multimodal(title,abstract)

Deep sr-DDL: Deep Structurally Regularized Dynamic Dictionary Learning to Integrate Multimodal and Dynamic Functional Connectomics data for Multidimensional Clinical Characterizations

Niharika Shimona D'Souza, Mary Beth Nebel, Deana Crocetti, Nicholas Wymbs, Joshua Robinson, Stewart H. Mostofsky, Archana Venkataraman

专题命中 视频多模态 ：multimodal(title,abstract)

A Deep-Generative Hybrid Model to Integrate Multimodal and Dynamic Connectivity for Predicting Spectrum-Level Deficits in Autism

Niharika Shimona D'Souza, Mary Beth Nebel, Deana Crocetti, Nicholas Wymbs, Joshua Robinson, Stewart Mostofsky, Archana Venkataraman

专题命中 视频多模态 ：multimodal(title,abstract)

SimTube: Generating Simulated Video Comments through Multimodal AI and User Personas

Yu-Kai Hung, Yun-Chien Huang, Ting-Yu Su, Yen-Ting Lin, Lung-Pan Cheng, Bryan Wang, Shao-Hua Sun

专题命中 视频多模态 ：multimodal(title,abstract)

Movie Trailer Genre Classification Using Multimodal Pretrained Features

Serkan Sulun, Paula Viana, Matthew E. P. Davies

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.AI、cs.MM

Journal ref Expert Systems with Applications 258 (2024) 125209

Multi-Modal Learning-based Reconstruction of High-Resolution Spatial Wind Speed Fields

Matteo Zambra, Nicolas Farrugia, Dorian Cazau, Alexandre Gensse, Ronan Fablet

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments 22 pages, 13 figures. This work is to be submitted to the IEEE for possible publication

vailá: Versatile Anarcho Integrated Liberation Ánalysis in Multimodal Toolbox

Paulo Roberto Pereira Santiago, Abel Gonçalves Chinaglia, Kira Flanagan, Bruno L. S. Bedo, Ligia Yumi Mochida, Juan Aceros, Aline Bononi, Guilherme Manna Cesar

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 21 pages, 13 figures, submitted to arXiv under cs.SE (Software Engineering)

Towards Robust Perception for Assistive Robotics: An RGB-Event-LiDAR Dataset and Multi-Modal Detection Pipeline

Adam Scicluna, Cedric Le Gentil, Sheila Sutjipto, Gavin Paul

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments Accepted to the 2024 IEEE International Conference on Automation Science and Engineering (CASE)

An Efficient and Explanatory Image and Text Clustering System with Multimodal Autoencoder Architecture

Tiancheng Shi, Yuanchen Wei, John R. Kender

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.AI、cs.MM

Towards Enhanced Context Awareness with Vision-based Multimodal Interfaces

Yongquan Hu, Wen Hu, Aaron Quigley

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 3 pages, MOBILEHCI Adjunct '24 26th International Conference on Mobile Human-Computer Interaction, September 30-October 3, 2024, Melbourne, VIC, Australia

Emolysis: A Multimodal Open-Source Group Emotion Analysis and Visualization Toolkit

Shreya Ghosh, Zhixi Cai, Parul Gupta, Garima Sharma, Abhinav Dhall, Munawar Hayat, Tom Gedeon

专题命中 视频多模态 ：multimodal(title,abstract)

Comments Accepted by ACII Demo 2024. Both Shreya Ghosh and Zhixi Cai contributed equally to this research

Multimodal Chaptering for Long-Form TV Newscast Video

Khalil Guetari, Yannis Tevissen, Frédéric Petitpont

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.AI、cs.MM