多模态大模型

AlanaVLM: A Multimodal Embodied AI Foundation Model for Egocentric Video Understanding

Alessandro Suglia, Claudio Greco, Katie Baker, Jose L. Part, Ioannis Papaioannou, Arash Eshghi, Ioannis Konstas, Oliver Lemon

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

Comments Code available https://github.com/alanaai/EVUD

Remaining useful life prediction of Lithium-ion batteries using spatio-temporal multimodal attention networks

Sungho Suh, Dhruv Aditya Mittal, Hymalai Bello, Bo Zhou, Mayank Shekhar Jha, Paul Lukowicz

专题命中 视频多模态 ：multimodal(title,abstract)

Multi-layer Learnable Attention Mask for Multimodal Tasks

Wayner Barrios, SouYoung Jin

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.AI、cs.MM

Multi-modal Mood Reader: Pre-trained Model Empowers Cross-Subject Emotion Recognition

Yihang Dong, Xuhang Chen, Yanyan Shen, Michael Kwok-Po Ng, Tao Qian, Shuqiang Wang

专题命中 视频多模态 ：multi-modal(title)；multimodal(abstract)

Comments Accepted by International Conference on Neural Computing for Advanced Applications, 2024

Temporal Cross-Attention for Dynamic Embedding and Tokenization of Multimodal Electronic Health Records

Yingbo Ma, Suraj Kolla, Dhruv Kaliraman, Victoria Nolan, Zhenhong Hu, Ziyuan Guan, Yuanfang Ren, Brooke Armfield, Tezcan Ozrazgat-Baslanti, Tyler J. Loftus, Parisa Rashidi, Azra Bihorac, Benjamin Shickel

专题命中 视频多模态 ：multimodal(title,abstract)

Comments ICLR 2024 Workshop on Learning From Time Series for Health. 10 pages, 3 figures

Process signature-driven high spatio-temporal resolution alignment of multimodal data

Abhishek Hanchate, Himanshu Balhara, Vishal S. Chindepalli, Satish T. S. Bukkapatnam

专题命中 视频多模态 ：multimodal(title,abstract)

Multimodal Sleep Apnea Detection with Missing or Noisy Modalities

Hamed Fayyaz, Abigail Strang, Niharika S. D'Souza, Rahmatollah Beheshti

专题命中 视频多模态 ：multimodal(title,abstract)

MTRGL:Effective Temporal Correlation Discerning through Multi-modal Temporal Relational Graph Learning

Junwei Su, Shan Wu, Jinhui Li

专题命中 视频多模态 ：multi-modal(title,abstract)

Haptics-Enabled Forceps with Multi-Modal Force Sensing: Towards Task-Autonomous Surgery

Tangyou Liu, Tinghua Zhang, Jay Katupitiya, Jiaole Wang, Liao Wu

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments 12 pages, 9 figures, accepted by T-MECH

Journal ref IEEE/ASME Transactions on Mechatronics. 2023:1-12

CognitiveDog: Large Multimodal Model Based System to Translate Vision and Language into Action of Quadruped Robot

Artem Lykov, Mikhail Litvinov, Mikhail Konenkov, Rinat Prochii, Nikita Burtsev, Ali Alridha Abdulkarim, Artem Bazhenov, Vladimir Berman, Dzmitry Tsetserukou

专题命中 视频多模态 ：multimodal(title)；multi-modal(abstract)

Comments This paper has been accepted for publication at the HRI2024 conference

Non-contact Multimodal Indoor Human Monitoring Systems: A Survey

Le Ngu Nguyen, Praneeth Susarla, Anirban Mukherjee, Manuel Lage Cañellas, Constantino Álvarez Casado, Xiaoting Wu, Olli~Silvén, Dinesh Babu Jayagopi, Miguel Bordallo López

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 19 pages, 5 figures

Spectral-temporal-spatial customization via modulating multimodal nonlinear pulse propagation

Tong Qiu, Honghao Cao, Kunzan Liu, Li-Yu Yu, Manuel Levy, Eva Lendaro, Fan Wang, Sixian You

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 36 pages, 19 figures

Uncovering Gender Stereotypes in Video Game Character Designs: A Multi-Modal Analysis of Honor of Kings

Bingqing Liu, Kyrie Zhixuan Zhou, Danlei Zhu, Jaihyun Park

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments 3rd International Conference on Natural Language Processing for Digital Humanities (NLP4DH)

Quantitative Evaluation of a Multi-Modal Camera Setup for Fusing Event Data with RGB Images

Julian Moosmann, Jakub Mandula, Philipp Mayer, Luca Benini, Michele Magno

专题命中 视频多模态 ：multi-modal(title,abstract)

A Multimodal Sensing Ring for Quantification of Scratch Intensity

Akhil Padmanabha, Sonal Choudhary, Carmel Majidi, Zackory Erickson

专题命中 视频多模态 ：multimodal(title,abstract)

Journal ref Commun Med 3, 115 (2023)

Close-up and Whispering: An Understanding of Multimodal and Parasocial Interactions in YouTube ASMR videos

Shuo Niu, Hugh S. Manon, Ava Bartolome, Nguyen B. Ha, Keegan Veazey

专题命中 视频多模态 ：multimodal(title,abstract)

Comments 4 pages

Multimodal Graph Learning for Modeling Emerging Pandemics with Big Data

Khanh-Tung Tran, Truong Son Hy, Lili Jiang, Xuan-Son Vu

专题命中 视频多模态 ：multimodal(title)；multi-modal(abstract)

Spatio-Temporal Wildfire Prediction using Multi-Modal Data

Chen Xu, Yao Xie, Daniel A. Zuniga Vazquez, Rui Yao, Feng Qiu

专题命中 视频多模态 ：multi-modal(title,abstract)

Integration-free Training for Spatio-temporal Multimodal Covariate Deep Kernel Point Processes

Yixuan Zhang, Quyu Kong, Feng Zhou

专题命中 视频多模态 ：multimodal(title,abstract)

Twin Graph-based Anomaly Detection via Attentive Multi-Modal Learning for Microservice System

Jun Huang, Yang Yang, Hang Yu, Jianguo Li, Xiao Zheng

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments This paper have been accepted by ASE 2023

Event-Enhanced Multi-Modal Spiking Neural Network for Dynamic Obstacle Avoidance

Yang Wang, Bo Dong, Yuji Zhang, Yunduo Zhou, Haiyang Mei, Ziqi Wei, Xin Yang

专题命中 视频多模态 ：multi-modal(title)；multimodal(abstract)

Comments In Proceedings of the 31st ACM International Conference on Multimedia (ACM MM 2023)

Multi-Modal Embeddings for Isolating Cross-Platform Coordinated Information Campaigns on Social Media

Fabio Barbero, Sander op den Camp, Kristian van Kuijk, Carlos Soto García-Delgado, Gerasimos Spanakis, Adriana Iamnitchi

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments To appear in the 5th Multidisciplinary International Symposium on Disinformation in Open Online Media (MISDOOM 2023)

Multimodal Integration of Olfactory and Visual Processing through DCM analysis: Contextual Modulation of Facial Perception

Gianluca Rho, Alejandro Luis Callara, Francesco Bossi, Dimitri Ognibene, Cinzia Cecchetto, Tommaso Lomonaco, Enzo Pasquale Scilingo, Alberto Greco

专题命中 视频多模态 ：multimodal(title,abstract)

Video Multimodal Emotion Recognition System for Real World Applications

Sun-Kyung Lee, Jong-Hwan Kim

专题命中 视频多模态 ：multimodal(title,abstract)

Comments Interspeech 2023

Reparameterized Policy Learning for Multimodal Trajectory Optimization

Zhiao Huang, Litian Liang, Zhan Ling, Xuanlin Li, Chuang Gan, Hao Su

专题命中 视频多模态 ：multimodal(title,abstract)

Multimodal Temporal Fusion Transformers Are Good Product Demand Forecasters

Maarten Sukel, Stevan Rudinac, Marcel Worring

专题命中 视频多模态 ：multimodal(title,abstract)

Identifying shifts in multi-modal travel patterns during special events using mobile data: Celebrating Vappu in Helsinki

Zhiren Huang, Charalampos Sipetas, Alonso Espinosa Mireles de Villafranca, Tri Quach

专题命中 视频多模态 ：multi-modal(title,abstract)

Comments 6 pages, 12 figures, Submitted to ITSC2023

Collaborative Recommendation Model Based on Multi-modal Multi-view Attention Network: Movie and literature cases

Zheng Hu, Shi-Min Cai, Jun Wang, Tao Zhou

专题命中 视频多模态 ：multi-modal(title,abstract)

Multimodal Detection and Identification of Robot Manipulation Failures

Arda Inceoglu, Eren Erdal Aksoy, Sanem Sariel

专题命中 视频多模态 ：multimodal(title,abstract)

Comments arXiv admin note: text overlap with arXiv:2011.05817

Bronchoscopic video synchronization for interactive multimodal inspection of bronchial lesions

Qi Chang, Patrick D. Byrnes, Danish Ahmad, Jennifer Toth, Rebecca Bascom, William E. Higgins

专题命中 视频多模态 ：multimodal(title,abstract)