多模态大模型

Investigating and Enhancing the Robustness of Large Multimodal Models Against Temporal Inconsistency

Jiafeng Liang, Shixin Jiang, Xuan Dong, Ning Wang, Zheng Chu, Hui Su, Jinlan Fu, Ming Liu, See-Kiong Ng, Bing Qin

机构 * Harbin Institute of Technology（哈尔滨工业大学） ； Peng Cheng Laboratory（鹏城实验室） ； National University of Singapore（新加坡国立大学） ； Meituan Inc.（美团公司） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Early Risk Prediction of Pediatric Cardiac Arrest from Electronic Health Records via Multimodal Fused Transformer

Jiaying Lu, Stephanie R. Brown, Songyuan Liu, Shifan Zhao, Kejun Dong, Del Bold, Michael Fundora, Alaa Aljiffry, Alex Fedorov, Jocelyn Grunwell, Xiao Hu

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Journal ref in Proceedings of 47th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC 2025)

METDrive: Multi-modal End-to-end Autonomous Driving with Temporal Guidance

Ziang Guo, Xinhao Lin, Zakhar Yagudin, Artem Lykov, Yong Wang, Yanqiang Li, Dzmitry Tsetserukou

机构 * Intelligent Space Robotics Laboratory, Center for Digital Engineering, Skolkovo Institute of Science and Technology（斯克尔科沃科学与技术研究所智能空间机器人实验室，数字工程中心） ； Institute of Automation, Qilu University of Technology (Shandong Academy of Sciences)（齐鲁科技大学自动化研究所，山东科学院） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by ICRA

A Comparative Study of Human Activity Recognition: Motion, Tactile, and multi-modal Approaches

Valerio Belcamino, Nhat Minh Dinh Le, Quan Khanh Luu, Alessandro Carfì, Van Anh Ho, Fulvio Mastrogiovanni

机构 * University of Genoa（热力学与系统工程系，基因瓦大学） ； The University of Danang–University of Science and Technology（丹那大学–科学与技术大学） ； Japan Advanced Institute of Science and Technology（日本先进科学研究院） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.AI

A Short Overview of Multi-Modal Wi-Fi Sensing

Zijian Zhao

机构 * Department of Civil and Environmental Engineering（土木及环境工程系） ； The Hong Kong University of Science and Technology（香港科学与技术大学） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.AI

Exploring Multimodal Foundation AI and Expert-in-the-Loop for Sustainable Management of Wild Salmon Fisheries in Indigenous Rivers

Chi Xu, Yili Jin, Sami Ma, Rongsheng Qian, Hao Fang, Jiangchuan Liu, Xue Liu, Edith C. H. Ngai, William I. Atlas, Katrina M. Connors, Mark A. Spoljaric

机构 * Simon Fraser University（西蒙弗雷泽大学） ； McGill University（麦吉尔大学） ； The University of Hong Kong（香港大学） ； Wild Salmon Center（野生鲑鱼中心） ； Pacific Salmon Foundation（太平洋鲑鱼基金会） ； Haida Fisheries Program（海达渔业计划） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 10 pages, accepted by IJCAI 2025, AI and Social Good Track

Uncertainty-Weighted Image-Event Multimodal Fusion for Video Anomaly Detection

Sungheon Jeong, Jihong Park, Mohsen Imani

机构 * University of California, Irvine（加州大学尔湾分校） 纠错

专题命中 视频多模态 ：multimodal(title)；cross-modal(abstract)；分类 cs.CV

PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulation

Zhuoman Liu, Weicai Ye, Yan Luximon, Pengfei Wan, Di Zhang

机构 * The Hong Kong Polytechnic University（香港理工大学） ； Kuaishou Technology（快手科技） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments CVPR 2025. Homepage: https://zhuomanliu.github.io/PhysFlow/

Visual Dominance and Emerging Multimodal Approaches in Distracted Driving Detection: A Review of Machine Learning Techniques

Anthony Dontoh, Stephanie Ivey, Logan Sirbaugh, Andrews Danyo, Armstrong Aboah

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Multi-modal Transfer Learning for Dynamic Facial Emotion Recognition in the Wild

Ezra Engel, Lishan Li, Chris Hudy, Robert Schleusner

机构 * Georgia Institute of Technology（佐治亚理工学院） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 8 pages, 6 figures

Multimodal Conditioned Diffusive Time Series Forecasting

Chen Su, Yuanhe Tian, Yan Song

机构 * University of Science and Technology of China（中国科学技术大学） ； University of Washington（华盛顿大学） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CL

TabulaTime: A Novel Multimodal Deep Learning Framework for Advancing Acute Coronary Syndrome Prediction through Environmental and Clinical Data Integration

Xin Zhang, Liangxiu Han, Stephen White, Saad Hassan, Philip A Kalra, James Ritchie, Carl Diver, Jennie Shorley

机构 * Department of Computing, and Mathematics, Manchester Metropolitan University（计算机与数学系，曼彻斯特 Metropolitan 大学） ； Blackpool Teaching Hospitals NHS Foundation Trust（布莱克浦教学医院 NHS 基础信托） ； Northern Care Alliance, NHS Foundation Trust（北方护理联盟，NHS 基础信托） ； Department of Engineering, Manchester Metropolitan University（工程系，曼彻斯特 Metropolitan 大学） ； Faculty of Business and Law, Manchester Metropolitan University（商业与法律学院，曼彻斯特 Metropolitan 大学） ； Faculty of Medical Sciences, Newcastle University（医学科学学院，纽卡斯尔大学） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

ActionArt: Advancing Multimodal Large Models for Fine-Grained Human-Centric Video Understanding

Yi-Xing Peng, Qize Yang, Yu-Ming Tang, Shenghao Fu, Kun-Yu Lin, Xihan Wei, Wei-Shi Zheng

机构 * Sun Yat-sen University, China（中山大学） ； Tongyi Lab, Alibaba Group（通义实验室，阿里巴巴集团） ； Peng Cheng Laboratory, Shenzhen, China（鹏城实验室，深圳，中国） ； Key Laboratory of Machine Intelligence and Advanced Computing, Ministry of Education, China（教育部人工智能与先进计算重点实验室） 纠错

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

ST-Think: How Multimodal Large Language Models Reason About 4D Worlds from Ego-Centric Videos

Peiran Wu, Yunze Liu, Miao Liu, Junxiao Shen

机构 * University of Bristol（布里斯托大学） ； X-Intelligence Labs（X-智能实验室） ； Meta 纠错

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Multi-Modal Fusion of In-Situ Video Data and Process Parameters for Online Forecasting of Cookie Drying Readiness

Shichen Li, Chenhui Shao

机构 * Department of Mechanical Science and Engineering, University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校机械科学与工程系） ； Department of Mechanical Engineering, University of Michigan（密歇根大学机械工程系） 纠错

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments 17 pages, 12 figures

Few-Shot Referring Video Single- and Multi-Object Segmentation via Cross-Modal Affinity with Instance Sequence Matching

Heng Liu, Guanghui Li, Mingqi Gao, Xiantong Zhen, Feng Zheng, Yang Wang

专题命中 视频多模态 ：cross-modal(title,abstract)；分类 cs.CV

Comments 23 pages, 10 figures

Multimodal Spatio-temporal Graph Learning for Alignment-free RGBT Video Object Detection

Qishun Wang, Zhengzheng Tu, Chenglong Li, Bo Jiang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Contextual AD Narration with Interleaved Multimodal Sequence

Hanlin Wang, Zhan Tong, Kecheng Zheng, Yujun Shen, Limin Wang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments Accepted by CVPR25

Multimodal Long Video Modeling Based on Temporal Dynamic Context

Haoran Hao, Jiaming Han, Yiyuan Zhang, Xiangyu Yue

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV、cs.CL、cs.AI

PRM-BAS: Enhancing Multimodal Reasoning through PRM-guided Beam Annealing Search

Pengfei Hu, Zhenrong Zhang, Qikai Chang, Shuhang Liu, Jiefeng Ma, Jun Du, Jianshu Zhang, Quan Liu, Jianqing Gao, Feng Ma, Qingfeng Liu

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.MM

End-to-end Open-vocabulary Video Visual Relationship Detection using Multi-modal Prompting

Yongqi Wang, Xinxiao Wu, Shuo Yang, Jiebo Luo

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Accepted by TPAMI

Research on the Design of a Short Video Recommendation System Based on Multimodal Information and Differential Privacy

Haowei Yang, Lei Fu, Qingyi Lu, Yue Fan, Tianle Zhang, Ruohan Wang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

RAVEN: An Agentic Framework for Multimodal Entity Discovery from Large-Scale Video Collections

Kevin Dela Rosa

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments Presented at AI Agent for Information Retrieval: Generating and Ranking (Agent4IR) @ AAAI 2025 [https://sites.google.com/view/ai4ir/aaai-2025]

Comparing Apples to Oranges: LLM-powered Multimodal Intention Prediction in an Object Categorization Task

Hassan Ali, Philipp Allgeuer, Stefan Wermter

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments Published in the Proceedings of the 16th International Conference on Social Robotics (ICSR) 2024,15 pages,5 figures,2 tables; work was co-funded by Horizon Europe project TERAIS under Grant agreement number 101079338

Journal ref In: Palinko, O., et al. Social Robotics. ICSR + AI 2024. vol 15563. Springer (2025)

The 1st Solution for 4th PVUW MeViS Challenge: Unleashing the Potential of Large Multimodal Models for Referring Video Segmentation

Hao Fang, Runmin Cong, Xiankai Lu, Zhiyang Chen, Wei Zhang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

MultiTSF: Transformer-based Sensor Fusion for Human-Centric Multi-view and Multi-modal Action Recognition

Trung Thanh Nguyen, Yasutomo Kawanishi, Vijay John, Takahiro Komamizu, Ichiro Ide

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments This is a part of article arXiv:2504.02287

Slow-Fast Architecture for Video Multi-Modal Large Language Models

Min Shi, Shihao Wang, Chieh-Yun Chen, Jitesh Jain, Kai Wang, Junjun Xiong, Guilin Liu, Zhiding Yu, Humphrey Shi

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments Technical report

GameVibe: A Multimodal Affective Game Corpus

Matthew Barthet, Maria Kaselimi, Kosmas Pinitas, Konstantinos Makantasis, Antonios Liapis, Georgios N. Yannakakis

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.AI

Comments 12 pages, 5 figures, 1 table

OmniMMI: A Comprehensive Multi-modal Interaction Benchmark in Streaming Video Contexts

Yuxuan Wang, Yueqian Wang, Bo Chen, Tong Wu, Dongyan Zhao, Zilong Zheng

专题命中 视频多模态 ：multi-modal(title,abstract)；分类 cs.CV

Comments To appear at CVPR 2025

Generating Multimodal Driving Scenes via Next-Scene Prediction

Yanhao Wu, Haoyang Zhang, Tianwei Lin, Lichao Huang, Shujie Luo, Rui Wu, Congpei Qiu, Wei Ke, Tong Zhang

专题命中 视频多模态 ：multimodal(title,abstract)；分类 cs.CV

Comments CVPR 2025