多模态大模型

Hierarchical Contact-Rich Trajectory Optimization for Multi-Modal Manipulation using Tight Convex Relaxations

Yuki Shirai, Arvind Raghunathan, Devesh K. Jha

机构 * Mitsubishi Electric Research Laboratories（三菱电机研究实验室） 纠错

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments 2025 IEEE International Conference on Robotics and Automation (2025 ICRA)

SuperEvent: Cross-Modal Learning of Event-based Keypoint Detection for SLAM

Yannick Burkhardt, Simon Schaefer, Stefan Leutenegger

机构 * Technical University of Munich（慕尼黑技术大学） ； ETH Zürich（苏黎世联邦理工学院） ； Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心） 纠错

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Generative Video Semantic Communication via Multimodal Semantic Fusion with Large Model

Hang Yin, Li Qiao, Yu Ma, Shuo Sun, Kan Li, Zhen Gao, Dusit Niyato

机构 * School of Information and Electronics, Beijing Institute of Technology（信息与电子学院，北京理工大学） ； School of Computer Science and Engineering, Nanyang Technological University（计算机科学与工程学院，南洋理工大学） 纠错

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments IEEE Transactions on Vehicular Technology

Multimodal LLM-based Query Paraphrasing for Video Search

Jiaxin Wu, Chong-Wah Ngo, Wing-Kwong Chan, Sheng-Hua Zhong, Xiong-Yong Wei, Qing Li

专题命中 视频多模态 ：multimodal(title)；分类 cs.MM

CLIP-AE: CLIP-assisted Cross-view Audio-Visual Enhancement for Unsupervised Temporal Action Localization

Rui Xia, Dan Jiang, Quan Zhang, Ke Zhang, Chun Yuan

专题命中 视频多模态 ：audio-visual(title)；分类 cs.CV

MoviePuzzle: Visual Narrative Reasoning through Multimodal Order Learning

Jianghui Wang, Yuxuan Wang, Dongyan Zhao, Zilong Zheng

机构 * Beijing Institute for General Artificial Intelligence（北京通用人工智能研究院） ； Wangxuan Institute of Computer Technology（王轩计算机技术研究所） 纠错

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Caption Anything in Video: Fine-grained Object-centric Captioning via Spatiotemporal Multimodal Prompting

Yunlong Tang, Jing Bi, Chao Huang, Susan Liang, Daiki Shimada, Hang Hua, Yunzhong Xiao, Yizhi Song, Pinxin Liu, Mingqian Feng, Junjia Guo, Zhuo Liu, Luchuan Song, Ali Vosoughi, Jinxi He, Liu He, Zeliang Zhang, Jiebo Luo, Chenliang Xu

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

VC-LLM: Automated Advertisement Video Creation from Raw Footage using Multi-modal LLMs

Dongjun Qian, Kai Su, Yiming Tan, Qishuai Diao, Xian Wu, Chang Liu, Bingyue Peng, Zehuan Yuan

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

A Multimodal Framework for Topic Propagation Classification in Social Networks

Yuchuan Jiang, Chaolong Jia, Yunyi Qin, Wei Cai, Yongsen Qian

专题命中 视频多模态 ：multimodal(title)；分类 cs.AI

Large Motion Video Autoencoding with Cross-modal Video VAE

Yazhou Xing, Yang Fei, Yingqing He, Jingye Chen, Jiaxin Xie, Xiaowei Chi, Qifeng Chen

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments Project Website: https://yzxing87.github.io/vae/

LAMBDA: Covering the Multimodal Critical Scenarios for Automated Driving Systems by Search Space Quantization

Xinzheng Wu, Junyi Chen, Xingyu Xing, Jian Sun, Ye Tian, Lihao Liu, Yong Shen

专题命中 视频多模态 ：multimodal(title)；分类 cs.AI

Comments 17pages, 21figures

Automating Video Thumbnails Selection and Generation with Multimodal and Multistage Analysis

Elia Fantini

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 150 pages, 60 figures

ViMGuard: A Novel Multi-Modal System for Video Misinformation Guarding

Andrew Kan, Christopher Kan, Zaid Nabulsi

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CL

Comments 7 pages, 2 figures

MMUTF: Multimodal Multimedia Event Argument Extraction with Unified Template Filling

Philipp Seeberger, Dominik Wagner, Korbinian Riedhammer

专题命中 视频多模态 ：multimodal(title)；分类 cs.CL

Comments Accepted to Findings of EMNLP 2024

Multimodal Power Outage Prediction for Rapid Disaster Response and Resource Allocation

Alejandro Aparcedo, Christian Lopez, Abhinav Kotta, Mengjie Li

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 7 pages, 4 figures, 1 table

Detecting Calls to Action in Multimodal Content: Analysis of the 2021 German Federal Election Campaign on Instagram

Michael Achmann-Denkler, Jakob Fehle, Mario Haim, Christian Wolff

专题命中 视频多模态 ：multimodal(title)；分类 cs.CL

Comments Accepted Archival Paper for the CPSS Workshop at KONVENS 2024. Camera Ready Submission

CMTA: Cross-Modal Temporal Alignment for Event-guided Video Deblurring

Taewoo Kim, Hoonhee Cho, Kuk-Jin Yoon

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments Accepted in ECCV2024

InternVideo2: Scaling Foundation Models for Multimodal Video Understanding

Yi Wang, Kunchang Li, Xinhao Li, Jiashuo Yu, Yinan He, Chenting Wang, Guo Chen, Baoqi Pei, Ziang Yan, Rongkun Zheng, Jilan Xu, Zun Wang, Yansong Shi, Tianxiang Jiang, Songze Li, Hongjie Zhang, Yifei Huang, Yu Qiao, Yali Wang, Limin Wang

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments a technical report about video understanding (accepted to ECCV2024)

PUDD: Towards Robust Multi-modal Prototype-based Deepfake Detection

Alvaro Lopez Pellcier, Yi Li, Plamen Angelov

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments CVPR2024

Journal ref CVPR2024

StreamingFlow: Streaming Occupancy Forecasting with Asynchronous Multi-modal Data Streams via Neural Ordinary Differential Equation

Yining Shi, Kun Jiang, Ke Wang, Jiusi Li, Yunlong Wang, Mengmeng Yang, Diange Yang

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments cvpr2024 poster (highlight), code at https://github.com/synsin0/StreamingFlow

Open-Ended Multi-Modal Relational Reasoning for Video Question Answering

Haozheng Luo, Ruiyang Qin, Chenwei Xu, Guo Ye, Zening Luo

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments 2023 32nd IEEE International Conference on Robot and Human Interactive Communication (RO-MAN)

Affective Behaviour Analysis via Integrating Multi-Modal Knowledge

Wei Zhang, Feng Qiu, Chen Liu, Lincheng Li, Heming Du, Tiancheng Guo, Xin Yu

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments 11 pages, 1 figure

One-shot Imitation in a Non-Stationary Environment via Multi-Modal Skill

Sangwoo Shin, Daehee Lee, Minjong Yoo, Woo Kyung Kim, Honguk Woo

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Comments ICML-2023 Camera Ready Version

Multi-modal News Understanding with Professionally Labelled Videos (ReutersViLNews)

Shih-Han Chou, Matthew Kowal, Yasmin Niknam, Diana Moyano, Shayaan Mehdi, Richard Pito, Cheng Zhang, Ian Knopke, Sedef Akinli Kocak, Leonid Sigal, Yalda Mohsenzadeh

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Mining multi-modal communication patterns in interaction with explainable and non-explainable robots

Suna Bensch, Amanda Eriksson

专题命中 视频多模态 ：multi-modal(title)；分类 cs.AI

Journal ref IEEE RO-MAN 2023, 32nd IEEE International conference on Robot and Human Interactive Communication; Workshop Human-Robot Interaction for Explainability in Robotics, Busan, Korea, August 28-31, 2023

Multimodal Generation of Novel Action Appearances for Synthetic-to-Real Recognition of Activities of Daily Living

Zdravko Marinov, David Schneider, Alina Roitberg, Rainer Stiefelhagen

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 8 pages, 7 figures, to be published in IROS 2022

Object-centric Cross-modal Feature Distillation for Event-based Object Detection

Lei Li, Alexander Liniger, Mario Millhaeusler, Vagia Tsiminaki, Yuanyou Li, Dengxin Dai

专题命中 视频多模态 ：cross-modal(title)；分类 cs.CV

Comments 12 pages, 8 figures

Multimodal Visual Concept Learning with Weakly Supervised Techniques

Giorgos Bouritsas, Petros Koutras, Athanasia Zlatintsi, Petros Maragos

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments CVPR 2018

Journal ref Proc. IEEE/CVF Conf. Comp. Vis. Patt. Rec. (CVPR) pp. 4914 - 4923 (2018)

EigenTrajectory: Low-Rank Descriptors for Multi-Modal Trajectory Forecasting

Inhwan Bae, Jean Oh, Hae-Gon Jeon

专题命中 视频多模态 ：multi-modal(title)；分类 cs.CV

Comments Accepted at ICCV 2023

MINOTAUR: Multi-task Video Grounding From Multimodal Queries

Raghav Goyal, Effrosyni Mavroudi, Xitong Yang, Sainbayar Sukhbaatar, Leonid Sigal, Matt Feiszli, Lorenzo Torresani, Du Tran

专题命中 视频多模态 ：multimodal(title)；分类 cs.CV

Comments 22 pages, 8 figures and 13 tables