多模态大模型

LIV: Language-Image Representations and Rewards for Robotic Control

Yecheng Jason Ma, William Liang, Vaidehi Som, Vikash Kumar, Amy Zhang, Osbert Bastani, Dinesh Jayaraman

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Comments Extended version of ICML 2023 camera-ready; Project website: https://penn-pal-lab.github.io/LIV/

Social Context-aware GCN for Video Character Search via Scene-prior Enhancement

Wenjun Peng, Weidong He, Derong Xu, Tong Xu, Chen Zhu, Enhong Chen

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.MM

Comments Accepted by ICME 2023

Cinematic Mindscapes: High-quality Video Reconstruction from Brain Activity

Zijiao Chen, Jiaxin Qing, Juan Helen Zhou

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 15 pages, 11 figures, submitted to anonymous conference

TSGN: Temporal Scene Graph Neural Networks with Projected Vectorized Representation for Multi-Agent Motion Prediction

Yunong Wu, Thomas Gilles, Bogdan Stanciulescu, Fabien Moutarde

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages

Mask to reconstruct: Cooperative Semantics Completion for Video-text Retrieval

Han Fang, Zhifei Yang, Xianghao Zang, Chao Ban, Hao Sun

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Segment and Track Anything

Yangming Cheng, Liulei Li, Yuanyou Xu, Xiaodi Li, Zongxin Yang, Wenguan Wang, Yi Yang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments 8 pages, 3 figures; Technical Report

Graph-ToolFormer: To Empower LLMs with Graph Reasoning Ability via Prompt Augmented by ChatGPT

Jiawei Zhang

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 34 pages, 3 figures, 8 tables

Co-attention Propagation Network for Zero-Shot Video Object Segmentation

Gensheng Pei, Yazhou Yao, Fumin Shen, Dan Huang, Xingguo Huang, Heng-Tao Shen

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments accepted by IEEE Transactions on Image Processing

HeteroEdge: Addressing Asymmetry in Heterogeneous Collaborative Autonomous Systems

Mohammad Saeid Anwar, Emon Dey, Maloy Kumar Devnath, Indrajeet Ghosh, Naima Khan, Jade Freeman, Timothy Gregory, Niranjan Suri, Kasthuri Jayaraja, Sreenivasan Ramasamy Ramamurthy, Nirmalya Roy

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Standpoint Linear Temporal Logic

Nicola Gigante, Lucia {Gomez Alvarez}, Tim S. Lyon

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

SViTT: Temporal Learning of Sparse Video-Text Transformers

Yi Li, Kyle Min, Subarna Tripathi, Nuno Vasconcelos

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2023

How you feelin'? Learning Emotions and Mental States in Movie Scenes

Dhruv Srivastava, Aditya Kumar Singh, Makarand Tapaswi

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2023. Project Page: https://katha-ai.github.io/projects/emotx/

HumanLight: Incentivizing Ridesharing via Human-centric Deep Reinforcement Learning in Traffic Signal Control

Dimitris M. Vlachogiannis, Hua Wei, Scott Moura, Jane Macfarlane

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.AI

Comments 29 pages, 17 figures

A Temporal Densely Connected Recurrent Network for Event-based Human Pose Estimation

Zhanpeng Shao, Wen Zhou, Wuzhen Wang, Jianyu Yang, Youfu Li

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

VindLU: A Recipe for Effective Video-and-Language Pretraining

Feng Cheng, Xizi Wang, Jie Lei, David Crandall, Mohit Bansal, Gedas Bertasius

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments CVPR 2023. Project page: https://klauscc.github.io/vindlu.html

Unsupervised Person Re-Identification with Wireless Positioning under Weak Scene Labeling

Yiheng Liu, Wengang Zhou, Qiaokang Xie, Houqiang Li

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted by TPAMI 2022

Fine-grained Audible Video Description

Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, Yu Qiao, Yiran Zhong

专题命中 视频多模态 ：audio-visual(abstract)；分类 cs.CV

Comments accepted to CVPR 2023, Xuyang Shen, Dong Li and Jinxing Zhou contribute equally, code link: github.com/OpenNLPLab/FAVDBench, dataset link: www.avlbench.opennlplab.cn

A Memory System of a Robot Cognitive Architecture and its Implementation in ArmarX

Fabian Peller-Konrad, Rainer Kartmann, Christian R. G. Dreher, Andre Meixner, Fabian Reister, Markus Grotz, Tamim Asfour

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.AI

Comments 35 pages, 19 figures, submitted to RAS

Journal ref Robotics and Autonomous Systems (2023)

Cap4Video: What Can Auxiliary Captions Do for Text-Video Retrieval?

Wenhao Wu, Haipeng Luo, Bo Fang, Jingdong Wang, Wanli Ouyang

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023. Selected as a Highlight (Top 2.5% of ALL submissions)

MELTR: Meta Loss Transformer for Learning to Fine-tune Video Foundation Models

Dohwan Ko, Joonmyung Choi, Hyeong Kyu Choi, Kyoung-Woon On, Byungseok Roh, Hyunwoo J. Kim

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments Accepted paper at CVPR 2023

LCE-Calib: Automatic LiDAR-Frame/Event Camera Extrinsic Calibration With A Globally Optimal Solution

Jianhao Jiao, Feiyi Chen, Hexiang Wei, Jin Wu, Ming Liu

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments 11 pages, 13 figures, accepted to IEEE/ASME Transactions on Mechatronics

Scribble-Supervised RGB-T Salient Object Detection

Zhengyi Liu, Xiaoshen Huang, Guanghui Zhang, Xianyong Fang, Linbo Wang, Bin Tang

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments ICME2023

Connecting Vision and Language with Video Localized Narratives

Paul Voigtlaender, Soravit Changpinyo, Jordi Pont-Tuset, Radu Soricut, Vittorio Ferrari

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Comments Accepted at CVPR 2023

Learning Trajectory-Word Alignments for Video-Language Tasks

Xu Yang, Zhangzikang Li, Haiyang Xu, Hanwang Zhang, Qinghao Ye, Chenliang Li, Ming Yan, Yu Zhang, Fei Huang, Songfang Huang

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

RGB-Event Fusion for Moving Object Detection in Autonomous Driving

Zhuyun Zhou, Zongwei Wu, Rémi Boutteau, Fan Yang, Cédric Demonceaux, Dominique Ginhac

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments ICRA'23

X$^3$KD: Knowledge Distillation Across Modalities, Tasks and Stages for Multi-Camera 3D Object Detection

Marvin Klingner, Shubhankar Borse, Varun Ravi Kumar, Behnaz Rezaei, Venkatraman Narayanan, Senthil Yogamani, Fatih Porikli

专题命中 视频多模态 ：cross-modal(abstract)；分类 cs.CV

Comments Accepted to CVPR 2023

LAformer: Trajectory Prediction for Autonomous Driving with Lane-Aware Scene Constraints

Mengmeng Liu, Hao Cheng, Lin Chen, Hellward Broszio, Jiangtao Li, Runjiang Zhao, Monika Sester, Michael Ying Yang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV

Diverse Human Motion Prediction Guided by Multi-Level Spatial-Temporal Anchors

Sirui Xu, Yu-Xiong Wang, Liang-Yan Gui

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

Comments ECCV 2022 (Oral); Project Page: https://sirui-xu.github.io/STARS/

Look, Listen, and Attack: Backdoor Attacks Against Video Action Recognition

Hasan Abed Al Kader Hammoud, Shuming Liu, Mohammed Alkhrashi, Fahad AlBalawi, Bernard Ghanem

专题命中 视频多模态 ：multi-modal(abstract)；分类 cs.CV

A Survey on Human Action Recognition

Zhou Shuchang

专题命中 视频多模态 ：multimodal(abstract)；分类 cs.CV