视频大模型

Understanding Action Sequences based on Video Captioning for Learning-from-Observation

Iori Yanokura, Naoki Wake, Kazuhiro Sasabuchi, Katsushi Ikeuchi, Masayuki Inaba

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Can Temporal Information Help with Contrastive Self-Supervised Learning?

Yutong Bai, Haoqi Fan, Ishan Misra, Ganesh Venkatesh, Yongyi Lu, Yuyin Zhou, Qihang Yu, Vikas Chandra, Alan Yuille

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

A Hierarchical Multi-Modal Encoder for Moment Localization in Video Corpus

Bowen Zhang, Hexiang Hu, Joonseok Lee, Ming Zhao, Sheide Chammas, Vihan Jain, Eugene Ie, Fei Sha

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Cycle-Contrast for Self-Supervised Video Representation Learning

Quan Kong, Wenpeng Wei, Ziwei Deng, Tomoaki Yoshinaga, Tomokazu Murakami

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 12 pages

Beyond Instructional Videos: Probing for More Diverse Visual-Textual Grounding on YouTube

Jack Hessel, Zhenhai Zhu, Bo Pang, Radu Soricut

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 11 pages including supplementary materials

Journal ref Published in EMNLP 2020

Global Self-Attention Networks for Image Recognition

Zhuoran Shen, Irwan Bello, Raviteja Vemulapalli, Xuhui Jia, Ching-Hui Chen

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

End-to-End Learning of Visual Representations from Uncurated Instructional Videos

Antoine Miech, Jean-Baptiste Alayrac, Lucas Smaira, Ivan Laptev, Josef Sivic, Andrew Zisserman

专题命中 视频理解 ：text-to-video(abstract)；分类 cs.CV

Comments CVPR'2020 Oral

Residual Frames with Efficient Pseudo-3D CNN for Human Action Recognition

Jiawei Chen, Jenson Hsiao, Chiu Man Ho

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Detection and Localization of Robotic Tools in Robot-Assisted Surgery Videos Using Deep Neural Networks for Region Proposal and Detection

Duygu Sarikaya, Jason J. Corso, Khurshid A. Guru

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Journal ref IEEE Transactions on Medical Imaging 36 (2017) 1542-1549

A Multigrid Method for Efficiently Training Video Models

Chao-Yuan Wu, Ross Girshick, Kaiming He, Christoph Feichtenhofer, Philipp Krähenbühl

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments CVPR 2020

AssembleNet: Searching for Multi-Stream Neural Connectivity in Video Architectures

Michael S. Ryoo, AJ Piergiovanni, Mingxing Tan, Anelia Angelova

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Journal ref ICLR 2020

4D Generic Video Object Proposals

Aljosa Osep, Paul Voigtlaender, Mark Weber, Jonathon Luiten, Bastian Leibe

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments ICRA 2020

Mimic The Raw Domain: Accelerating Action Recognition in the Compressed Domain

Barak Battash, Haim Barad, Hanlin Tang, Amit Bleiweiss

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments CVPR 2020: Joint Workshop on Efficient Deep Learning in Computer Vision

Fully Automated Hand Hygiene Monitoring\\in Operating Room using 3D Convolutional Neural Network

Minjee Kim, Joonmyeong Choi, Namkug Kim

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Beyond the Camera: Neural Networks in World Coordinates

Gunnar A. Sigurdsson, Abhinav Gupta, Cordelia Schmid, Karteek Alahari

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

CLEVRER: CoLlision Events for Video REpresentation and Reasoning

Kexin Yi, Chuang Gan, Yunzhu Li, Pushmeet Kohli, Jiajun Wu, Antonio Torralba, Joshua B. Tenenbaum

专题命中 视频理解 ：video reasoning(abstract)；分类 cs.CV

Comments The first two authors contributed equally to this work. Accepted as Oral Spotlight as ICLR 2020. Project page: http://clevrer.csail.mit.edu/

CTM: Collaborative Temporal Modeling for Action Recognition

Qian Liu, Tao Wang, Jie Liu, Yang Guan, Qi Bu, Longfei Yang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Video

Jie Wu, Guanbin Li, Si Liu, Liang Lin

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments To appear in AAAI2020

AdapNet: Adaptability Decomposing Encoder-Decoder Network for Weakly Supervised Action Recognition and Localization

Xiao-Yu Zhang, Changsheng Li, Haichao Shi, Xiaobin Zhu, Peng Li, Jing Dong

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Cross-Class Relevance Learning for Temporal Concept Localization

Junwei Ma, Satya Krishna Gorti, Maksims Volkovs, Ilya Stanevich, Guangwei Yu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Dilated Temporal Relational Adversarial Network for Generic Video Summarization

Yujia Zhang, Michael Kampffmeyer, Xiaodan Liang, Dingwen Zhang, Min Tan, Eric P. Xing

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

SCSampler: Sampling Salient Clips from Video for Efficient Action Recognition

Bruno Korbar, Du Tran, Lorenzo Torresani

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

Learning Visual Actions Using Multiple Verb-Only Labels

Michael Wray, Dima Damen

专题命中 视频理解 ：text-to-video(abstract)；分类 cs.CV

Comments Accepted at BMVC 2019. More information can be found at https://mwray.github.io/MVOL/. Annotations can be found at https://github.com/mwray/Multi-Verb-Labels

Text-based Editing of Talking-head Video

Ohad Fried, Ayush Tewari, Michael Zollhöfer, Adam Finkelstein, Eli Shechtman, Dan B Goldman, Kyle Genova, Zeyu Jin, Christian Theobalt, Maneesh Agrawala

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

Comments A version with higher resolution images can be downloaded from the authors' website

From Here to There: Video Inbetweening Using Direct 3D Convolutions

Yunpeng Li, Dominik Roblek, Marco Tagliasacchi

专题命中 视频理解 ：video generation(abstract)；分类 cs.CV

Hierarchical Video Frame Sequence Representation with Deep Convolutional Graph Network

Feng Mao, Xiang Wu, Hui Xue, Rong Zhang

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments ECCV 2018

Journal ref ECCV 2018 Workshops pp 262-270

Lightweight Network Architecture for Real-Time Action Recognition

Alexander Kozlov, Vadim Andronov, Yana Gritsenko

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 8 pages, 3 figures

Dynamic Graph Modules for Modeling Object-Object Interactions in Activity Recognition

Hao Huang, Luowei Zhou, Wei Zhang, Jason J. Corso, Chenliang Xu

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments 14 pages, 5 figures

Large-scale weakly-supervised pre-training for video action recognition

Deepti Ghadiyaram, Matt Feiszli, Du Tran, Xueting Yan, Heng Wang, Dhruv Mahajan

专题命中 视频理解 ：long video(abstract)；分类 cs.CV

The Visual Centrifuge: Model-Free Layered Video Representations

Jean-Baptiste Alayrac, João Carreira, Andrew Zisserman

专题命中 视频理解 ：video understanding(abstract)；分类 cs.CV

Comments Appears in: 2019 IEEE Conference on Computer Vision and Pattern Recognition (CVPR 2019). This arXiv contains the CVPR Camera Ready version of the paper (although we have included larger figures) as well as an appendix detailing the model architecture