视频大模型

Open-Vocabulary Video Relation Extraction

Wentao Tian, Zheng Wang, Yuqian Fu, Jingjing Chen, Lechao Cheng

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments accpeted by AAAI 2024

Consistent Video-to-Video Transfer Using Synthetic Dataset

Jiaxin Cheng, Tianjun Xiao, Tong He

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

VBench: Comprehensive Benchmark Suite for Video Generative Models

Ziqi Huang, Yinan He, Jiashuo Yu, Fan Zhang, Chenyang Si, Yuming Jiang, Yuanhan Zhang, Tianxing Wu, Qingyang Jin, Nattapol Chanpaisit, Yaohui Wang, Xinyuan Chen, Limin Wang, Dahua Lin, Yu Qiao, Ziwei Liu

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments Equal contributions from first four authors. Project page: https://vchitect.github.io/VBench-project/ Code: https://github.com/Vchitect/VBench

Learning Fine-grained View-Invariant Representations from Unpaired Ego-Exo Videos via Temporal Alignment

Zihui Xue, Kristen Grauman

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by NeurIPS 2023, Project website: https://vision.cs.utexas.edu/projects/AlignEgoExo/

Let's Think Frame by Frame with VIP: A Video Infilling and Prediction Dataset for Evaluating Video Chain-of-Thought

Vaishnavi Himakunthala, Andy Ouyang, Daniel Rose, Ryan He, Alex Mei, Yujie Lu, Chinmay Sonar, Michael Saxon, William Yang Wang

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

Comments Accepted to the 2023 Conference on Empirical Methods in Natural Language Processing (EMNLP 2023)

ProBio: A Protocol-guided Multimodal Dataset for Molecular Biology Lab

Jieming Cui, Ziren Gong, Baoxiong Jia, Siyuan Huang, Zilong Zheng, Jianzhu Ma, Yixin Zhu

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Perception Test: A Diagnostic Benchmark for Multimodal Video Models

Viorica Pătrăucean, Lucas Smaira, Ankush Gupta, Adrià Recasens Continente, Larisa Markeeva, Dylan Banarse, Skanda Koppula, Joseph Heyward, Mateusz Malinowski, Yi Yang, Carl Doersch, Tatiana Matejovicova, Yury Sulsky, Antoine Miech, Alex Frechette, Hanna Klimczak, Raphael Koster, Junlin Zhang, Stephanie Winkler, Yusuf Aytar, Simon Osindero, Dima Damen, Andrew Zisserman, João Carreira

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments 37th Conference on Neural Information Processing Systems (NeurIPS 2023) Track on Datasets and Benchmarks

Building an Open-Vocabulary Video CLIP Model with Better Architectures, Optimization and Data

Zuxuan Wu, Zejia Weng, Wujian Peng, Xitong Yang, Ang Li, Larry S. Davis, Yu-Gang Jiang

专题命中 视频数据与评测 ：text-to-video(abstract)；分类 cs.CV

Comments arXiv admin note: substantial text overlap with arXiv:2302.00624

ReLER@ZJU Submission to the Ego4D Moment Queries Challenge 2022

Jiayi Shao, Xiaohan Wang, Yi Yang

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Comments Accepted to ECCV 2022 Ego4D Workshop; 3rd place in Ego4D Moment Query Challenge

PointOdyssey: A Large-Scale Synthetic Dataset for Long-Term Point Tracking

Yang Zheng, Adam W. Harley, Bokui Shen, Gordon Wetzstein, Leonidas J. Guibas

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

HA-ViD: A Human Assembly Video Dataset for Comprehensive Assembly Knowledge Understanding

Hao Zheng, Regina Lee, Yuqian Lu

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Efficient Annotation and Learning for 3D Hand Pose Estimation: A Survey

Takehiko Ohkawa, Ryosuke Furuta, Yoichi Sato

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Egocentric Video Task Translation

Zihui Xue, Yale Song, Kristen Grauman, Lorenzo Torresani

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by CVPR 2023 (Highlight), Project website: https://vision.cs.utexas.edu/projects/egot2/

Fine-grained Audible Video Description

Xuyang Shen, Dong Li, Jinxing Zhou, Zhen Qin, Bowen He, Xiaodong Han, Aixuan Li, Yuchao Dai, Lingpeng Kong, Meng Wang, Yu Qiao, Yiran Zhong

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments accepted to CVPR 2023, Xuyang Shen, Dong Li and Jinxing Zhou contribute equally, code link: github.com/OpenNLPLab/FAVDBench, dataset link: www.avlbench.opennlplab.cn

Blind Video Deflickering by Neural Filtering with a Flawed Atlas

Chenyang Lei, Xuanchi Ren, Zhaoxiang Zhang, Qifeng Chen

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments To appear in CVPR2023. Code: github.com/ChenyangLEI/All-In-One-Deflicker Website: chenyanglei.github.io/deflicker

Grafting Pre-trained Models for Multimodal Headline Generation

Lingfeng Qiao, Chen Wu, Ye Liu, Haoyuan Peng, Di Yin, Bo Ren

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Comments Accepted by EMNLP 2022

Unsupervised Audio-Visual Lecture Segmentation

Darshan Singh S, Anchit Gupta, C. V. Jawahar, Makarand Tapaswi

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Comments 17 pages, 14 figures, 14 tables, Accepted to WACV 2023. Project page: https://cvit.iiit.ac.in/research/projects/cvit-projects/avlectures

FineAction: A Fine-Grained Video Dataset for Temporal Action Localization

Yi Liu, Limin Wang, Yali Wang, Xiao Ma, Yu Qiao

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted by IEEE T-IP. HomePage: https://deeperaction.github.io/datasets/fineaction

Semantic Video Moments Retrieval at Scale: A New Task and a Baseline

Na Li

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Multi-modal Video Chapter Generation

Xiao Cao, Zitan Chen, Canyu Le, Lei Meng

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Benchmarking the Robustness of Spatial-Temporal Models Against Corruptions

Chenyu Yi, Siyuan Yang, Haoliang Li, Yap-peng Tan, Alex Kot

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to NeurIPs 2021 Dataset and Benchmark Track. Our codes are available on https://github.com/Newbeeyoung/Video-Corruption-Robustness

How Severe is Benchmark-Sensitivity in Video Self-Supervised Learning?

Fida Mohammad Thoker, Hazel Doughty, Piyush Bagad, Cees Snoek

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted in ECCV 2022

CelebV-HQ: A Large-Scale Video Facial Attributes Dataset

Hao Zhu, Wayne Wu, Wentao Zhu, Liming Jiang, Siwei Tang, Li Zhang, Ziwei Liu, Chen Change Loy

专题命中 视频数据与评测 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2022. Project Page: https://celebv-hq.github.io/ ; Dataset: https://github.com/CelebV-HQ/CelebV-HQ

Occluded Video Instance Segmentation: A Benchmark

Jiyang Qi, Yan Gao, Yao Hu, Xinggang Wang, Xiaoyu Liu, Xiang Bai, Serge Belongie, Alan Yuille, Philip H. S. Torr, Song Bai

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments IJCV 2022. Project page at https://songbai.site/ovis

ComPhy: Compositional Physical Reasoning of Objects and Events from Videos

Zhenfang Chen, Kexin Yi, Yunzhu Li, Mingyu Ding, Antonio Torralba, Joshua B. Tenenbaum, Chuang Gan

专题命中 视频数据与评测 ：video reasoning(abstract)；分类 cs.CV

Comments ICLR 2022. Project page: https://comphyreasoning.github.io/

A Multi-Person Video Dataset Annotation Method of Spatio-Temporally Actions

Fan Yang

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Temporal Alignment Networks for Long-term Video

Tengda Han, Weidi Xie, Andrew Zisserman

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments CVPR2022 Oral, 16 pages

End-to-End Referring Video Object Segmentation with Multimodal Transformers

Adam Botach, Evgenii Zheltonozhskii, Chaim Baskin

专题命中 视频数据与评测 ：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2022

MAD: A Scalable Dataset for Language Grounding in Videos from Movie Audio Descriptions

Mattia Soldan, Alejandro Pardo, Juan León Alcázar, Fabian Caba Heilbron, Chen Zhao, Silvio Giancola, Bernard Ghanem

专题命中 视频数据与评测 ：video-language(abstract)；分类 cs.CV

Comments 12 Pages, 6 Figures, 7 Tables

Journal ref Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition CVPR 2022

STEP: Segmenting and Tracking Every Pixel

Mark Weber, Jun Xie, Maxwell Collins, Yukun Zhu, Paul Voigtlaender, Hartwig Adam, Bradley Green, Andreas Geiger, Bastian Leibe, Daniel Cremers, Aljoša Ošep, Laura Leal-Taixé, Liang-Chieh Chen

专题命中 视频数据与评测 ：long video(abstract)；分类 cs.CV

Comments Accepted to NeurIPS 2021 Track on Datasets and Benchmarks. Code: https://github.com/google-research/deeplab2