视频大模型 - arXivDaily 专题

2211.14758 2022-11-29 cs.CV 57%

VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

Kun Cheng, Xiaodong Cun, Yong Zhang, Menghan Xia, Fei Yin, Mingrui Zhu, Xuan Wang, Jue Wang, Nannan Wang

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments Accepted by SIGGRAPH Asia 2022 Conference Proceedings. Project page: https://vinthony.github.io/video-retalking/

2008.11898 2022-11-28 cs.CV 57%

Pose-Guided High-Resolution Appearance Transfer via Progressive Training

Ji Liu, Heshan Liu, Mang-Tik Chiu, Yu-Wing Tai, Chi-Keung Tang

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments 10 pages, 10 figures, 2 tables

2211.11351 2022-11-22 cs.CV 57%

Are All Combinations Equal? Combining Textual and Visual Features with Multiple Space Learning for Text-Based Video Retrieval

Damianos Galanopoulos, Vasileios Mezaris

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Comments Accepted for publication; to be included in Proc. ECCV Workshops 2022. The version posted here is the "submitted manuscript" version

2206.13559 2022-10-14 cs.CV 57%

ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning

Junting Pan, Ziyi Lin, Xiatian Zhu, Jing Shao, Hongsheng Li

专题命中视频生成：video understanding(abstract)；分类 cs.CV

Comments Accepted in NeurIPS 2022

2210.02872 2022-10-07 cs.CV 57%

Text-driven Video Prediction

Xue Song, Jingjing Chen, Bin Zhu, Yu-Gang Jiang

专题命中视频生成：video generation(abstract)；分类 cs.CV

2103.07278 2022-10-06 cs.CV 57%

Learning Long-Term Style-Preserving Blind Video Temporal Consistency

Hugo Thimonier, Julien Despois, Robin Kips, Matthieu Perrot

专题命中视频生成：video generation(abstract)；分类 cs.CV

Journal ref 2021 IEEE International Conference on Multimedia and Expo (ICME)

2207.09814 2022-08-15 cs.CV 57%

NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis

Chenfei Wu, Jian Liang, Xiaowei Hu, Zhe Gan, Jianfeng Wang, Lijuan Wang, Zicheng Liu, Yuejian Fang, Nan Duan

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments 24 pages, 19 figures

2205.05739 2022-07-19 cs.CV cs.AI cs.CL cs.HC cs.MA 57%

Learning to Retrieve Videos by Asking Questions

Avinash Madasu, Junier Oliva, Gedas Bertasius

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Journal ref ACM Multimedia 2022

2204.07441 2022-05-23 cs.CV cs.CL cs.IR 57%

COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval

Haoyu Lu, Nanyi Fei, Yuqi Huo, Yizhao Gao, Zhiwu Lu, Ji-Rong Wen

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Comments Accepted by CVPR2022

2203.09494 2022-05-10 cs.CV cs.LG 57%

Transframer: Arbitrary Frame Prediction with Generative Models

Charlie Nash, João Carreira, Jacob Walker, Iain Barr, Andrew Jaegle, Mateusz Malinowski, Peter Battaglia

专题命中视频生成：video generation(abstract)；分类 cs.CV

2104.01122 2022-03-22 cs.CV 57%

M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformers

Tsu-Jui Fu, Xin Eric Wang, Scott T. Grafton, Miguel P. Eckstein, William Yang Wang

专题命中视频生成：video understanding(abstract)；分类 cs.CV

Comments CVPR'22

2203.04036 2022-03-18 cs.CV 57%

StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN

Fei Yin, Yong Zhang, Xiaodong Cun, Mingdeng Cao, Yanbo Fan, Xuan Wang, Qingyan Bai, Baoyuan Wu, Jue Wang, Yujiu Yang

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments Project Page is at http://feiiyin.github.io/StyleHEAT/

2203.07086 2022-03-15 cs.CV 57%

MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization

Alexander Kunitsyn, Maksim Kalashnikov, Maksim Dzabraev, Andrei Ivaniuta

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

2109.08591 2021-12-07 cs.CV 57%

Diverse Generation from a Single Video Made Possible

Niv Haim, Ben Feinstein, Niv Granot, Assaf Shocher, Shai Bagon, Tali Dekel, Michal Irani

专题命中视频生成：video generation(abstract)；分类 cs.CV

2012.09855 2021-12-02 cs.CV cs.GR 57%

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image

Andrew Liu, Richard Tucker, Varun Jampani, Ameesh Makadia, Noah Snavely, Angjoo Kanazawa

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments ICCV 2021 (oral); Project page: https://infinite-nature.github.io/; Video: https://www.youtube.com/watch?v=oXUf6anNAtc

2111.10916 2021-11-23 cs.CV cs.LG 57%

Video Content Swapping Using GAN

Tingfung Lau, Sailun Xu, Xinze Wang

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments 9 pages, 12 figures

2110.14147 2021-10-29 cs.CV 57%

Image Comes Dancing with Collaborative Parsing-Flow Video Synthesis

Bowen Wu, Zhenyu Xie, Xiaodan Liang, Yubei Xiao, Haoye Dong, Liang Lin

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments TIP 2021

2110.08580 2021-10-19 cs.CV 57%

Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor

Anchit Gupta, Faizan Farooq Khan, Rudrabha Mukhopadhyay, Vinay P. Namboodiri, C. V. Jawahar

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments 9 pages, 7 figures, accepted in ICVGIP 2021

2104.12671 2021-10-18 cs.CV 57%

Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos

Brian Chen, Andrew Rouditchenko, Kevin Duarte, Hilde Kuehne, Samuel Thomas, Angie Boggust, Rameswar Panda, Brian Kingsbury, Rogerio Feris, David Harwath, James Glass, Michael Picheny, Shih-Fu Chang

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Comments To be presented at ICCV 2021

Journal ref Proceedings of the IEEE/CVF International Conference on Computer Vision (ICCV), 2021, pp. 8012-8021

2110.01442 2021-10-05 cs.LG cs.AI cs.CV 57%

A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensing

Ankan Dash, Junyi Ye, Guiling Wang

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments 41 pages, 10 figures, ACM Computing Surveys (under review)

2109.04600 2021-09-13 cs.CV cs.AI cs.CL 57%

EVOQUER: Enhancing Temporal Grounding with Video-Pivoted BackQuery Generation

Yanjun Gao, Lulu Liu, Jason Wang, Xin Chen, Huayan Wang, Rui Zhang

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Comments Accepted by Visually Grounded Interaction and Language (ViGIL) Workshop at NAACL 2021

2106.11097 2021-06-22 cs.CV 57%

CLIP2Video: Mastering Video-Text Retrieval via Image CLIP

Han Fang, Pengfei Xiong, Luhui Xu, Yu Chen

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

2105.04551 2021-06-18 cs.CV 57%

Stochastic Image-to-Video Synthesis using cINNs

Michael Dorkenwald, Timo Milbich, Andreas Blattmann, Robin Rombach, Konstantinos G. Derpanis, Björn Ommer

专题命中视频生成：video understanding(abstract)；分类 cs.CV

Comments Accepted to CVPR 2021

2104.15069 2021-05-03 cs.CV 57%

A Good Image Generator Is What You Need for High-Resolution Video Synthesis

Yu Tian, Jian Ren, Menglei Chai, Kyle Olszewski, Xi Peng, Dimitris N. Metaxas, Sergey Tulyakov

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments Accepted to ICLR 2021

2104.14786 2021-05-03 cs.CV cs.GR 57%

Editable Free-viewpoint Video Using a Layered Neural Representation

Jiakai Zhang, Xinhang Liu, Xinyi Ye, Fuqiang Zhao, Yanshun Zhang, Minye Wu, Yingliang Zhang, Lan Xu, Jingyi Yu

专题命中视频生成：video generation(abstract)；分类 cs.CV

2104.11931 2021-04-27 cs.CV 57%

Adaptive Appearance Rendering

Mengyao Zhai, Ruizhi Deng, Jiacheng Chen, Lei Chen, Zhiwei Deng, Greg Mori

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments Accepted to BMVC 2018. arXiv admin note: substantial text overlap with arXiv:1712.01955

2103.08849 2021-04-16 cs.CV cs.CL 57%

Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models

Po-Yao Huang, Mandela Patrick, Junjie Hu, Graham Neubig, Florian Metze, Alexander Hauptmann

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Comments accepted by NAACL 2021

1908.11588 2021-03-31 cs.MM cs.IR 57%

Generating Persuasive Visual Storylines for Promotional Videos

Chang Liu, Yi Dong, Han Yu, Zhiqi Shen, Zhanning Gao, Pan Wang, Changgong Zhang, Peiran Ren, Xuansong Xie, Lizhen Cui, Chunyan Miao

专题命中视频生成：video generation(abstract)；分类 cs.MM

Comments 10 pages, accepted by The 28th ACM International Conference on Information and Knowledge Management (CIKM)

2102.13329 2021-03-01 cs.CV 57%

Dual-MTGAN: Stochastic and Deterministic Motion Transfer for Image-to-Video Synthesis

Fu-En Yang, Jing-Cheng Chang, Yuan-Hao Lee, Yu-Chiang Frank Wang

专题命中视频生成：video generation(abstract)；分类 cs.CV

Comments Accepted to ICPR 2020

2010.02824 2021-01-15 cs.CV 57%

Support-set bottlenecks for video-text representation learning

Mandela Patrick, Po-Yao Huang, Yuki Asano, Florian Metze, Alexander Hauptmann, João Henriques, Andrea Vedaldi

专题命中视频生成：text-to-video(abstract)；分类 cs.CV

Comments Accepted as spotlight paper at the International Conference on Learning Representations (ICLR) 2021

1. 视频生成 2156 篇

VideoReTalking: Audio-based Lip Synchronization for Talking Head Video Editing In the Wild

Pose-Guided High-Resolution Appearance Transfer via Progressive Training

Are All Combinations Equal? Combining Textual and Visual Features with Multiple Space Learning for Text-Based Video Retrieval

ST-Adapter: Parameter-Efficient Image-to-Video Transfer Learning

Text-driven Video Prediction

Learning Long-Term Style-Preserving Blind Video Temporal Consistency

NUWA-Infinity: Autoregressive over Autoregressive Generation for Infinite Visual Synthesis

Learning to Retrieve Videos by Asking Questions

COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval

Transframer: Arbitrary Frame Prediction with Generative Models

M3L: Language-based Video Editing via Multi-Modal Multi-Level Transformers

StyleHEAT: One-Shot High-Resolution Editable Talking Face Generation via Pre-trained StyleGAN

MDMMT-2: Multidomain Multimodal Transformer for Video Retrieval, One More Step Towards Generalization

Diverse Generation from a Single Video Made Possible

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image

Video Content Swapping Using GAN

Image Comes Dancing with Collaborative Parsing-Flow Video Synthesis

Intelligent Video Editing: Incorporating Modern Talking Face Generation Algorithms in a Video Editor

Multimodal Clustering Networks for Self-supervised Learning from Unlabeled Videos

A review of Generative Adversarial Networks (GANs) and its applications in a wide variety of disciplines -- From Medical to Remote Sensing

EVOQUER: Enhancing Temporal Grounding with Video-Pivoted BackQuery Generation

CLIP2Video: Mastering Video-Text Retrieval via Image CLIP

Stochastic Image-to-Video Synthesis using cINNs

A Good Image Generator Is What You Need for High-Resolution Video Synthesis

Editable Free-viewpoint Video Using a Layered Neural Representation

Adaptive Appearance Rendering

Multilingual Multimodal Pre-training for Zero-Shot Cross-Lingual Transfer of Vision-Language Models

Generating Persuasive Visual Storylines for Promotional Videos

Dual-MTGAN: Stochastic and Deterministic Motion Transfer for Image-to-Video Synthesis

Support-set bottlenecks for video-text representation learning