视频大模型

Write What You Want: Applying Text-to-video Retrieval to Audiovisual Archives

Yuchen Yang

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.MM

GLOBER: Coherent Non-autoregressive Video Generation via GLOBal Guided Video DecodER

Mingzhen Sun, Weining Wang, Zihan Qin, Jiahui Sun, Sihan Chen, Jing Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

The Power of Sound (TPoS): Audio Reactive Video Generation with Stable Diffusion

Yujin Jeong, Wonjeong Ryoo, Seunghyun Lee, Dabin Seo, Wonmin Byeon, Sangpil Kim, Jinkyu Kim

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments ICCV2023

StyleInV: A Temporal Style Modulated Inversion Network for Unconditional Video Generation

Yuhan Wang, Liming Jiang, Chen Change Loy

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments ICCV 2023. Code: https://github.com/johannwyh/StyleInV Project page: https://www.mmlab-ntu.com/project/styleinv/index.html

Implicit Identity Representation Conditioned Memory Compensation Network for Talking Head video Generation

Fa-Ting Hong, Dan Xu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by ICCV2023, update the reference and figures

DragNUWA: Fine-grained Control in Video Generation by Integrating Text, Image, and Trajectory

Shengming Yin, Chenfei Wu, Jian Liang, Jie Shi, Houqiang Li, Gong Ming, Nan Duan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Text-to-Video: a Two-stage Framework for Zero-shot Identity-agnostic Talking-head Generation

Zhichao Wang, Mengyu Dai, Keld Lundgaard

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

Comments 6 pages

TeachCLIP: Multi-Grained Teaching for Efficient Text-to-Video Retrieval

Kaibin Tian, Ruixiang Zhao, Hu Hu, Runquan Xie, Fengzong Lian, Zhanhui Kang, Xirong Li

专题命中 视频生成 ：text-to-video(title,abstract)；分类 cs.CV

PV3D: A 3D Generative Model for Portrait Video Generation

Zhongcong Xu, Jianfeng Zhang, Jun Hao Liew, Wenqing Zhang, Song Bai, Jiashi Feng, Mike Zheng Shou

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted to ICLR2023, Project Page https://showlab.github.io/pv3d

GD-VDM: Generated Depth for better Diffusion-based Video Generation

Ariel Lapid, Idan Achituve, Lior Bracha, Ethan Fetaya

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Temporally Consistent Transformers for Video Generation

Wilson Yan, Danijar Hafner, Stephen James, Pieter Abbeel

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project website: https://wilson1yan.github.io/teco

Text2Performer: Text-Driven Human Video Generation

Yuming Jiang, Shuai Yang, Tong Liang Koh, Wayne Wu, Chen Change Loy, Ziwei Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project Page: https://yumingj.github.io/projects/Text2Performer.html, Github: https://github.com/yumingj/Text2Performer

MoStGAN-V: Video Generation with Temporal Motion Styles

Xiaoqian Shen, Xiang Li, Mohamed Elhoseiny

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Controllable Video Generation by Learning the Underlying Dynamical System with Neural ODE

Yucheng Xu, Li Nanbo, Arushi Goel, Zijian Guo, Zonghai Yao, Hamidreza Kasaei, Mohammadreze Kasaei, Zhibin Li

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Tell Me What Happened: Unifying Text-guided Video Completion via Multimodal Masked Video Generation

Tsu-Jui Fu, Licheng Yu, Ning Zhang, Cheng-Yang Fu, Jong-Chyi Su, William Yang Wang, Sean Bell

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments CVPR'23

Copy Motion From One to Another: Fake Motion Video Generation

Zhenguang Liu, Sifan Wu, Chejian Xu, Xiang Wang, Lei Zhu, Shuang Wu, Fuli Feng

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 9 pages, 4 figures

Sound-Guided Semantic Video Generation

Seung Hyun Lee, Gyeongrok Oh, Wonmin Byeon, Chanyoung Kim, Won Jeong Ryoo, Sang Ho Yoon, Hyunjun Cho, Jihyun Bae, Jinkyu Kim, Sangpil Kim

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Layered Controllable Video Generation

Jiahui Huang, Yuhe Jin, Kwang Moo Yi, Leonid Sigal

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments This paper has been accepted to ECCV 2022 as an Oral paper

StyleFaceV: Face Video Generation via Decomposing and Recomposing Pretrained StyleGAN3

Haonan Qiu, Yuming Jiang, Hang Zhou, Wayne Wu, Ziwei Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project Page: http://haonanqiu.com/projects/StyleFaceV.html; Code Repo: https://github.com/arthur-qiu/StyleFaceV

Jointly Harnessing Prior Structures and Temporal Consistency for Sign Language Video Generation

Yucheng Suo, Zhedong Zheng, Xiaohan Wang, Bang Zhang, Yi Yang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Patch-based Object-centric Transformers for Efficient Video Generation

Wilson Yan, Ryo Okumura, Stephen James, Pieter Abbeel

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project Website: https://sites.google.com/view/povt-public

RockGPT: Reconstructing three-dimensional digital rocks from single two-dimensional slice from the perspective of video generation

Qiang Zheng, Dongxiao Zhang

专题命中 视频生成 ：video generation(title,abstract)；分类 eess.IV

Comments 32 pages, 8 figures

Journal ref Computational Geosciences, 26 (3), 677-696, 2022

Cascaded Video Generation for Videos In-the-Wild

Lluis Castrejon, Nicolas Ballas, Aaron Courville

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted to the 26th International Conference on Pattern Recognition (ICPR 2022). arXiv admin note: substantial text overlap with arXiv:2106.02719

Diverse Video Generation from a Single Video

Niv Haim, Ben Feinstein, Niv Granot, Assaf Shocher, Shai Bagon, Tali Dekel, Michal Irani

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments AI for Content Creation Workshop @ CVPR 2022

Make It Move: Controllable Image-to-Video Generation with Text Descriptions

Yaosi Hu, Chong Luo, Zhenzhong Chen

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Accepted by CVPR'2022

V3GAN: Decomposing Background, Foreground and Motion for Video Generation

Arti Keshari, Sonam Gupta, Sukhendu Das

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, Longhao Zhang, Li Shen, Dan Xu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 15 Pages; Accepted by CVPR 2022

Autoencoding Video Latents for Adversarial Video Generation

Sai Hemanth Kasaraneni

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments preprint

Continuous-Time Video Generation via Learning Motion Dynamics with Neural ODE

Kangyeol Kim, Sunghyun Park, Junsoo Lee, Joonseok Lee, Sookyung Kim, Jaegul Choo, Edward Choi

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 24 pages; Accepted to BMVC 2021

AI-Empowered Persuasive Video Generation: A Survey

Chang Liu, Han Yu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.MM

Comments under review