视频大模型

EMO2: End-Effector Guided Audio-Driven Avatar Video Generation

Linrui Tian, Siqi Hu, Qi Wang, Bang Zhang, Liefeng Bo

专题命中 视频生成 ：video generation(title)；分类 cs.CV

SyncFlow: Toward Temporally Aligned Joint Audio-Video Generation from Text

Haohe Liu, Gael Le Lan, Xinhao Mei, Zhaoheng Ni, Anurag Kumar, Varun Nagaraja, Wenwu Wang, Mark D. Plumbley, Yangyang Shi, Vikas Chandra

专题命中 视频生成 ：video generation(title)；分类 cs.MM

Seeing Beyond Views: Multi-View Driving Scene Video Generation with Holistic Attention

Hannan Lu, Xiaohe Wu, Shudong Wang, Xiameng Qin, Xinyu Zhang, Junyu Han, Wangmeng Zuo, Ji Tao

专题命中 视频生成 ：video generation(title)；分类 cs.CV

PoM: Efficient Image and Video Generation with the Polynomial Mixer

David Picard, Nicolas Dufour

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Pose-Guided Fine-Grained Sign Language Video Generation

Tongkai Shi, Lianyu Hu, Fanhua Shang, Jichao Feng, Peidong Liu, Wei Feng

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments ECCV 2024

Panacea+: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Binyuan Huang, Fan Jia, Yanhui Wang, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Project page: https://panacea-ad.github.io/. arXiv admin note: text overlap with arXiv:2311.16813

RAVEN: Rethinking Adversarial Video Generation with Efficient Tri-plane Networks

Partha Ghosh, Soubhik Sanyal, Cordelia Schmid, Bernhard Schölkopf

专题命中 视频生成 ：video generation(title)；分类 cs.CV

EchoNet-Synthetic: Privacy-preserving Video Generation for Safe Medical Data Sharing

Hadrien Reynaud, Qingjie Meng, Mischa Dombrowski, Arijit Ghosh, Thomas Day, Alberto Gomez, Paul Leeson, Bernhard Kainz

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted at MICCAI 2024

I2VEdit: First-Frame-Guided Video Editing via Image-to-Video Diffusion Models

Wenqi Ouyang, Yi Dong, Lei Yang, Jianlou Si, Xingang Pan

专题命中 视频生成 ：video diffusion(title)；分类 cs.CV

Comments 19 pages

AnimateZoo: Zero-shot Video Generation of Cross-Species Animation via Subject Alignment

Yuanfeng Xu, Yuhao Chen, Zhongzhan Huang, Zijian He, Guangrun Wang, Philip Torr, Liang Lin

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Technical report,15 pages

Virbo: Multimodal Multilingual Avatar Video Generation in Digital Marketing

Juan Zhang, Jiahao Chen, Cheng Wang, Zhiwang Yu, Tangquan Qi, Can Liu, Di Wu

专题命中 视频生成 ：video generation(title)；分类 cs.MM

StyleLipSync: Style-based Personalized Lip-sync Video Generation

Taekyung Ki, Dongchan Min

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments International Conference on Computer Vision (ICCV) 2023. Project page: https://stylelipsync.github.io

Decouple Content and Motion for Conditional Image-to-Video Generation

Cuifeng Shen, Yulu Gan, Chen Chen, Xiongwei Zhu, Lele Cheng, Tingting Gao, Jinzhi Wang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

DaGAN++: Depth-Aware Generative Adversarial Network for Talking Head Video Generation

Fa-Ting Hong, Li Shen, Dan Xu

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted at TPAMI; CVPR 2022 extension

Panacea: Panoramic and Controllable Video Generation for Autonomous Driving

Yuqing Wen, Yucheng Zhao, Yingfei Liu, Fan Jia, Yanhui Wang, Chong Luo, Chi Zhang, Tiancai Wang, Xiaoyan Sun, Xiangyu Zhang

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Project page: https://panacea-ad.github.io/

High-Fidelity and Freely Controllable Talking Head Video Generation

Yue Gao, Yuan Zhou, Jinglu Wang, Xiao Li, Xiang Ming, Yan Lu

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments CVPR 2023

3D-Aware Video Generation

Sherwin Bahmani, Jeong Joon Park, Despoina Paschalidou, Hao Tang, Gordon Wetzstein, Leonidas Guibas, Luc Van Gool, Radu Timofte

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments TMLR 2023; Project page: https://sherwinbahmani.github.io/3dvidgen

Facial Expression Video Generation Based-On Spatio-temporal Convolutional GAN: FEV-GAN

Hamza Bouzid, Lahoucine Ballihi

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments 13 pages, 8 figures, accepted in ISWA journal

Journal ref Intelligent Systems with Applications. 19 (2022)

Multi-object Video Generation from Single Frame Layouts

Yang Wu, Zhibin Liu, Hefeng Wu, Liang Lin

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments 6 pages limit

Conditional Image-to-Video Generation with Latent Flow Diffusion Models

Haomiao Ni, Changhao Shi, Kai Li, Sharon X. Huang, Martin Renqiang Min

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments CVPR 2023

D'ARTAGNAN: Counterfactual Video Generation

Hadrien Reynaud, Athanasios Vlontzos, Mischa Dombrowski, Ciarán Lee, Arian Beqiri, Paul Leeson, Bernhard Kainz

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted for MICCAI 2022

RoME: Role-aware Mixture-of-Expert Transformer for Text-to-Video Retrieval

Burak Satar, Hongyuan Zhu, Hanwang Zhang, Joo Hwee Lim

专题命中 视频生成 ：text-to-video(title)；分类 cs.CV

Comments Preprint, under review in TCSVT Journal

Controllable Video Generation through Global and Local Motion Dynamics

Aram Davtyan, Paolo Favaro

专题命中 视频生成 ：video generation(title)；分类 cs.CV

VirtualConductor: Music-driven Conducting Video Generation System

Delong Chen, Fan Liu, Zewen Li, Feng Xu

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Accepted by IEEE International Conference on Multimedia and Expo (ICME) 2021, demo track. Best demo

NWT: Towards natural audio-to-video generation with representation learning

Rayhane Mama, Marc S. Tyndel, Hashiam Kadhim, Cole Clifford, Ragavan Thurairatnam

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Efficient training for future video generation based on hierarchical disentangled representation of latent variables

Naoya Fushishita, Antonio Tejero-de-Pablos, Yusuke Mukuta, Tatsuya Harada

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Long-Term Human Video Generation of Multiple Futures Using Poses

Naoya Fushishita, Antonio Tejero-de-Pablos, Yusuke Mukuta, Tatsuya Harada

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Unsupervised object-centric video generation and decomposition in 3D

Paul Henderson, Christoph H. Lampert

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Appeared at NeurIPS 2020. Project page: http://pmh47.net/o3v/

Can Everybody Sign Now? Exploring Sign Language Video Generation from 2D Poses

Lucas Ventura, Amanda Duarte, Xavier Giro-i-Nieto

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments Video here: https://youtu.be/4ve1sGzWl2g

VideoFlow: A Conditional Flow-Based Model for Stochastic Video Generation

Manoj Kumar, Mohammad Babaeizadeh, Dumitru Erhan, Chelsea Finn, Sergey Levine, Laurent Dinh, Durk Kingma

专题命中 视频生成 ：video generation(title)；分类 cs.CV

Comments ICLR 2020 Camera-Ready. Previous title: VideoFlow: A Flow-Based Generative Model for Video