视频大模型

SINGER: Vivid Audio-driven Singing Video Generation with Multi-scale Spectral Diffusion Model

Yan Li, Ziya Zhou, Zhiqiang Wang, Wei Xue, Wenhan Luo, Yike Guo

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Open-Sora Plan: Open-Source Large Video Generation Model

Bin Lin, Yunyang Ge, Xinhua Cheng, Zongjian Li, Bin Zhu, Shaodong Wang, Xianyi He, Yang Ye, Shenghai Yuan, Liuhan Chen, Tanghui Jia, Junwu Zhang, Zhenyu Tang, Yatian Pang, Bin She, Cen Yan, Zhiheng Hu, Xiaoyi Dong, Lin Chen, Zhang Pan, Xing Zhou, Shaoling Dong, Yonghong Tian, Li Yuan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments v1.3

Fleximo: Towards Flexible Text-to-Human Motion Video Generation

Yuhang Zhang, Yuan Zhou, Zeyu Liu, Yuxuan Cai, Qiuyue Wang, Aidong Men, Huan Yang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

SPAgent: Adaptive Task Decomposition and Model Selection for General Video Generation and Editing

Rong-Cheng Tu, Wenhao Sun, Zhao Jin, Jingyi Liao, Jiaxing Huang, Dacheng Tao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Scene Co-pilot: Procedural Text to Video Generation with Human in the Loop

Zhaofang Qian, Abolfazl Sharifi, Tucker Carroll, Ser-Nam Lim

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Videos are available at our project page: https://abolfazl-sh.github.io/Scene_co-pilot_site/

Medical Video Generation for Disease Progression Simulation

Xu Cao, Kaizhao Liang, Kuei-Da Liao, Tianren Gao, Wenqian Ye, Jintai Chen, Zhiguang Ding, Jianguo Cao, James M. Rehg, Jimeng Sun

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Tech Report. The appendix will release soon. arXiv admin note: text overlap with arXiv:2309.11745

AnimateAnything: Consistent and Controllable Animation for Video Generation

Guojun Lei, Chi Wang, Hong Li, Rong Zhang, Yikai Wang, Weiwei Xu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Artificial Intelligence for Biomedical Video Generation

Linyuan Li, Jianing Qiu, Anujit Saha, Lin Li, Poyuan Li, Mengxian He, Ziyu Guo, Wu Yuan

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

StoryAgent: Customized Storytelling Video Generation via Multi-Agent Collaboration

Panwen Hu, Jin Jiang, Jianqi Chen, Mingfei Han, Shengcai Liao, Xiaojun Chang, Xiaodan Liang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Exploring the Interplay Between Video Generation and World Models in Autonomous Driving: A Survey

Ao Fu, Yi Zhou, Tao Zhou, Yi Yang, Bojun Gao, Qun Li, Guobin Wu, Ling Shao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

MotionCraft: Physics-based Zero-Shot Video Generation

Luca Savant Aira, Antonio Montanaro, Emanuele Aiello, Diego Valsesia, Enrico Magli

专题命中 视频生成 ：video generation(title)；video diffusion(abstract)；分类 cs.CV

Journal ref NeurIPS 2024

WorldSimBench: Towards Video Generation Models as World Simulators

Yiran Qin, Zhelun Shi, Jiwen Yu, Xijun Wang, Enshen Zhou, Lijun Li, Zhenfei Yin, Xihui Liu, Lu Sheng, Jing Shao, Lei Bai, Wanli Ouyang, Ruimao Zhang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Allegro: Open the Black Box of Commercial-Level Video Generation Model

Yuan Zhou, Qiuyue Wang, Yuxuan Cai, Huan Yang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Fundus to Fluorescein Angiography Video Generation as a Retinal Generative Foundation Model

Weiyi Zhang, Jiancheng Yang, Ruoyu Chen, Siyu Huang, Pusheng Xu, Xiaolan Chen, Shanfu Lu, Hongyu Cao, Mingguang He, Danli Shi

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

DragEntity: Trajectory Guided Video Generation using Entity and Positional Relationships

Zhang Wan, Sheng Tang, Jiawei Wei, Ruize Zhang, Juan Cao

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments ACM MM2024 Oral

VideoScore: Building Automatic Metrics to Simulate Fine-grained Human Feedback for Video Generation

Xuan He, Dongfu Jiang, Ge Zhang, Max Ku, Achint Soni, Sherman Siu, Haonan Chen, Abhranil Chandra, Ziyan Jiang, Aaran Arulraj, Kai Wang, Quy Duc Do, Yuansheng Ni, Bohan Lyu, Yaswanth Narsupalli, Rongqi Fan, Zhiheng Lyu, Yuchen Lin, Wenhu Chen

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

HARIVO: Harnessing Text-to-Image Models for Video Generation

Mingi Kwon, Seoung Wug Oh, Yang Zhou, Difan Liu, Joon-Young Lee, Haoran Cai, Baqiao Liu, Feng Liu, Youngjung Uh

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments ECCV2024

Towards World Simulator: Crafting Physical Commonsense-Based Benchmark for Video Generation

Fanqing Meng, Jiaqi Liao, Xinyu Tan, Wenqi Shao, Quanfeng Lu, Kaipeng Zhang, Yu Cheng, Dianqi Li, Yu Qiao, Ping Luo

专题命中 视频生成 ：video generation(title)；text-to-video(abstract)；分类 cs.CV

Comments Project Page: https://phygenbench123.github.io/

Noise Crystallization and Liquid Noise: Zero-shot Video Generation using Image Diffusion Models

Muhammad Haaris Khan, Hadrien Reynaud, Bernhard Kainz

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

PhysDreamer: Physics-Based Interaction with 3D Objects via Video Generation

Tianyuan Zhang, Hong-Xing Yu, Rundi Wu, Brandon Y. Feng, Changxi Zheng, Noah Snavely, Jiajun Wu, William T. Freeman

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Project website at: https://physdreamer.github.io/ Appear on ECCV 2024

VideoPhy: Evaluating Physical Commonsense for Video Generation

Hritik Bansal, Zongyu Lin, Tianyi Xie, Zeshun Zong, Michal Yarom, Yonatan Bitton, Chenfanfu Jiang, Yizhou Sun, Kai-Wei Chang, Aditya Grover

专题命中 视频生成 ：video generation(title)；text-to-video(abstract)；分类 cs.CV

Comments 43 pages, 29 figures, 12 tables. Added CogVideo and Dream Machine in v2

COMUNI: Decomposing Common and Unique Video Signals for Diffusion-based Video Generation

Mingzhen Sun, Weining Wang, Xinxin Zhu, Jing Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

SurGen: Text-Guided Diffusion Model for Surgical Video Generation

Joseph Cho, Samuel Schmidgall, Cyril Zakka, Mrudang Mathur, Dhamanpreet Kaur, Rohan Shad, William Hiesinger

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

DiffTED: One-shot Audio-driven TED Talk Video Generation with Diffusion-based Co-speech Gestures

Steven Hogue, Chenxu Zhang, Hamza Daruger, Yapeng Tian, Xiaohu Guo

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

DriveScape: Towards High-Resolution Controllable Multi-View Driving Video Generation

Wei Wu, Xi Guo, Weixuan Tang, Tingxuan Huang, Chiyu Wang, Dongyue Chen, Chenjing Ding

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments Homepage: https://metadrivescape.github.io/papers_project/drivescapev1/index.html

DriveGenVLM: Real-world Video Generation for Vision Language Model based Autonomous Driving

Yongjie Fu, Anmol Jain, Xuan Di, Xu Chen, Zhaobin Mo

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

TVG: A Training-free Transition Video Generation Method with Diffusion Models

Rui Zhang, Yaosen Chen, Yuegen Liu, Wei Wang, Xuming Wen, Hongxia Wang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Towards Understanding Unsafe Video Generation

Yan Pang, Aiping Xiong, Yang Zhang, Tianhao Wang

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

Comments 18 pages

Learning Online Scale Transformation for Talking Head Video Generation

Fa-Ting Hong, Dan Xu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV

A Comprehensive Survey on Human Video Generation: Challenges, Methods, and Insights

Wentao Lei, Jinting Wang, Fengji Ma, Guanjie Huang, Li Liu

专题命中 视频生成 ：video generation(title,abstract)；分类 cs.CV