VideoFusion: Decomposed Diffusion Models for High-Quality Video Generation
University of Chinese Academy of Sciences (UCAS)（中国科学院大学）；Alibaba Group（阿里巴巴集团）；Center for Research on Intelligent Perception and Computing (CRIPAC)（智能感知与计算研究中心）；Institute of Automation, Chinese Academy of Sciences (CASIA)（中国科学院自动化研究所）；Ant Group（蚂蚁集团）；Nanjing University（南京大学）
Zhengxiong Luo, Dayou Chen, Yingya Zhang, Yan Huang, Liang Wang, Yujun Shen, Deli Zhao, Jingren Zhou, Tieniu Tan
A diffusion probabilistic model (DPM), which constructs a forward diffusion process by gradually adding noise to data points and learns the reverse denoising process to generate new samples, has been shown to handle complex data distribution. Despite its recent success in image synthesis, applying DPMs to video generation is still challenging due to high-dimensional data spaces. Previous methods usually adopt a standard diffusion process, where frames in the same video clip are destroyed with independent noises, ignoring the content redundancy and temporal correlation. This work presents a decomposed diffusion process via resolving the per-frame noise into a base noise that is shared among all frames and a residual noise that varies along the time axis. The denoising pipeline employs two jointly-learned networks to match the noise decomposition accordingly. Experiments on various datasets confirm that our approach, termed as VideoFusion, surpasses both GAN-based and diffusion-based alternatives in high-quality video generation. We further show that our decomposed formulation can benefit from pre-trained image diffusion models and well-support text-conditioned video creation.
University of California, Davis（加州大学戴维斯分校）；Microsoft Research（微软研究院）；University of Southern California（南加州大学）；University of California, Santa Cruz（加州大学圣克鲁兹分校）
Fujian Agriculture and Forestry University（福建农林大学）；Tianjin University（天津大学）；Minjiang University（闽江学院）；Institute of High Performance Computing, Agency for Science, Technology and Research（新加坡科技研究局高性能计算研究所）；Sichuan University（四川大学）；Centre for Frontier AI Research (CFAR), Agency for Science, Technology and Research (A*STAR)（新加坡科技研究局前沿人工智能研究中心（CFAR））
LinCa: Accelerating Diffusion Models via Learnable Decomposed Feature Caching
Shanghai Jiao Tong University（上海交通大学）；Shandong University（山东大学）；Terminal Intelligent Computing Division, Alibaba Cloud（阿里云终端智能计算事业部）；South China University of Technology（华南理工大学）；Jilin University（吉林大学）
The Chinese University of Hong Kong（香港中文大学）；Monash University（莫纳什大学）；Cornell University（康奈尔大学）；Shanghai AI Laboratory（上海人工智能实验室）；Nanyang Technological University（南洋理工大学）
Deforming Videos to Masks: Flow Matching for Referring Video Segmentation
SGIT AI Lab, State Grid Corporation of China（国网信通研究院）；University of California, San Diego（加州大学圣地亚哥分校）；The Hong Kong University of Science and Technology（香港科技大学）；The University of Tokyo（东京大学）；University of Cambridge（剑桥大学）；Zhejiang University of Technology（浙江工业大学）；Baidu（百度）
Holo-World: Unified Camera, Object and Weather Control for Video World Model
University of Science and Technology of China（中国科学技术大学）；Li Auto；Institute of Artificial Intelligence, Hefei Comprehensive National Science Center（合肥综合国家科学中心人工智能研究院）
Hierarchical Curriculum Learning for Surgical Video Generation: Focusing on Bilateral Axillo-Breast Approach Robotic Thyroidectomy Datasets
Seoul National University College of Medicine（首尔国立大学医学院）；Seoul National University Hospital（首尔国立大学医院）；YONSEI WITH-YOU Surgery Clinic（延世WITH-YOU外科诊所）；Institute of Convergence Medicine with Innovative Technology, Seoul National University Hospital（首尔国立大学医院创新技术融合医学研究所）
DRSM: efficient neural 4d decomposition for dynamic reconstruction in stationary monocular cameras
Xiamen University（厦门大学）；National Institute for Data Science in Health and Medicine, Xiamen University（厦门大学健康与医学数据科学国家研究所）；BNU-HKBU United International College（北京师范大学-香港浸会大学联合国际学院）；The University of Texas at Dallas（德克萨斯大学达拉斯分校）
Sparse Transformer for Ultra-sparse Sampled Video Compressive Sensing
Zhejiang University（浙江大学）；Westlake University（西湖大学）；vivo Mobile Communication Co., Ltd（vivo移动通信有限公司）；School of Engineering and Research Center for Industries of the Future（工程学院和未来产业研究中心）；University of Arizona（亚利桑那大学）；Wyant College of Optical Sciences（Wyant光学科学学院）
Artemis: Geometry-Grounded Multi-Agent Driving World Models with Shared 3D State and Progressive Memory Update
University of Oxford（牛津大学）；University of Cambridge（剑桥大学）；University of Twente（特文特大学）；National University of Singapore（新加坡国立大学）；University of Bath（巴斯大学）
Identity-Preserving Text-to-Video Generation by Frequency Decomposition
Peking University（北京大学）；Peng Cheng Laboratory（鹏城实验室）；University of Rochester（罗切斯特大学）；Rabbitpre Intelligence（睿兔智算）；National University of Singapore（新加坡国立大学）
Split4D: Decomposed 4D Scene Reconstruction Without Video Segmentation
Zhejiang University China；Shanghai AI Lab China；State Key Lab of CAD\&CG, Zhejiang University China；Zhejiang University；Shanghai AI Lab；State Key Lab of CAD\&CG, Zhejiang University
