视频大模型

NOVA3D: Normal Aligned Video Diffusion Model for Single Image to 3D Generation

Yuxiao Yang, Peihao Li, Yuhong Zhang, Junzhe Lu, Xianglong He, Minghan Qin, Weitao Wang, Haoqian Wang

机构 * Tsinghua University（清华大学） 纠错

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments 8 pages, 7 figures, accepted by ICME 2025

Learning Temporally Consistent Video Depth from Video Diffusion Priors

Jiahao Shao, Yuanbo Yang, Hongyu Zhou, Youmin Zhang, Yujun Shen, Vitor Guizilini, Yue Wang, Matteo Poggi, Yiyi Liao

机构 * Zhejiang University（浙江大学） ； University of Bologna（博洛尼亚大学） ； University of Southern California（南加州大学） ； Ant Group（蚂蚁集团） ； Toyota Research Institute（丰田研究院） ； Rock Universe AI 纠错

专题命中 视频扩散模型 ：video diffusion(title)；long video(abstract)；分类 cs.CV

FPSAttention: Training-Aware FP8 and Sparsity Co-Design for Fast Video Diffusion

Akide Liu, Zeyu Zhang, Zhexin Li, Xuehai Bai, Yizeng Han, Jiasheng Tang, Yuanjie Xing, Jichao Wu, Mingyang Yang, Weihua Chen, Jiahao He, Yuanyu He, Fan Wang, Gholamreza Haffari, Bohan Zhuang

机构 * Monash University（墨尔本大学） ； DAMO Academy, Alibaba Group（阿里云图学院） ； ZIP Lab, Zhejiang University（浙江大学ZIP实验室） ； Hupan Lab（汇磐实验室） 纠错

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

Comments Project Page: https://fps.ziplab.co

Voyager: Long-Range and World-Consistent Video Diffusion for Explorable 3D Scene Generation

Tianyu Huang, Wangguandong Zheng, Tengfei Wang, Yuhao Liu, Zhenwei Wang, Junta Wu, Jie Jiang, Hui Li, Rynson W. H. Lau, Wangmeng Zuo, Chunchao Guo

机构 * Harbin Institute of Technology China（哈尔滨工业大学） ； Southeast University China（东南大学） ； Tencent Hunyuan China（腾讯幻境） ； City University of Hong Kong China（香港城市大学） 纠错

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

DiffuseSlide: Training-Free High Frame Rate Video Generation Diffusion

Geunmin Hwang, Hyun-kyu Ko, Younghyun Kim, Seungryong Lee, Eunbyung Park

机构 * RECON Labs Inc.（RECON实验室公司） ； Department of Artificial Intelligence, Yonsei University（延世大学人工智能系） ； Department of Artificial Intelligence, Sungkyunkwan University（成均馆大学人工智能系） ； Department of Electrical and Computer Engineering, Sungkyunkwan University（成均馆大学电气与计算机工程系） 纠错

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

UniGeo: Taming Video Diffusion for Unified Consistent Geometry Estimation

Yang-Tian Sun, Xin Yu, Zehuan Huang, Yi-Hua Huang, Yuan-Chen Guo, Ziyi Yang, Yan-Pei Cao, Xiaojuan Qi

机构 * The University of Hong Kong（香港大学） ； Beihang University（北京航空航天大学） ； VAST 纠错

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

Comments Project page: https://sunyangtian.github.io/UniGeo-web/

Improving Tropical Cyclone Forecasting With Video Diffusion Models

Zhibo Ren, Pritthijit Nath, Pancham Shukla

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Recommended for spotlight presentation at the ICLR 2025 workshop on Tackling Climate Change with Machine Learning. 7 pages, 7 figures

SVAD: From Single Image to 3D Avatar via Synthetic Data Generation with Video Diffusion and Data Augmentation

Yonwoo Choi

机构 * SECERN AI 纠错

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2025 SyntaGen Workshop, Project Page: https://yc4ny.github.io/SVAD/

PhysFlow: Unleashing the Potential of Multi-modal Foundation Models and Video Diffusion for 4D Dynamic Physical Scene Simulation

Zhuoman Liu, Weicai Ye, Yan Luximon, Pengfei Wan, Di Zhang

机构 * The Hong Kong Polytechnic University（香港理工大学） ； Kuaishou Technology（快手科技） 纠错

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments CVPR 2025. Homepage: https://zhuomanliu.github.io/PhysFlow/

DiVE: Efficient Multi-View Driving Scenes Generation Based on Video Diffusion Transformer

Junpeng Jiang, Gangyi Hong, Miao Zhang, Hengtong Hu, Kun Zhan, Rui Shao, Liqiang Nie

机构 * Harbin Institute of Technology（哈尔滨工业大学） ； Li Auto Inc.（Li汽车公司） ； Tsinghua University（清华大学） 纠错

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

Sparse VideoGen: Accelerating Video Diffusion Transformers with Spatial-Temporal Sparsity

Haocheng Xi, Shuo Yang, Yilong Zhao, Chenfeng Xu, Muyang Li, Xiuyu Li, Yujun Lin, Han Cai, Jintao Zhang, Dacheng Li, Jianfei Chen, Ion Stoica, Kurt Keutzer, Song Han

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

Comments 17 pages, 11 figures, 3 tables

FlowLoss: Dynamic Flow-Conditioned Loss Strategy for Video Diffusion Models

Kuanting Wu, Kei Ota, Asako Kanezaki

机构 * Science Tokyo（科学东京） ； Mitsubishi Electric（三菱电机） 纠错

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Understanding Attention Mechanism in Video Diffusion Models

Bingyan Liu, Chengyu Wang, Tongtong Su, Huan Ten, Jun Huang, Kailing Guo, Kui Jia

专题命中 视频扩散模型 ：video diffusion(title)；text-to-video(abstract)；分类 cs.CV

VGDFR: Diffusion-based Video Generation with Dynamic Latent Frame Rate

Zhihang Yuan, Rui Xie, Yuzhang Shang, Hanling Zhang, Siyuan Wang, Shengen Yan, Guohao Dai, Yu Wang

专题命中 视频扩散模型 ：video generation(title,abstract)；分类 cs.CV

GaussVideoDreamer: 3D Scene Generation with Video Diffusion and Inconsistency-Aware Gaussian Splatting

Junlin Hao, Peiheng Wang, Haoyang Wang, Xinggong Zhang, Zongming Guo

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

NormalCrafter: Learning Temporally Consistent Normals from Video Diffusion Priors

Yanrui Bin, Wenbo Hu, Haoyuan Wang, Xinya Chen, Bing Wang

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments 9 pages, 6 figures, Project Page: https://normalcrafter.github.io/

Analysis of Attention in Video Diffusion Transformers

Yuxin Wen, Jim Wu, Ajay Jain, Tom Goldstein, Ashwinee Panda

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

StarGen: A Spatiotemporal Autoregression Framework with Video Diffusion Model for Scalable and Controllable Scene Generation

Shangjin Zhai, Zhichao Ye, Jialin Liu, Weijian Xie, Jiaqi Hu, Zhen Peng, Hua Xue, Danpeng Chen, Xiaomeng Wang, Lei Yang, Nan Wang, Haomin Liu, Guofeng Zhang

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Discriminator-Free Direct Preference Optimization for Video Diffusion

Haoran Cheng, Qide Dong, Liang Peng, Zhizhou Sha, Weiguo Feng, Jinghui Xie, Zhao Song, Shilei Wen, Xiaofei He, Boxi Wu

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments arXiv admin note: text overlap with arXiv:2412.14167 by other authors

WF-VAE: Enhancing Video VAE by Wavelet-Driven Energy Flow for Latent Video Diffusion Model

Zongjian Li, Bin Lin, Yang Ye, Liuhan Chen, Xinhua Cheng, Shenghai Yuan, Li Yuan

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments 8 pages, 7 figures

InterDyn: Controllable Interactive Dynamics with Video Diffusion Models

Rick Akkerman, Haiwen Feng, Michael J. Black, Dimitrios Tzionas, Victoria Fernández Abrevaya

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

SkyReels-A2: Compose Anything in Video Diffusion Transformers

Zhengcong Fei, Debang Li, Di Qiu, Jiahua Wang, Yikun Dou, Rui Wang, Jingtao Xu, Mingyuan Fan, Guibin Chen, Yang Li, Yahui Zhou

专题命中 视频扩散模型 ：video diffusion(title)；video generation(abstract)；分类 cs.CV

VideoScene: Distilling Video Diffusion Model to Generate 3D Scenes in One Step

Hanyang Wang, Fangfu Liu, Jiawei Chi, Yueqi Duan

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Accepted by CVPR 2025; Project Page: https://hanyang-21.github.io/VideoScene

Articulated Kinematics Distillation from Video Diffusion Models

Xuan Li, Qianli Ma, Tsung-Yi Lin, Yongxin Chen, Chenfanfu Jiang, Ming-Yu Liu, Donglai Xiang

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Adapting Video Diffusion Models for Time-Lapse Microscopy

Alexander Holmberg, Nils Mechtel, Wei Ouyang

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Lux Post Facto: Learning Portrait Performance Relighting with Conditional Video Diffusion and a Hybrid Dataset

Yiqun Mei, Mingming He, Li Ma, Julien Philip, Wenqi Xian, David M George, Xueming Yu, Gabriel Dedic, Ahmet Levent Taşel, Ning Yu, Vishal M. Patel, Paul Debevec

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments CVPR 2025

NVS-Solver: Video Diffusion Model as Zero-Shot Novel View Synthesizer

Meng You, Zhiyu Zhu, Hui Liu, Junhui Hou

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments ICLR 2025

Can Video Diffusion Model Reconstruct 4D Geometry?

Jinjie Mai, Wenxuan Zhu, Haozhe Liu, Bing Li, Cheng Zheng, Jürgen Schmidhuber, Bernard Ghanem

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

EGVD: Event-Guided Video Diffusion Model for Physically Realistic Large-Motion Frame Interpolation

Ziran Zhang, Xiaohui Li, Yihao Liu, Yujin Wang, Yueting Chen, Tianfan Xue, Shi Guo

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Repurposing Pre-trained Video Diffusion Models for Event-based Video Interpolation

Jingxi Chen, Brandon Y. Feng, Haoming Cai, Tianfu Wang, Levi Burner, Dehao Yuan, Cornelia Fermuller, Christopher A. Metzler, Yiannis Aloimonos

专题命中 视频扩散模型 ：video diffusion(title,abstract)；分类 cs.CV

Comments Accepted to CVPR 2025