视频大模型

IDOL: Unified Dual-Modal Latent Diffusion for Human-Centric Joint Video-Depth Generation

Yuanhao Zhai, Kevin Lin, Linjie Li, Chung-Ching Lin, Jianfeng Wang, Zhengyuan Yang, David Doermann, Junsong Yuan, Zicheng Liu, Lijuan Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments ECCV 2024; project page: https://yhzhai.github.io/idol/

Kinetic Typography Diffusion Model

Seonmi Park, Inhwan Bae, Seunghyun Shin, Hae-Gon Jeon

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted at ECCV 2024, Project page: https://seonmip.github.io/kinety

E2VIDiff: Perceptual Events-to-Video Reconstruction using Diffusion Priors

Jinxiu Liang, Bohan Yu, Yixin Yang, Yiming Han, Boxin Shi

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

MVOC: a training-free multiple video object composition method with diffusion models

Wei Wang, Yaosen Chen, Yuegen Liu, Qi Yuan, Shubin Yang, Yanru Zhang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Diffusion-Promoted HDR Video Reconstruction

Yuanshen Guan, Ruikang Xu, Mingde Yao, Ruisheng Gao, Lizhi Wang, Zhiwei Xiong

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Arxiv Preprint

Evaluating and Mitigating IP Infringement in Visual Generative AI

Zhenting Wang, Chen Chen, Vikash Sehwag, Minzhou Pan, Lingjuan Lyu

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

LatentMan: Generating Consistent Animated Characters using Image Diffusion Models

Abdelrahman Eldesokey, Peter Wonka

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

Comments CVPRW 2024. Project page: https://abdo-eldesokey.github.io/latentman/

X-Ray: A Sequential 3D Representation For Generation

Tao Hu, Wenhang Ge, Yuyang Zhao, Gim Hee Lee

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

VividDream: Generating 3D Scene with Ambient Dynamics

Yao-Chih Lee, Yi-Ting Chen, Andrew Wang, Ting-Hsuan Liao, Brandon Y. Feng, Jia-Bin Huang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project page: https://vivid-dream-4d.github.io

Zero-Shot Video Semantic Segmentation based on Pre-Trained Diffusion Models

Qian Wang, Abdelrahman Eldesokey, Mohit Mendiratta, Fangneng Zhan, Adam Kortylewski, Christian Theobalt, Peter Wonka

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project webpage: https://qianwangx.github.io/VidSeg_diffusion/

A Unified Approach for Text- and Image-guided 4D Scene Generation

Yufeng Zheng, Xueting Li, Koki Nagano, Sifei Liu, Karsten Kreis, Otmar Hilliges, Shalini De Mello

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project page: https://research.nvidia.com/labs/nxp/dream-in-4d/

DORSal: Diffusion for Object-centric Representations of Scenes et al

Allan Jabri, Sjoerd van Steenkiste, Emiel Hoogeboom, Mehdi S. M. Sajjadi, Thomas Kipf

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Accepted to ICLR 2024. Project page: https://www.sjoerdvansteenkiste.com/dorsal

Bridge to Non-Barrier Communication: Gloss-Prompted Fine-grained Cued Speech Gesture Generation with Diffusion Model

Wentao Lei, Li Liu, Jun Wang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Journal ref IJCAI 2024

The Missing U for Efficient Diffusion Models

Sergio Calvo-Ordonez, Chun-Wun Cheng, Jiahao Huang, Lipei Zhang, Guang Yang, Carola-Bibiane Schonlieb, Angelica I Aviles-Rivero

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments 23 pages, 14 figures, Accepted at Transactions of Machine Learning Research (04/2024)

Upsample Guidance: Scale Up Diffusion Models without Training

Juno Hwang, Yong-Hyun Park, Junghyo Jo

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments 15 pages, 15 Figures

Sat2Scene: 3D Urban Scene Generation from Satellite Images with Diffusion

Zuoyue Li, Zhenqiang Li, Zhaopeng Cui, Marc Pollefeys, Martin R. Oswald

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Journal ref CVPR 2024

An Intermediate Fusion ViT Enables Efficient Text-Image Alignment in Diffusion Models

Zizhao Hu, Shaochong Jia, Mohammad Rostami

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

STAG4D: Spatial-Temporal Anchored Generative 4D Gaussians

Yifei Zeng, Yanqin Jiang, Siyu Zhu, Yuanxun Lu, Youtian Lin, Hao Zhu, Weiming Hu, Xun Cao, Yao Yao

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Magic-Me: Identity-Specific Video Customized Diffusion

Ze Ma, Daquan Zhou, Chun-Hsiao Yeh, Xue-She Wang, Xiuyu Li, Huanrui Yang, Zhen Dong, Kurt Keutzer, Jiashi Feng

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments Project Page at https://magic-me-webpage.github.io

AnimateDiff-Lightning: Cross-Model Diffusion Distillation

Shanchuan Lin, Xiao Yang

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Envision3D: One Image to 3D with Anchor Views Interpolation

Yatian Pang, Tanghui Jia, Yujun Shi, Zhenyu Tang, Junwu Zhang, Xinhua Cheng, Xing Zhou, Francis E. H. Tay, Li Yuan

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments GitHub repository: https://github.com/PKU-YuanGroup/Envision3D

VLOGGER: Multimodal Diffusion for Embodied Avatar Synthesis

Enric Corona, Andrei Zanfir, Eduard Gabriel Bazavan, Nikos Kolotouros, Thiemo Alldieck, Cristian Sminchisescu

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV

Comments Project web: https://enriccorona.github.io/vlogger/

Animate124: Animating One Image to 4D Dynamic Scene

Yuyang Zhao, Zhiwen Yan, Enze Xie, Lanqing Hong, Zhenguo Li, Gim Hee Lee

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments Project Page: https://animate124.github.io

Boximator: Generating Rich and Controllable Motions for Video Synthesis

Jiawei Wang, Yuchen Zhang, Jiaxin Zou, Yan Zeng, Guoqiang Wei, Liping Yuan, Hang Li

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Comments 16 pages, 9 figures

ActAnywhere: Subject-Aware Video Background Generation

Boxiao Pan, Zhan Xu, Chun-Hao Paul Huang, Krishna Kumar Singh, Yang Zhou, Leonidas J. Guibas, Jimei Yang

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

Multi-scale 2D Temporal Map Diffusion Models for Natural Language Video Localization

Chongzhi Zhang, Mingyuan Zhang, Zhiyang Teng, Jiayi Li, Xizhou Zhu, Lewei Lu, Ziwei Liu, Aixin Sun

专题命中 视频扩散模型 ：video understanding(abstract)；分类 cs.CV

HiCAST: Highly Customized Arbitrary Style Transfer with Adapter Enhanced Diffusion Models

Hanzhang Wang, Haoran Wang, Jinze Yang, Zhongrui Yu, Zeke Xie, Lei Tian, Xinyan Xiao, Junjun Jiang, Xianming Liu, Mingming Sun

专题命中 视频扩散模型 ：video diffusion(abstract)；分类 cs.CV

MotionCrafter: One-Shot Motion Customization of Diffusion Models

Yuxin Zhang, Fan Tang, Nisha Huang, Haibin Huang, Chongyang Ma, Weiming Dong, Changsheng Xu

专题命中 视频扩散模型 ：text-to-video(abstract)；分类 cs.CV

DVIS++: Improved Decoupled Framework for Universal Video Segmentation

Tao Zhang, Xingye Tian, Yikang Zhou, Shunping Ji, Xuebo Wang, Xin Tao, Yuan Zhang, Pengfei Wan, Zhongyuan Wang, Yu Wu

专题命中 视频扩散模型 ：long video(abstract)；分类 cs.CV

Towards Accurate Guided Diffusion Sampling through Symplectic Adjoint Method

Jiachun Pan, Hanshu Yan, Jun Hao Liew, Jiashi Feng, Vincent Y. F. Tan

专题命中 视频扩散模型 ：video generation(abstract)；分类 cs.CV