图像生成

AID: Adapting Image2Video Diffusion Models for Instruction-guided Video Prediction

Zhen Xing, Qi Dai, Zejia Weng, Zuxuan Wu, Yu-Gang Jiang

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

MeLFusion: Synthesizing Music from Image and Language Cues using Diffusion Models

Sanjoy Chowdhury, Sayan Nag, K J Joseph, Balaji Vasan Srinivasan, Dinesh Manocha

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted at CVPR 2024 as Highlight paper. Webpage: https://schowdhury671.github.io/melfusion_cvpr2024/

Flexible Motion In-betweening with Diffusion Models

Setareh Cohan, Guy Tevet, Daniele Reda, Xue Bin Peng, Michiel van de Panne

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments SIGGRAPH 2024. For project page and code, see https://setarehc.github.io/CondMDI/

VecFusion: Vector Font Generation with Diffusion

Vikas Thamizharasan, Difan Liu, Shantanu Agarwal, Matthew Fisher, Michael Gharbi, Oliver Wang, Alec Jacobson, Evangelos Kalogerakis

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

MMFusion: Multi-modality Diffusion Model for Lymph Node Metastasis Diagnosis in Esophageal Cancer

Chengyu Wu, Chengkai Wang, Yaqi Wang, Huiyu Zhou, Yatao Zhang, Qifeng Wang, Shuai Wang

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments Early accepted to MICCAI 2024 (6/6/5)

DiffPoseTalk: Speech-Driven Stylistic 3D Facial Animation and Head Pose Generation via Diffusion Models

Zhiyao Sun, Tian Lv, Sheng Ye, Matthieu Lin, Jenny Sheng, Yu-Hui Wen, Minjing Yu, Yong-Jin Liu

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments SIGGRAPH 2024 (Journal Track). Project page: https://diffposetalk.github.io/

GaussianDreamer: Fast Generation from Text to 3D Gaussians by Bridging 2D and 3D Diffusion Models

Taoran Yi, Jiemin Fang, Junjie Wang, Guanjun Wu, Lingxi Xie, Xiaopeng Zhang, Wenyu Liu, Qi Tian, Xinggang Wang

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments CVPR 2024, Project page: https://taoranyi.com/gaussiandreamer/

Shape Conditioned Human Motion Generation with Diffusion Model

Kebing Xue, Hyewon Seo

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Spice-E : Structural Priors in 3D Diffusion using Cross-Entity Attention

Etai Sella, Gal Fiebelman, Noam Atia, Hadar Averbuch-Elor

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Accepted to SIGGRAPH 2024. Project webpage: https://tau-vailab.github.io/Spice-E

LGTM: Local-to-Global Text-Driven Human Motion Diffusion Model

Haowen Sun, Ruikun Zheng, Haibin Huang, Chongyang Ma, Hui Huang, Ruizhen Hu

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments 9 pages,7 figures, SIGGRAPH 2024

Blue noise for diffusion models

Xingchang Huang, Corentin Salaün, Cristina Vasconcelos, Christian Theobalt, Cengiz Öztireli, Gurprit Singh

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments SIGGRAPH 2024 Conference Proceedings; Project page: https://xchhuang.github.io/bndm

Lodge: A Coarse to Fine Diffusion Network for Long Dance Generation Guided by the Characteristic Dance Primitives

Ronghui Li, YuXiang Zhang, Yachao Zhang, Hongwen Zhang, Jie Guo, Yan Zhang, Yebin Liu, Xiu Li

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Accepted by CVPR2024, Project page: https://li-ronghui.github.io/lodge

DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation

Junming Chen, Yunfei Liu, Jianan Wang, Ailing Zeng, Yu Li, Qifeng Chen

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Accepted by CVPR 2024. Project page: https://jeremycjm.github.io/proj/DiffSHEG

Enhancing Diffusion-based Point Cloud Generation with Smoothness Constraint

Yukun Li, Liping Liu

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Co-Speech Gesture Video Generation via Motion-Decoupled Diffusion Model

Xu He, Qiaochu Huang, Zhensong Zhang, Zhiwei Lin, Zhiyong Wu, Sicheng Yang, Minglei Li, Zhiyi Chen, Songcen Xu, Xiaofei Wu

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments 22 pages, 8 figures, CVPR 2024

Drag Your Noise: Interactive Point-based Editing via Diffusion Semantic Propagation

Haofeng Liu, Chenshu Xu, Yifei Yang, Lihua Zeng, Shengfeng He

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Accepted by CVPR 2024

As-Plausible-As-Possible: Plausibility-Aware Mesh Deformation Using 2D Diffusion Priors

Seungwoo Yoo, Kunho Kim, Vladimir G. Kim, Minhyuk Sung

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Project page: https://as-plausible-as-possible.github.io/

Language Model Beats Diffusion -- Tokenizer is Key to Visual Generation

Lijun Yu, José Lezama, Nitesh B. Gundavarapu, Luca Versari, Kihyuk Sohn, David Minnen, Yong Cheng, Vighnesh Birodkar, Agrim Gupta, Xiuye Gu, Alexander G. Hauptmann, Boqing Gong, Ming-Hsuan Yang, Irfan Essa, David A. Ross, Lu Jiang

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments ICLR 2024

TRIP: Temporal Residual Learning with Image Noise Prior for Image-to-Video Diffusion Models

Zhongwei Zhang, Fuchen Long, Yingwei Pan, Zhaofan Qiu, Ting Yao, Yang Cao, Tao Mei

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments CVPR 2024; Project page: https://trip-i2v.github.io/TRIP/

Learning Spatial Adaptation and Temporal Coherence in Diffusion Models for Video Super-Resolution

Zhikai Chen, Fuchen Long, Zhaofan Qiu, Ting Yao, Wengang Zhou, Jiebo Luo, Tao Mei

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments CVPR 2024

A Unified Module for Accelerating STABLE-DIFFUSION: LCM-LORA

Ayush Thakur, Rashmi Vashisth

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

MAS: Multi-view Ancestral Sampling for 3D motion generation using 2D diffusion

Roy Kapon, Guy Tevet, Daniel Cohen-Or, Amit H. Bermano

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Intrinsic Image Diffusion for Indoor Single-view Material Estimation

Peter Kocsis, Vincent Sitzmann, Matthias Nießner

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Project page: https://peter-kocsis.github.io/IntrinsicImageDiffusion/ Video: https://youtu.be/lz0meJlj5cA

One-Step Image Translation with Text-to-Image Models

Gaurav Parmar, Taesung Park, Srinivasa Narasimhan, Jun-Yan Zhu

专题命中 扩散模型 ：text-to-image(title)；diffusion(abstract)；分类 cs.CV、cs.GR

Comments Github: https://github.com/GaParmar/img2img-turbo

FaceTalk: Audio-Driven Motion Diffusion for Neural Parametric Head Models

Shivangi Aneja, Justus Thies, Angela Dai, Matthias Nießner

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Paper Video: https://youtu.be/7Jf0kawrA3Q Project Page: https://shivangi-aneja.github.io/projects/facetalk/

Journal ref CVPR 2024

EucliDreamer: Fast and High-Quality Texturing for 3D Models with Stable Diffusion Depth

Cindy Le, Congrui Hetang, Chendi Lin, Ang Cao, Yihui He

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Terrain Diffusion Network: Climatic-Aware Terrain Generation with Geological Sketch Guidance

Zexin Hu, Kun Hu, Clinton Mo, Lei Pan, Zhiyong Wang

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Seeing and Hearing: Open-domain Visual-Audio Generation with Diffusion Latent Aligners

Yazhou Xing, Yingqing He, Zeyue Tian, Xintao Wang, Qifeng Chen

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.MM

Comments Accepted to CVPR 2024. Project website: https://yzxing87.github.io/Seeing-and-Hearing/

MVD$^2$: Efficient Multiview 3D Reconstruction for Multiview Diffusion

Xin-Yang Zheng, Hao Pan, Yu-Xiao Guo, Xin Tong, Yang Liu

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Denoising Diffusion via Image-Based Rendering

Titas Anciukevičius, Fabian Manhardt, Federico Tombari, Paul Henderson

专题命中 扩散模型 ：diffusion(title,abstract)；分类 cs.CV、cs.GR

Comments Accepted at ICLR 2024. Project page: https://anciukevicius.github.io/generative-image-based-rendering