We propose a new class of generative diffusion models, called functional diffusion. In contrast to previous work, functional diffusion works on samples that are represented by functions with a continuous domain. Functional diffusion can be seen as an extension of classical diffusion models to an infinite-dimensional domain. Functional diffusion is very versatile as images, videos, audio, 3D shapes, deformations, \etc, can be handled by the same framework with minimal changes. In addition, functional diffusion is especially suited for irregular data or data defined in non-standard domains. In our work, we derive the necessary foundations for functional diffusion and propose a first implementation based on the transformer architecture. We show generative results on complicated signed distance functions and deformation functions defined on 3D surfaces.
Deformation-Recovery Diffusion Model (DRDM): Instance Deformation for Image Manipulation and Synthesis
The Kennedy Institute of Rheumatology, University of Oxford, U.K.;Chinese Academy of Medical Sciences Oxford Institute, University of Oxford, U.K.;Big Data Institute, University of Oxford, U.K.;edited MRC Laboratory of Medical Sciences, Imperial College London, U.K.;Department of Computer Science, University of Oxford, Oxford, U.K. [12.5pt] Project page: -5pt
Diff-Def: Diffusion-Generated Deformation Fields for Conditional Atlases
School of Computation, Information and Technology and the School of Medicine and Health, TUM Klinikum, Technical University of Munich(计算信息学院和医学健康学院,慕尼黑技术大学克林克医院,慕尼黑技术大学);Munich Center for Machine Learning (MCML), Munich, Germany(慕尼黑机器学习中心(MCML),德国慕尼黑);Department of Computing, Imperial College London, UK(计算学院,伦敦帝国学院,英国);FAU Erlangen-Nürnberg, Germany(埃尔兰根-纽伦堡大学,德国)
Trustworthy Longitudinal Brain MRI Completion: A Deformation-Based Approach with KAN-Enhanced Diffusion Model
School of Biomedical Engineering and Imaging Science, King's College London, London, UK(生物医学工程与成像科学学院,伦敦国王学院);School of Biomedical Engineering, ShanghaiTech University, Shanghai, China(生物医学工程学院,上海科技大学);School of Computer Science and Digital Technologies, Aston University, Birmingham, UK(计算机科学与数字技术学院,阿斯顿大学);Kunming Medical University, Kunming, China(昆明医学院)
D-Garment: Physically Grounded Latent Diffusion for Dynamic Garment Deformations
Inria Centre at the University Grenoble Alpes(格勒诺布尔阿尔卑斯大学Inria研究中心);Inria, University of Rennes, CNRS, IRISA-UMR 6074(雷恩大学Inria、CNRS、IRISA-UMR 6074);InterDigital Inc.(InterDigital公司)
Drive Any Mesh: 4D Latent Diffusion for Mesh Deformation from Video
State Key Laboratory of Virtual Reality Technology and Systems, Beihang University(虚拟现实技术与系统国家重点实验室,北京航空航天大学);School of Electronic and Computer Engineering, Peking University(电子与计算机工程学院,北京大学);Baidu VIS(百度VIS)