Diffusion Models, Image Super-Resolution And Everything: A Survey
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau(莱茵兰-普法尔茨州 Kaiserslautern-Landau 工业大学)
Brian B. Moser, Arundhati S. Shanbhag, Federico Raue, Stanislav Frolov, Sebastian Palacio, Andreas Dengel
Diffusion Models (DMs) have disrupted the image Super-Resolution (SR) field and further closed the gap between image quality and human perceptual preferences. They are easy to train and can produce very high-quality samples that exceed the realism of those produced by previous generative methods. Despite their promising results, they also come with new challenges that need further research: high computational demands, comparability, lack of explainability, color shifts, and more. Unfortunately, entry into this field is overwhelming because of the abundance of publications. To address this, we provide a unified recount of the theoretical foundations underlying DMs applied to image SR and offer a detailed analysis that underscores the unique characteristics and methodologies within this domain, distinct from broader existing reviews in the field. This survey articulates a cohesive understanding of DM principles and explores current research avenues, including alternative input domains, conditioning techniques, guidance mechanisms, corruption spaces, and zero-shot learning approaches. By offering a detailed examination of the evolution and current trends in image SR through the lens of DMs, this survey sheds light on the existing challenges and charts potential future directions, aiming to inspire further innovation in this rapidly advancing area.
Diffuse Everything: Multimodal Diffusion Models on Arbitrary State Spaces
Machine Learning Center, Georgia Institute of Technology, Atlanta, GA;School of Mathematics, Georgia Institute of Technology, Atlanta, GA;Department of Mathematics \& Statistics, SUNY Albany, NY
Everything at Every Scale: Scale-Invariant Diffusion with Continuous Super-Resolution
Department of Physics, Massachusetts Institute of Technology(麻省理工学院物理系);Department of EECS, Massachusetts Institute of Technology(麻省理工学院电子工程与计算机科学系);NSF AI Institute for Artificial Intelligence and Fundamental Interactions(国家科学基金会人工智能与基础相互作用研究所);Institute for Data, Systems and Society, Massachusetts Institute of Technology(麻省理工学院数据、系统与社会研究所)
From Diffusion to Resolution: Leveraging 2D Diffusion Models for 3D Super-Resolution Task
School of Advanced Interdisciplinary Studies, University of Chinese Academy of Sciences(中国科学院大学先进交叉科学学院);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);School of Future Technology, University of Chinese Academy of Sciences(中国科学院大学未来技术学院)
The Superposition of Diffusion Models Using the Itô Density Estimator
University of Toronto(多伦多大学);Vector Institute(向量研究所);University of Oxford(牛津大学);Mila - Quebec AI Institute(米拉-魁北克人工智能研究所);Université de Montréal(蒙特利尔大学)
Grounding Everything in Tokens for Multimodal Large Language Models
MoE Key Lab of Artificial Intelligence(人工智能混合专家模型关键实验室);AI Institute, Shanghai Jiao Tong University(上海交通大学人工智能研究院);Central Research Institute, Huawei(华为中央研究院)
Detecting Everything in the Open World: Towards Universal Object Detection
Tsinghua University(清华大学);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心(BNRist));The University of Hong Kong(香港大学);Meta AI;Massachusetts Institute of Technology(麻省理工学院)
Layer Selection in Feature-Based Losses Affects Image Quality and Microstructural Consistency in Deep Learning Super-Resolution of Brain Diffusion MRI
Institue for Applied Medical Informatics, University Medical Center Hamburg-Eppendorf(应用医学信息学研究所,汉堡大学医学中心);Institute of Computational Neuroscience, University Medical Center Hamburg-Eppendorf(计算神经科学研究所,汉堡大学医学中心);Center for Biomedical Artificial Intelligence (bAIome), University Medical Center Hamburg-Eppendorf(生物医学人工智能中心(bAIome),汉堡大学医学中心)