Computational neuroimaging involves analyzing brain images or signals to provide mechanistic insights and predictive tools for human cognition and behavior. While diffusion models have shown stability and high-quality generation in natural images, there is increasing interest in adapting them to analyze brain data for various neurological tasks such as data enhancement, disease diagnosis and brain decoding. This survey provides an overview of recent efforts to integrate diffusion models into computational neuroimaging. We begin by introducing the common neuroimaging data modalities, follow with the diffusion formulations and conditioning mechanisms. Then we discuss how the variations of the denoising starting point, condition input and generation target of diffusion models are developed and enhance specific neuroimaging tasks. For a comprehensive overview of the ongoing research, we provide a publicly available repository at https://github.com/JoeZhao527/dm4neuro.
Wavelet-Fusion Diffusion Model for Multimodal Brain MRI Synthesis with Modality and Metadata Conditioning
Department of Psychology & Neuroscience, Auckland University of Technology(心理学与神经科学系,奥克兰技术大学);Department of Psychiatry, University of Melbourne(精神病学系,墨尔本大学)
Characterization Multimodal Connectivity of Brain Network by Hypergraph GAN for Alzheimer's Disease Analysis
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);Shenzhen University(深圳大学);Renmin University of China(中国人民大学);Harbin Engineering University(哈尔滨工程大学)
A Comprehensive Survey on Visual Concept Mining in Text-to-image Diffusion Models
School of Computer Science, Nanjing University of Information Science and Technology(南京信息工程大学计算机学院);School of Computer Science, Nanjing University of Science and Technology(南京理工大学计算机学院)
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Southern University of Science and Technology(南方科技大学);NVIDIA(英伟达公司);Adobe Inc(奥多比公司);Apple Inc(苹果公司)
White Matter Geometry-Guided Score-Based Diffusion Model for Tissue Microstructure Imputation in Tractography Imaging
Harvard Medical School(哈佛医学院);School of Computer Science, The University of Sydney(悉尼大学计算机学院);Brigham and Women’s Hospital(布里格姆妇女医院);University of Electronic Science and Technology of China(电子科技大学)
Phy-Diff: Physics-guided Hourglass Diffusion Model for Diffusion MRI Synthesis
School of Science and Engineering, University of Dundee(邓迪大学科学与工程学院);University of Cambridge(剑桥大学);University of Bath(巴斯大学);School of Medicine, University of Dundee(邓迪大学医学院)
A Survey on Personalized Content Synthesis with Diffusion Models
Department of Computing(计算系);The Hong Kong Polytechnic University(香港理工大学);Center for Artificial Intelligence and Robotics(人工智能与机器人中心);Hong Kong Institute of Science & Innovation(香港科学创新研究院);Chinese Academy of Sciences(中国科学院);State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Chinese Academy of Sciences Institute of Automation(中国科学院自动化研究所);School of Artificial Intelligence(人工智能学院);University of Chinese Academy of Sciences(中国科学院大学)
TauGenNet: Plasma-Driven Tau PET Image Synthesis via Text-Guided 3D Diffusion Models
J. Crayton Pruitt Family Department of Biomedical Engineering, University of Florida(J. Crayton Pruitt家族生物医学工程系,佛罗里达大学);Department of Radiology & Biomedical Imaging, Yale University(放射学与生物医学成像系,耶鲁大学);Department of Medicine, University of Florida(医学系,佛罗里达大学);Banner Alzheimer’s Institute(Banner阿尔茨海默症研究所)
Preference Alignment on Diffusion Model: A Comprehensive Survey for Image Generation and Editing
University of Liverpool(利物浦大学);Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);University of Edinburgh(爱丁堡大学);University of Bristol(布里斯托大学);University of Exeter(埃克塞特大学)
Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models
School of Cyber Science and Engineering, Southeast University(电子科技大学信息与通信工程学院);Data61, CSIRO(数据61,CSIRO);Zhejiang Laboratory(浙江省实验室);school of Computer Science and Artificial Intelligence, Wuhan University of Technology(计算机科学与人工智能学院,武汉理工大学);College of Computing and Data Science, Nanyang Technological University(计算科学与数据科学学院,南洋理工大学)
Diffusion Models: A Comprehensive Survey of Methods and Applications
Peking University(北京大学);OpenAI;University of California, Los Angeles(加州大学洛杉矶分校);Carnegie Mellon University(卡内基梅隆大学);University of California at Merced(加州大学默塞德分校)
Diffusion Models for Medical Image Analysis: A Comprehensive Survey
Iran University of Science and Technology(伊朗科技大学);Shahid Beheshti University(沙希德·贝赫什提大学);RWTH Aachen University(亚琛工业大学);Microsoft(微软);University of British Columbia(不列颠哥伦比亚大学);University of Regensburg(雷根斯堡大学)
Tsinghua University(清华大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Duke University(杜克大学);Shanghai Jiao Tong University(上海交通大学);Harbin Institute of Technology(哈尔滨工业大学);Tianyijiaotong Technology Ltd.(天宜交通科技有限公司)
A Survey on Deep Learning for Neuroimaging-based Brain Disorder Analysis
College of Computer Science and Technology, Nanjing Forestry University(南京林业大学计算机科学与技术学院);College of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics(南京航空航天大学计算机科学与技术学院);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校)
Fudan University(复旦大学);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心);School of Computer Science(计算机学院);Microsoft Research Asia(微软亚洲研究院);Noah’s Ark Lab(诺亚方舟实验室)
A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Stanford University(斯坦福大学);Georgia Institute of Technology(佐治亚理工学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
Conditional Image Synthesis with Diffusion Models: A Survey
State Key Laboratory of Blockchain and Data Security, Zhejiang University College of Computer Science, Zhejiang University(区块链与数据安全国家重点实验室,浙江大学计算机科学学院,浙江大学);University at Buffalo, State University of New York(纽约州立大学布法罗分校);College of Computer Science, Zhejiang University of Technology(浙江工业大学计算机科学学院);State Key Laboratory of Blockchain and Data Security, Zhejiang University Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(区块链与数据安全国家重点实验室,浙江大学杭州高科技区(滨江)区块链与数据安全研究院);College of Computer Science, Zhejiang University(浙江大学计算机科学学院)
School of Artificial Intelligence, Nanjing University of Information Science and Technology(南京信息工程大学人工智能学院);Tsinghua University(清华大学);Institute of Cyberspace Security and College of Information Engineering, Zhejiang University of Technology(浙江工业大学网络空间安全研究院与信息工程学院);University of Edinburgh(爱丁堡大学);Beijing Institute of Technology(北京理工大学);College of Computer Science and Engineering, Dalian Minzu University(大连民族大学计算机科学与工程学院);Durham University(杜伦大学);Northumbria University(诺森比亚大学)
Lesion-DDPM: Lesion-Enhanced 3D Diffusion for MS MRI Synthesis
University of Texas at Arlington(德克萨斯大学阿灵顿分校);University of Texas at San Antonio(德克萨斯大学圣安东尼奥分校);University of Texas at Dallas(德克萨斯大学达拉斯分校);National Taiwan University Hospital(国立台湾大学医院);National University of Mongolia(蒙古国立大学);University of Texas at Austin(德克萨斯大学奥斯汀分校)
ConnectomeDiffuser: Generative AI Enables Brain Network Construction from Diffusion Tensor Imaging
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究所);Department of Computer and Information Science, University of Macau(澳门大学计算机与信息科学系);Department of Mathematics, Hong Kong Baptist University(香港 Baptist大学数学系)
Looking deeper into interpretable deep learning in neuroimaging: a comprehensive survey
Georgia State University(佐治亚州立大学);Georgia Institute of Technology(佐治亚理工学院);Emory University(埃默里大学);Tri-institutional Center for Translational Research in Neuroimaging and Data Science(三机构神经影像与数据科学转化研究中心)
Replication in Visual Diffusion Models: A Survey and Outlook
Australian Artificial Intelligence Institute, University of Technology Sydney(澳大利亚人工智能研究所,悉尼技术大学);Baidu Inc.(百度公司);College of Computer Science and Technology, Zhejiang University(计算机科学与技术学院,浙江大学)