Recently, there has been significant progress in the development of large models. Following the success of ChatGPT, numerous language models have been introduced, demonstrating remarkable performance. Similar advancements have also been observed in image generation models, such as Google's Imagen model, OpenAI's DALL-E 2, and stable diffusion models, which have exhibited impressive capabilities in generating images. However, similar to large language models, these models still encounter unresolved challenges. Fortunately, the availability of open-source stable diffusion models and their underlying mathematical principles has enabled the academic community to extensively analyze the performance of current image generation models and make improvements based on this stable diffusion framework. This survey aims to examine the existing issues and the current solutions pertaining to image generation models.
Tsinghua University(清华大学);Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Duke University(杜克大学);Shanghai Jiao Tong University(上海交通大学);Harbin Institute of Technology(哈尔滨工业大学);Tianyijiaotong Technology Ltd.(天宜交通科技有限公司)
Diffusion Models: A Comprehensive Survey of Methods and Applications
Peking University(北京大学);OpenAI;University of California, Los Angeles(加州大学洛杉矶分校);Carnegie Mellon University(卡内基梅隆大学);University of California at Merced(加州大学默塞德分校)
Fudan University(复旦大学);Shanghai Collaborative Innovation Center of Intelligent Visual Computing(上海智能视觉计算协同创新中心);School of Computer Science(计算机学院);Microsoft Research Asia(微软亚洲研究院);Noah’s Ark Lab(诺亚方舟实验室)
Conditional Image Synthesis with Diffusion Models: A Survey
State Key Laboratory of Blockchain and Data Security, Zhejiang University College of Computer Science, Zhejiang University(区块链与数据安全国家重点实验室,浙江大学计算机科学学院,浙江大学);University at Buffalo, State University of New York(纽约州立大学布法罗分校);College of Computer Science, Zhejiang University of Technology(浙江工业大学计算机科学学院);State Key Laboratory of Blockchain and Data Security, Zhejiang University Hangzhou High-Tech Zone (Binjiang) Institute of Blockchain and Data Security(区块链与数据安全国家重点实验室,浙江大学杭州高科技区(滨江)区块链与数据安全研究院);College of Computer Science, Zhejiang University(浙江大学计算机科学学院)
School of Artificial Intelligence, Nanjing University of Information Science and Technology(南京信息工程大学人工智能学院);Tsinghua University(清华大学);Institute of Cyberspace Security and College of Information Engineering, Zhejiang University of Technology(浙江工业大学网络空间安全研究院与信息工程学院);University of Edinburgh(爱丁堡大学);Beijing Institute of Technology(北京理工大学);College of Computer Science and Engineering, Dalian Minzu University(大连民族大学计算机科学与工程学院);Durham University(杜伦大学);Northumbria University(诺森比亚大学)
Preference Alignment on Diffusion Model: A Comprehensive Survey for Image Generation and Editing
University of Liverpool(利物浦大学);Institute of Software Chinese Academy of Sciences(中国科学院软件研究所);University of Edinburgh(爱丁堡大学);University of Bristol(布里斯托大学);University of Exeter(埃克塞特大学)
Responsible Diffusion: A Comprehensive Survey on Safety, Ethics, and Trust in Diffusion Models
School of Cyber Science and Engineering, Southeast University(电子科技大学信息与通信工程学院);Data61, CSIRO(数据61,CSIRO);Zhejiang Laboratory(浙江省实验室);school of Computer Science and Artificial Intelligence, Wuhan University of Technology(计算机科学与人工智能学院,武汉理工大学);College of Computing and Data Science, Nanyang Technological University(计算科学与数据科学学院,南洋理工大学)
Replication in Visual Diffusion Models: A Survey and Outlook
Australian Artificial Intelligence Institute, University of Technology Sydney(澳大利亚人工智能研究所,悉尼技术大学);Baidu Inc.(百度公司);College of Computer Science and Technology, Zhejiang University(计算机科学与技术学院,浙江大学)
Diffusion Models for Medical Image Analysis: A Comprehensive Survey
Iran University of Science and Technology(伊朗科技大学);Shahid Beheshti University(沙希德·贝赫什提大学);RWTH Aachen University(亚琛工业大学);Microsoft(微软);University of British Columbia(不列颠哥伦比亚大学);University of Regensburg(雷根斯堡大学)
A Comprehensive Survey on Visual Concept Mining in Text-to-image Diffusion Models
School of Computer Science, Nanjing University of Information Science and Technology(南京信息工程大学计算机学院);School of Computer Science, Nanjing University of Science and Technology(南京理工大学计算机学院)
Diffusion Models, Image Super-Resolution And Everything: A Survey
German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心(DFKI));Rheinland-Pfälzische Technische Universität Kaiserslautern-Landau(莱茵兰-普法尔茨州 Kaiserslautern-Landau 工业大学)
Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Southern University of Science and Technology(南方科技大学);NVIDIA(英伟达公司);Adobe Inc(奥多比公司);Apple Inc(苹果公司)
A Survey on Adversarial Attacks and Defenses for Diffusion Models Across Multiple Modalities
University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Stanford University(斯坦福大学);Georgia Institute of Technology(佐治亚理工学院);The University of Texas at Austin(德克萨斯大学奥斯汀分校)
A Survey on Personalized Content Synthesis with Diffusion Models
Department of Computing(计算系);The Hong Kong Polytechnic University(香港理工大学);Center for Artificial Intelligence and Robotics(人工智能与机器人中心);Hong Kong Institute of Science & Innovation(香港科学创新研究院);Chinese Academy of Sciences(中国科学院);State Key Laboratory of Multimodal Artificial Intelligence Systems(多模态人工智能系统国家重点实验室);Chinese Academy of Sciences Institute of Automation(中国科学院自动化研究所);School of Artificial Intelligence(人工智能学院);University of Chinese Academy of Sciences(中国科学院大学)
Image Inversion: A Survey from GANs to Diffusion and Beyond
College of Control Science and Engineering, Zhejiang University(浙江大学控制科学与工程学院);YouTu Lab, Tencent(腾讯优图实验室);College of Computer and Information Science, Southwest University(西南大学计算机与信息科学学院);Department of Computer Science & Engineering, Shanghai Jiao Tong University(上海交通大学计算机科学与工程系);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Anomaly Detection and Generation with Diffusion Models: A Survey
Department of Computer Science, The University of Toronto(多伦多大学计算机科学系);College of Future Information Technology, Fudan University(复旦大学未来信息技术学院);Division of Natural and Applied Sciences, Duke Kunshan University(杜克昆山大学自然与应用科学系);Department of Electrical and Computer Engineering, The University of British Columbia(不列颠哥伦比亚大学电气与计算机工程系);School of Computer Science, University of Sydney(悉尼大学计算机科学学院);Department of Chemical Engineering, Massachusetts Institute of Technology(麻省理工学院化学工程系);School of Future Science and Engineering, Soochow University(苏州大学未来科学与工程学院);School of Computer Science and Artificial Intelligence, Zhengzhou University(郑州大学计算机科学与人工智能学院);Department of Computer Science, St. Francis Xavier University(圣弗朗西斯科大学计算机科学系);Department of Computer Science and Engineering, State University of New York at Buffalo(纽约州立大学布法罗分校计算机科学与工程系)
Deconstructing The Ethics of Large Language Models from Long-standing Issues to New-emerging Dilemmas: A Survey
Rutgers University(罗格斯大学);University of Technology Sydney(悉尼科技大学);Ohio State University(俄亥俄州立大学);University of Notre Dame(圣母大学);Washington University in St. Louis(圣路易斯华盛顿大学);University of Chicago(芝加哥大学);University of Illinois Chicago(伊利诺伊大学芝加哥分校);Georgia Institute of Technology(佐治亚理工学院);University of California, Los Angeles(加利福尼亚大学洛杉矶分校);Carnegie Mellon University(卡内基梅隆大学);Stony Brook University(石溪大学);University of Connecticut(康涅狄格大学);University of Illinois Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Boise State University(博伊西州立大学)
Diffusion Models for Image Restoration and Enhancement: A Comprehensive Survey
University of Science and Technology of China(科学技术大学);National University of Singapore(国立新加坡大学);Eastern Institute for Advanced Study(东部高级研究机构);Microsoft Research Asia(微软亚洲研究院)
A Survey of Emerging Applications of Diffusion Probabilistic Models in MRI
School of Biomedical Engineering(生物医学工程学院);ShanghaiTech University(上海科技大学);King’s College London(伦敦国王学院);St. Thomas’ hospital(圣托马斯医院);Institute of High Performance Computing(高性能计算研究所)