Dynamic magnetic resonance image reconstruction from incomplete k-space data has generated great research interest due to its capability to reduce scan time. Never-theless, the reconstruction problem is still challenging due to its ill-posed nature. Recently, diffusion models espe-cially score-based generative models have exhibited great potential in algorithm robustness and usage flexi-bility. Moreover, the unified framework through the variance exploding stochastic differential equation (VE-SDE) is proposed to enable new sampling methods and further extend the capabilities of score-based gener-ative models. Therefore, by taking advantage of the uni-fied framework, we proposed a k-space and image Du-al-Domain collaborative Universal Generative Model (DD-UGM) which combines the score-based prior with low-rank regularization penalty to reconstruct highly under-sampled measurements. More precisely, we extract prior components from both image and k-space domains via a universal generative model and adaptively handle these prior components for faster processing while maintaining good generation quality. Experimental comparisons demonstrated the noise reduction and detail preservation abilities of the proposed method. Much more than that, DD-UGM can reconstruct data of differ-ent frames by only training a single frame image, which reflects the flexibility of the proposed model.
Mining the manifolds of deep generative models for multiple data-consistent solutions of ill-posed tomographic imaging problems
Washington University in St. Louis(圣路易斯华盛顿大学);The University of Texas at Austin(德克萨斯大学奥斯汀分校);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
Applying Conditional Generative Adversarial Networks for Imaging Diagnosis
University of Houston(休斯顿大学);Johns Hopkins University(约翰斯·霍普金斯大学);Northeastern University(东北大学);University of Massachusetts Boston(马萨诸塞大学波士顿分校);Brandeis University(布兰迪斯大学)
Generative Range Imaging for Learning Scene Priors of 3D LiDAR Data
Kyushu University(九州大学);Jet Propulsion Laboratory, California Institute of Technology(加州理工学院喷气推进实验室)
3D LiDAR传感器对于自主移动机器人的强大视觉不可或缺。然而,部署基于LiDAR的感知算法通常会由于与训练环境的域差距而失败,例如不一致的角分辨率和丢失的属性。现有的研究通过学习域间映射来解决这个问题,而可转移性受到训练配置的限制,并且训练容易受到称为射线下降的特殊有损噪声的影响。为了解决这个问题,本文提出了一种适用于数据级域传输的激光雷达距离图像生成模型。由于激光雷达测量是基于逐点距离成像的,因此我们训练了一个基于隐式图像表示的生成对抗网络,并引入了可区分的光线降效应。我们证明了我们的模型的保真度和多样性相比,基于点和基于图像的国家的最先进的生成模型。我们还展示了上采样和恢复应用程序。此外,我们介绍了一个Sim2Real应用激光雷达语义分割。我们证明,我们的方法是有效的,作为一个现实的射线下降模拟器,并优于国家的最先进的方法。
Generative Adversarial Networks (GAN) Powered Fast Magnetic Resonance Imaging -- Mini Review, Comparison and Perspectives
Imperial College London(伦敦帝国理工学院);Royal Brompton Hospital(皇家布朗普顿医院);Yantai University(烟台大学);University of Cambridge(剑桥大学);Beijing Institute of Technology(北京理工大学)
SPI-GAN: Towards Single-Pixel Imaging through Generative Adversarial Network
University of Central Florida(中佛罗里达大学)
单像素成像是一种新颖的成像方案,由于其巨大的计算增益和潜在的低成本替代可见光谱以外的成像而受到欢迎。当限制来自空间光调制器的照明图案的数量时,传统的重建方法难以产生清晰的恢复。作为补救措施,已经提出了几种基于深度学习的解决方案,由于架构设置和损失函数,这些解决方案缺乏良好的泛化能力。在本文中,我们提出了一个基于生成对抗网络的单像素成像重建框架,简称为SPI-GAN。即使采样率降至5%,我们的方法也可以重建17.92 dB PSNR和0.487 SSIM的图像。这有利于更快的重建,使我们的方法适用于单像素视频。此外,我们的生成器的ResNet类架构导致有用的表示学习,使我们能够重建完全看不见的对象。实验结果表明,SPI-GAN实现了显着的性能增益,例如,近3dB的PSNR增益,在当前的最先进的方法。
Generative AI for Medical Imaging: extending the MONAI Framework
King’s College London(伦敦国王学院);National Institute of Mental Health(美国国家精神卫生研究所);The University of Edinburgh(爱丁堡大学);University of Basel(巴塞尔大学);Korea Advanced Institute of Science & Technology(韩国科学技术院);NVIDIA Corporation(英伟达公司);Stanford University(斯坦福大学);Icahn School of Medicine at Mount Sinai(西奈山伊坎医学院)
Reconstruct or Generate: Exploring the Spectrum of Generative Modeling for Cardiac MRI
School of Computation, Information and Technology(计算信息学院);Technical University of Munich(慕尼黑技术大学);Munich Center for Machine Learning(慕尼黑机器学习中心);School of Medicine, Klinikum Rechts der Isar(医学院,莱茵河右岸医院);Department of Quantitative Biomedicine(定量生物医学系);University of Zurich(苏黎世大学);Department of Computing(计算系);Imperial College London(伦敦帝国理工学院)
UPHDR-GAN: Generative Adversarial Network for High Dynamic Range Imaging with Unpaired Data
University of Electronic Science and Technology of China(电子科技大学);Megvii Technology(旷视科技);Tencent AI Lab(腾讯人工智能实验室);West China Hospital, Sichuan University(四川大学华西医院)
STAN-CT: Standardizing CT Image using Generative Adversarial Network
University of Kentucky(肯塔基大学);University of Texas at Dallas(德克萨斯大学达拉斯分校);UT Southwestern Medical Center(德克萨斯大学西南医学中心);The University of Texas Health Science Center at Houston(德克萨斯大学休斯顿健康科学中心)
Direct Energy-resolving CT Imaging via Energy-integrating CT images using a Unified Generative Adversarial Network
Southern Medical University(南方医科大学);Guangzhou Key Laboratory of Medical Radiation Imaging and Detection Technology(广州市医学辐射成像与检测技术重点实验室);South China University of Technology(华南理工大学)
ProstateGAN: Mitigating Data Bias via Prostate Diffusion Imaging Synthesis with Generative Adversarial Networks
University of Waterloo(滑铁卢大学);Waterloo Artificial Intelligence Institute(滑铁卢人工智能研究所);Lunenfeld-Tanenbaum Research Institute (LTRI)(卢嫩菲尔德-塔南鲍姆研究所(LTRI));Sinai Health System(西奈卫生系统);University of Toronto(多伦多大学)
WiFi-GEN: High-Resolution Indoor Imaging from WiFi Signals Using Generative AI
Pengcheng Laboratory(鹏城实验室);College of Big Data and Internet(大数据与互联网学院);Shenzhen Technology University(深圳技术大学);Department of Electrical Engineering(电子工程系);Indian Institute of Technology Delhi(印度理工学院德里分校);Department of Electronic and Computer Engineering(电子与计算机工程系);HKUST(香港科技大学);School of Computer Science and Technology(计算机科学与技术学院);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳))
Inner-ear Augmented Metal Artifact Reduction with Simulation-based 3D Generative Adversarial Networks
Université Côte d’Azur(蔚蓝海岸大学);Inria Sophia Antipolis Méditerranée(法国国家信息与自动化研究所索菲亚·安蒂波利斯-地中海研究中心);Head and Neck University Institute, Nice University Hospital(尼斯大学医院头颈大学研究所);Department of Radiology, Nice University Hospital(尼斯大学医院放射科);Oticon Medical(奥迪康医疗公司)
Edge-Enhanced Dual Discriminator Generative Adversarial Network for Fast MRI with Parallel Imaging Using Multi-view Information
Zhejiang Shuren University(浙江树人大学);Imperial College London(伦敦帝国理工学院);Nantong University(南通大学);Yantai University(烟台大学);Peking University School and Hospital of Stomatology(北京大学口腔医学院);Peking University(北京大学);TECNALIA;Basque Research and Technology Alliance(巴斯克研究与技术联盟);University of the Basque Country(巴斯克大学);The First Affiliated Hospital of Shenzhen University Health Science Center(深圳大学医学部第一附属医院);Houston Methodist Cancer Center(休斯顿卫理公会癌症中心);Houston Methodist Hospital(休斯顿卫理公会医院);Weill Cornell Medicine(威尔康奈尔医学院)
Physics-Inspired Generative Models in Medical Imaging: A Review
KTH Royal Institute of Technology(瑞典皇家理工学院);Karolinska University Hospital(卡罗林斯卡大学医院);University of Regensburg(雷根斯堡大学);Fraunhofer Institute for Digital Medicine MEVIS(弗劳恩霍夫数字医学MEVIS研究所);Rensselaer Polytechnic Institute(伦斯勒理工学院)
Generative Artificial Intelligence in Medical Imaging: Foundations, Progress, and Clinical Translation
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);University of Chinese Academy of Sciences(中国科学院大学);Macao Polytechnic University(澳门理工大学)
Multibranch Generative Models for Multichannel Imaging with an Application to PET/CT Synergistic Reconstruction
Univ. Brest, LaTIM, INSERM, UMR 1101(布雷斯特大学、LaTIM研究所、法国国家健康与医学研究院、UMR 1101联合研究单位);Nuclear Medicine Department, Poitiers University Hospital(普瓦捷大学医院核医学科)
Learning stochastic object models from medical imaging measurements by use of advanced ambient generative adversarial networks
University of California Santa Barbara(加州大学圣巴巴拉分校);Washington University in St. Louis(圣路易斯华盛顿大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Cancer Center at Illinois(伊利诺伊癌症中心)
GMENet: Generative Mixture of Experts Network for Multi-Center Glioma Diagnosis with Incomplete Imaging Sequences
School of Biomedical Engineering and Technology Innovation, Fudan University(复旦大学生物医学工程与技术创新学院);Institute of Science and Technology for Brain-Inspired Intelligence, Fudan University(复旦大学脑启发智能科学技术研究院);Intelligent Diagnosis and Treatment Laboratory for Brain Diseases, Joint Laboratory of Neurosurgery Department of Huashan Hospital and School of Information Science and Technology, Fudan University(脑病智能诊断与治疗实验室,华山医院神经外科部门联合实验室,复旦大学信息科学学院)