arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.00577eess.IVcs.CV
收藏

基于微调生成对抗网络的医学图像超分辨率模型

Fine-tuned Generative Adversarial Network-based Model for Medical Image Super-Resolution

Ferdowsi University of Mashhad(马什哈德菲尔多西大学)

Alireza Aghelan, Modjtaba Rouhani

AI总结:

本文通过迁移学习微调预训练Real-ESRGAN模型,利用高阶退化模型提升胸部X光片和视网膜图像的超分辨率感知质量。

摘要:

在医学图像分析领域,对高分辨率(HR)图像存在大量需求,以提高诊断准确性。然而,获取HR医学图像是一项具有挑战性的任务,因为它需要先进的仪器和大量的时间。基于深度学习的超分辨率方法可以帮助提高低分辨率(LR)医学图像的分辨率和感知质量。近年来,基于生成对抗网络(GAN)的方法在基于深度学习的超分辨率方法中表现出卓越的性能。真实增强超分辨率生成对抗网络(Real-ESRGAN)是一种用于从真实世界LR图像中恢复HR图像的实用模型。在我们提出的方法中,我们使用迁移学习技术,并利用医学图像数据集对预训练的Real-ESRGAN模型进行微调。该技术有助于提高模型的性能。我们采用Real-ESRGAN的高阶退化模型,该模型能更好地模拟真实世界的图像退化。这种适配使得能够生成更逼真的退化医学图像,从而提升性能。本文的重点是提高胸部X光片和视网膜图像的分辨率和感知质量。我们使用结核病胸部X光(深圳)数据集和视网膜图像STARE数据集对模型进行微调。与Real-ESRGAN模型相比,所提出的模型实现了更优越的感知质量,有效保留了精细细节,并生成了具有更逼真纹理的图像。

英文摘要:

In the field of medical image analysis, there is a substantial need for high-resolution (HR) images to improve diagnostic accuracy. However, it is a challenging task to obtain HR medical images, as it requires advanced instruments and significant time. Deep learning-based super-resolution methods can help to improve the resolution and perceptual quality of low-resolution (LR) medical images. Recently, Generative Adversarial Network (GAN) based methods have shown remarkable performance among deep learning-based super-resolution methods. Real-Enhanced Super-Resolution Generative Adversarial Network (Real-ESRGAN) is a practical model for recovering HR images from real-world LR images. In our proposed approach, we use transfer learning technique and fine-tune the pre-trained Real-ESRGAN model using medical image datasets. This technique helps in improving the performance of the model. We employ the high-order degradation model of the Real-ESRGAN which better simulates real-world image degradations. This adaptation allows for generating more realistic degraded medical images, resulting in improved performance. The focus of this paper is on enhancing the resolution and perceptual quality of chest X-ray and retinal images. We use the Tuberculosis chest X-ray (Shenzhen) dataset and the STARE dataset of retinal images for fine-tuning the model. The proposed model achieves superior perceptual quality compared to the Real-ESRGAN model, effectively preserving fine details and generating images with more realistic textures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑