arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2602.02171cs.CV

由双阶段生成对抗网络驱动的肺结节图像合成

Lung Nodule Image Synthesis Driven by Two-Stage Generative Adversarial Networks

Wuyi University(五邑大学)

Lu Cao, Xiquan He, Junying Zeng, Chaoyun Mai, Min Luo

AI总结:

本文提出双阶段生成对抗网络TSGAN,通过解耦肺结节形态结构与纹理特征,提升合成数据多样性及检测模型性能。

摘要:

肺结节CT数据样本量有限且多样性不足,严重限制了检测模型的性能和泛化能力。现有方法生成的图像多样性不足且可控性差,存在纹理特征单调和解剖结构扭曲等问题。因此,我们提出了一种双阶段生成对抗网络(TSGAN),通过解耦肺结节的形态结构和纹理特征,以提高合成数据的多样性和空间可控性。第一阶段使用StyleGAN生成语义分割掩码图像,编码肺结节和组织背景以控制肺结节图像的解剖结构;第二阶段使用DL-Pix2Pix模型将掩码图转换为CT图像,利用局部重要性注意力捕捉局部特征,同时利用动态权重多头窗口注意力增强肺结节纹理和背景的建模能力。与原始数据集相比,在LUNA16数据集上,准确率提高了4.6%,mAP提高了4%。实验结果表明,TSGAN可以提高合成图像的质量和检测模型的性能。

英文摘要:

The limited sample size and insufficient diversity of lung nodule CT datasets severely restrict the performance and generalization ability of detection models. Existing methods generate images with insufficient diversity and controllability, suffering from issues such as monotonous texture features and distorted anatomical structures. Therefore, we propose a two-stage generative adversarial network (TSGAN) to enhance the diversity and spatial controllability of synthetic data by decoupling the morphological structure and texture features of lung nodules. In the first stage, StyleGAN is used to generate semantic segmentation mask images, encoding lung nodules and tissue backgrounds to control the anatomical structure of lung nodule images; The second stage uses the DL-Pix2Pix model to translate the mask map into CT images, employing local importance attention to capture local features, while utilizing dynamic weight multi-head window attention to enhance the modeling capability of lung nodule texture and background. Compared to the original dataset, the accuracy improved by 4.6% and mAP by 4% on the LUNA16 dataset. Experimental results demonstrate that TSGAN can enhance the quality of synthetic images and the performance of detection models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑