arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.16002cs.CV
收藏

释放合成图像的潜力:一项关于组织病理学图像分类的研究

Unleashing the Potential of Synthetic Images: A Study on Histopathology Image Classification

TECNALIA(泰克纳利亚科技中心);Basque Research and Technology Alliance (BRTA)(巴斯克研究与技术联盟(BRTA));University of the Basque Country(巴斯克大学)

Leire Benito-Del-Valle, Aitor Alvarez-Gila, Itziar Eguskiza, Cristina L. Saratxaga

AI总结:

本研究针对组织病理学图像分类中数据集获取成本高的问题,探讨了不同生成模型与图像选择方法在生成合成图像块中的应用,发现扩散模型利于迁移学习、GAN利于数据增强,且transformer模型无需图像过滤,最终证明合成图像可有效提升下游分类任务性能。

摘要:

组织病理学图像分类对于准确识别和诊断各种疾病至关重要,但需要庞大且多样化的数据集。然而,由于需要专家标注和伦理限制,获取此类数据集通常成本高昂且耗时。为了解决这一问题,我们研究了不同生成模型和图像选择方法的适用性,以生成以类标签为条件的逼真合成组织病理学图像块。我们的研究结果强调了选择合适的生成模型类型和架构以提升性能的重要性。我们在PCam数据集上的实验表明,扩散模型适用于迁移学习,而GAN生成的样本更适合用于数据增强。此外,基于transformer的生成模型不需要图像过滤,相比之下,源自卷积神经网络(CNN)的模型则受益于基于真实性分数的筛选。因此,我们证明了合成图像能有效扩充现有数据集,最终提升下游组织病理学图像分类任务的性能。

英文摘要:

Histopathology image classification is crucial for the accurate identification and diagnosis of various diseases but requires large and diverse datasets. Obtaining such datasets, however, is often costly and time-consuming due to the need for expert annotations and ethical constraints. To address this, we examine the suitability of different generative models and image selection approaches to create realistic synthetic histopathology image patches conditioned on class labels. Our findings highlight the importance of selecting an appropriate generative model type and architecture to enhance performance. Our experiments over the PCam dataset show that diffusion models are effective for transfer learning, while GAN-generated samples are better suited for augmentation. Additionally, transformer-based generative models do not require image filtering, in contrast to those derived from Convolutional Neural Networks (CNNs), which benefit from realism score-based selection. Therefore, we show that synthetic images can effectively augment existing datasets, ultimately improving the performance of the downstream histopathology image classification task.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑