arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2304.01992eess.IVcs.CV
收藏

面向结直肠组织分类的交叉调制少样本图像生成

Cross-modulated Few-shot Image Generation for Colorectal Tissue Classification

Technology Innovation Institute(技术创新研究院);MBZUAI(穆罕默德·本·扎耶德人工智能大学);Aalto University(阿尔托大学)

Amandeep Kumar, Ankan kumar Bhunia, Sanath Narayan, Hisham Cholakkal, Rao Muhammad Anwer, Jorma Laaksonen, Fahad Shahbaz Khan

AI总结:

本文提出少样本结直肠组织图像生成方法 XM-GAN,通过可控融合模块生成高质量多样图像,并验证其在病理学家评估和数据增强分类任务中的有效性。

摘要:

在这项工作中,我们提出了一种少样本结直肠组织图像生成方法,用于解决罕见癌组织病理训练数据稀缺的问题。我们的少样本生成方法名为 XM-GAN,以一张基础图像和一对参考组织图像作为输入,生成高质量且多样化的图像。在 XM-GAN 中,一种新颖的可控融合模块根据参考图像局部区域与基础图像局部区域的相似性,对参考图像的局部区域进行密集聚合,从而得到局部一致的特征。据我们所知,我们是首个研究结直肠组织图像少样本生成的工作。我们通过广泛的定性、定量以及基于专科医生(病理学家)的评估,对所提出的少样本结直肠组织图像生成方法进行了评价。具体而言,在基于专科医生的评估中,病理学家区分 XM-GAN 生成的组织图像与真实图像的准确率仅为 55%。此外,我们将这些生成图像用作数据增强,以解决少样本组织图像分类任务,在平均准确率上相比原始少样本分类器获得了 4.4% 的提升。代码:\url{https://github.com/VIROBO-15/XM-GAN}

英文摘要:

In this work, we propose a few-shot colorectal tissue image generation method for addressing the scarcity of histopathological training data for rare cancer tissues. Our few-shot generation method, named XM-GAN, takes one base and a pair of reference tissue images as input and generates high-quality yet diverse images. Within our XM-GAN, a novel controllable fusion block densely aggregates local regions of reference images based on their similarity to those in the base image, resulting in locally consistent features. To the best of our knowledge, we are the first to investigate few-shot generation in colorectal tissue images. We evaluate our few-shot colorectral tissue image generation by performing extensive qualitative, quantitative and subject specialist (pathologist) based evaluations. Specifically, in specialist-based evaluation, pathologists could differentiate between our XM-GAN generated tissue images and real images only 55% time. Moreover, we utilize these generated images as data augmentation to address the few-shot tissue image classification task, achieving a gain of 4.4% in terms of mean accuracy over the vanilla few-shot classifier. Code: \url{https://github.com/VIROBO-15/XM-GAN}

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑