arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2008.01967cs.LGcs.NEstat.ML
收藏

退火遗传GAN在少数过采样中的应用

Annealing Genetic GAN for Minority Oversampling

University of Edinburgh(爱丁堡大学);Imperial College London(伦敦帝国学院)

Jingyu Hao, Chengjia Wang, Heye Zhang, Guang Yang

摘要:

准确把握少数民族阶层的分布是克服阶层失衡问题的关键。生成对抗网络(GANs)已经显示出一些解决类不平衡问题的潜力,因为它们能够在给定充足的训练数据样本的情况下再现数据分布。然而,一个或多个类的稀缺样本仍然对GANs学习少数类的准确分布构成了巨大的挑战。在这项工作中,我们提出了一个退火遗传GAN(AGGAN)方法,其目的是再现的分布最接近的少数类使用有限的数据样本。我们的AGGAN将GANs的训练更新为一个包含模拟退火机制的进化过程。特别是,生成器使用不同的训练策略来生成多个后代并保留最好的。然后,我们在模拟退火中使用Metropolis准则来决定我们是否应该更新生成器的最佳后代。由于Metropolis准则允许有一定的机会接受更差的解决方案,因此它使我们的AGGAN能够远离局部最优。根据理论分析和多个不平衡图像数据集上的实验研究,我们证明了所提出的训练策略可以使我们的AGGAN从稀缺的样本中再现少数类的分布,并为类不平衡问题提供了一个有效和鲁棒的解决方案。

英文摘要:

The key to overcome class imbalance problems is to capture the distribution of minority class accurately. Generative Adversarial Networks (GANs) have shown some potentials to tackle class imbalance problems due to their capability of reproducing data distributions given ample training data samples. However, the scarce samples of one or more classes still pose a great challenge for GANs to learn accurate distributions for the minority classes. In this work, we propose an Annealing Genetic GAN (AGGAN) method, which aims to reproduce the distributions closest to the ones of the minority classes using only limited data samples. Our AGGAN renovates the training of GANs as an evolutionary process that incorporates the mechanism of simulated annealing. In particular, the generator uses different training strategies to generate multiple offspring and retain the best. Then, we use the Metropolis criterion in the simulated annealing to decide whether we should update the best offspring for the generator. As the Metropolis criterion allows a certain chance to accept the worse solutions, it enables our AGGAN steering away from the local optimum. According to both theoretical analysis and experimental studies on multiple imbalanced image datasets, we prove that the proposed training strategy can enable our AGGAN to reproduce the distributions of minority classes from scarce samples and provide an effective and robust solution for the class imbalance problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑