arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.09950cs.LGstat.ML
收藏

分布支持边界生成器(BDSG):边界上的样本生成

Boundary of Distribution Support Generator (BDSG): Sample Generation on the Boundary

The University of Edinburgh(爱丁堡大学)

Nikolaos Dionelis, Mehrdad Yaghoobi, Sotirios A. Tsaftaris

摘要:

生成模型,如生成对抗网络(GANs),已被用于无监督的异常检测。虽然性能不断提高,存在几个限制,特别是由于在捕捉多模态支持的困难和接近的尾部,即分布的支持的边界的基础分布的能力。本文提出了一种方法,试图减轻这些缺点。本文提出了一种基于可逆残差网络的模型--分布支持边界生成器(BDSG)。GANs通常不保证概率分布的存在,在这里,我们使用最近开发的可逆残差网络(IResNet)和残差流(ResFlow)进行密度估计。这些模型尚未用于异常检测。我们利用IResNet和ResFlow进行分布外(OoD)样本检测,并使用复合损失函数在边界上生成样本,该函数迫使样本位于边界上。BDSG解决了非凸支持、不相交分量和多峰分布。合成数据和多峰分布数据(如MNIST和CIFAR-10)的结果表明,与文献中的方法相比,具有竞争力的性能。

英文摘要:

Generative models, such as Generative Adversarial Networks (GANs), have been used for unsupervised anomaly detection. While performance keeps improving, several limitations exist particularly attributed to difficulties at capturing multimodal supports and to the ability to approximate the underlying distribution closer to the tails, i.e. the boundary of the distribution's support. This paper proposes an approach that attempts to alleviate such shortcomings. We propose an invertible-residual-network-based model, the Boundary of Distribution Support Generator (BDSG). GANs generally do not guarantee the existence of a probability distribution and here, we use the recently developed Invertible Residual Network (IResNet) and Residual Flow (ResFlow), for density estimation. These models have not yet been used for anomaly detection. We leverage IResNet and ResFlow for Out-of-Distribution (OoD) sample detection and for sample generation on the boundary using a compound loss function that forces the samples to lie on the boundary. The BDSG addresses non-convex support, disjoint components, and multimodal distributions. Results on synthetic data and data from multimodal distributions, such as MNIST and CIFAR-10, demonstrate competitive performance compared to methods from the literature.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑