arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.14082cs.LGcs.AI
收藏

使用完整编码器学习稳定表示

Learning Stable Representations with Full Encoder

Beijing University of Chemical Technology(北京化工大学)

Zhouzheng Li, Kun Feng

摘要:

虽然beta-VAE家族的目标是找到解开的表示并获得人类可解释的生成因子,就像ICA(来自线性域)所做的那样,但我们提出了Full Encoder,这是一种新的统一自动编码器框架,与非线性域中的PCA相对应。其思想是先用一个隐变量训练一个自编码器,然后逐步引入更多的隐变量来改进重构结果。Full Encoder也是一种潜在变量预测模型,所获取的潜在变量是稳定和鲁棒的,因为无论网络初始状态如何,它们总是学习相同的表示。全编码器可用于确定简单非线性系统中的自由度,并可用于数据压缩或异常检测。Full Encoder还可以与beta-VAE框架相结合,以整理生成因素的重要性,为非线性系统分析提供更多见解。这些品质将使FE分析现实生活中的工业非线性系统有用。为了验证,我们创建了一个带有定制非线性系统的玩具数据集来测试它,并将其属性与VAE和beta-VAE的属性进行比较。

英文摘要:

While the beta-VAE family is aiming to find disentangled representations and acquire human-interpretable generative factors, like what an ICA (from the linear domain) does, we propose Full Encoder, a novel unified autoencoder framework as a correspondence to PCA in the non-linear domain. The idea is to train an autoencoder with one latent variable first, then involve more latent variables progressively to refine the reconstruction results. The Full Encoder is also a latent variable predictive model that the latent variables acquired are stable and robust, as they always learn the same representation regardless of the network initial states. Full Encoder can be used to determine the degrees of freedom in a simple non-linear system and can be useful for data compression or anomaly detection. Full Encoder can also be combined with the beta-VAE framework to sort out the importance of the generative factors, providing more insights for non-linear system analysis. These qualities will make FE useful for analyzing real-life industrial non-linear systems. To validate, we created a toy dataset with a custom-made non-linear system to test it and compare its properties to those of VAE and beta-VAE's.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑