arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.12964cs.LGcs.AIcs.CVstat.ML
收藏

连续不定概率神经网络

Continuous Indeterminate Probability Neural Network

United Automotive Electronic Systems Co., Ltd.(联合汽车电子有限公司)

Tao Yang

摘要:

本文介绍了一种通用的模型CIPNN -连续不定概率神经网络,该模型是基于离散隐随机变量的IPNN模型。目前,连续型潜变量的后验被认为是一个棘手的问题,而IPNN提出的新理论可以解决这个问题。我们的贡献是四方面的。首先,我们推导了连续型潜随机变量后验计算的解析解,并提出了一个通用分类模型(CIPNN)。其次,我们提出了一个通用的自动编码器CIPAE -连续不确定概率自动编码器,解码器部分不是一个神经网络,并首次使用了一个完全的概率推理模型。第三,我们提出了一种新的方法来可视化潜随机变量,我们使用N维潜变量中的一个作为解码器来重建输入图像,即使对于分类任务也可以工作,这样,我们可以看到每个潜变量都学到了什么。第四,IPNN表现出了很强的分类能力,CIPNN将这种分类能力推向了无限。理论上的优势体现在实验结果中。

英文摘要:

This paper introduces a general model called CIPNN - Continuous Indeterminate Probability Neural Network, and this model is based on IPNN, which is used for discrete latent random variables. Currently, posterior of continuous latent variables is regarded as intractable, with the new theory proposed by IPNN this problem can be solved. Our contributions are Four-fold. First, we derive the analytical solution of the posterior calculation of continuous latent random variables and propose a general classification model (CIPNN). Second, we propose a general auto-encoder called CIPAE - Continuous Indeterminate Probability Auto-Encoder, the decoder part is not a neural network and uses a fully probabilistic inference model for the first time. Third, we propose a new method to visualize the latent random variables, we use one of N dimensional latent variables as a decoder to reconstruct the input image, which can work even for classification tasks, in this way, we can see what each latent variable has learned. Fourth, IPNN has shown great classification capability, CIPNN has pushed this classification capability to infinity. Theoretical advantages are reflected in experimental results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑