arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1906.02576cs.LGcs.ITmath.ITstat.ML
收藏

类条件压缩和解纠缠:弥合神经网络和朴素贝叶斯分类器之间的差距

Class-Conditional Compression and Disentanglement: Bridging the Gap between Neural Networks and Naive Bayes Classifiers

Rana Ali Amjad, Bernhard C. Geiger

摘要:

在这篇报告正在进行的工作的草稿中,我们1)通过用类条件压缩替换压缩项来适应信息瓶颈泛函,2)使用与类条件解纠缠相关的变分界限来放松该泛函,3)将该泛函视为随机神经网络的训练目标,以及4)示出了潜在表示被学习,使得它们可以用于朴素贝叶斯分类器。我们继续建议沿着非线性信息瓶颈线进行一系列实验[Kolchinsky等人,2018年],深度变分信息瓶颈[Alemi等人,2017年],和信息辍学[Alberle和Soatto,2018年]。此外,我们提出了一个神经网络的解码器架构是一个参数化的朴素贝叶斯解码器。

英文摘要:

In this draft, which reports on work in progress, we 1) adapt the information bottleneck functional by replacing the compression term by class-conditional compression, 2) relax this functional using a variational bound related to class-conditional disentanglement, 3) consider this functional as a training objective for stochastic neural networks, and 4) show that the latent representations are learned such that they can be used in a naive Bayes classifier. We continue by suggesting a series of experiments along the lines of Nonlinear In-formation Bottleneck [Kolchinsky et al., 2018], Deep Variational Information Bottleneck [Alemi et al., 2017], and Information Dropout [Achille and Soatto, 2018]. We furthermore suggest a neural network where the decoder architecture is a parameterized naive Bayes decoder.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑