协作神经网络(CoNN):利用先验独立结构改进分类
Cooperative neural networks (CoNN): Exploiting prior independence structure for improved classification
摘要:
我们提出了一种新的方法,称为合作神经网络(CoNN),它使用一组合作训练的神经网络,以捕捉潜在的表示,利用事先给定的独立结构。该模型比基于指数族分布的传统图形模型更灵活,但比传统的深度网络或变分自编码器包含更多的域特定先验结构。该框架非常通用,可以用来利用任何图形模型的独立结构。我们说明的技术,我们可以转移到一个合作的神经网络,CoNN-sLDA的流行的潜在狄利克雷分配(LDA)模型的独立结构。CoNN-sLDA在监督文本分类任务上的实证评估表明,先验独立结构的理论优势可以在实践中实现-与最先进的技术相比,我们在具有挑战性的MultiSent数据集上的错误减少了23%。
英文摘要:
We propose a new approach, called cooperative neural networks (CoNN), which uses a set of cooperatively trained neural networks to capture latent representations that exploit prior given independence structure. The model is more flexible than traditional graphical models based on exponential family distributions, but incorporates more domain specific prior structure than traditional deep networks or variational autoencoders. The framework is very general and can be used to exploit the independence structure of any graphical model. We illustrate the technique by showing that we can transfer the independence structure of the popular Latent Dirichlet Allocation (LDA) model to a cooperative neural network, CoNN-sLDA. Empirical evaluation of CoNN-sLDA on supervised text classification tasks demonstrates that the theoretical advantages of prior independence structure can be realized in practice -we demonstrate a 23\% reduction in error on the challenging MultiSent data set compared to state-of-the-art.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。