跨组主题表示学习
Inter-Battery Topic Representation Learning
摘要:
在本文中,我们提出了跨电池主题模型(IBTM)。我们的方法扩展了传统的主题模型,通过学习一个因式分解的潜在变量表示。结构化表示导致一种模型,该模型将传统上与判别方法(例如特征选择)相关联的益处与生成模型(例如原则性正则化和处理缺失数据的能力)的益处结合。通过将数据表示为对齐的观测对作为不同的视图来提供因子分解。这提供了用于选择表示的方法,该表示将存在于两个视图中的主题与对于单个视图唯一的主题分开建模。这种结构化的合并允许高效和鲁棒的推理,并提供紧凑和高效的表示。通过最大化对数似然的严格界限,以贝叶斯方式执行学习。首先,我们说明了该模型在合成数据集上的好处。然后,在两个不同的分类任务上,利用现成的卷积神经网络(CNN)功能,在单模态和多模态设置下对模型进行评估,这些功能可以生成具有极其紧凑表示的最先进结果。
英文摘要:
In this paper, we present the Inter-Battery Topic Model (IBTM). Our approach extends traditional topic models by learning a factorized latent variable representation. The structured representation leads to a model that marries benefits traditionally associated with a discriminative approach, such as feature selection, with those of a generative model, such as principled regularization and ability to handle missing data. The factorization is provided by representing data in terms of aligned pairs of observations as different views. This provides means for selecting a representation that separately models topics that exist in both views from the topics that are unique to a single view. This structured consolidation allows for efficient and robust inference and provides a compact and efficient representation. Learning is performed in a Bayesian fashion by maximizing a rigorous bound on the log-likelihood. Firstly, we illustrate the benefits of the model on a synthetic dataset,. The model is then evaluated in both uni- and multi-modality settings on two different classification tasks with off-the-shelf convolutional neural network (CNN) features which generate state-of-the-art results with extremely compact representations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。