相关神经网络
Correlational Neural Networks
摘要:
公共表示学习(CRL),其中不同的描述(或视图)的数据被嵌入在一个共同的子空间,最近受到了很多关注。两种流行的范例是基于典型相关分析(CCA)的方法和基于自动编码器(AE)的方法。基于CCA的方法通过在投影到公共子空间时最大化视图的相关性来学习联合表示。基于AE的方法通过最小化重建两个视图的误差来学习公共表示。这些方法中的每一种都有其自身的优点和缺点。例如,虽然对于迁移学习的任务,基于CCA的方法优于基于AE的方法,但是它们不如后者可扩展。在这项工作中,我们提出了一种基于AE的方法称为相关神经网络(CorrNet),显式地最大化的视图之间的相关性时,投影到共同的子空间。通过一系列的实验,我们证明了所提出的CorrNet是优于上述方法的能力,学习相关的共同表示。此外,我们采用CorrNet的几个跨语言的任务,并表明使用CorrNet学习的表示比使用其他国家的最先进的方法学习的表现更好。
英文摘要:
Common Representation Learning (CRL), wherein different descriptions (or views) of the data are embedded in a common subspace, is receiving a lot of attention recently. Two popular paradigms here are Canonical Correlation Analysis (CCA) based approaches and Autoencoder (AE) based approaches. CCA based approaches learn a joint representation by maximizing correlation of the views when projected to the common subspace. AE based methods learn a common representation by minimizing the error of reconstructing the two views. Each of these approaches has its own advantages and disadvantages. For example, while CCA based approaches outperform AE based approaches for the task of transfer learning, they are not as scalable as the latter. In this work we propose an AE based approach called Correlational Neural Network (CorrNet), that explicitly maximizes correlation among the views when projected to the common subspace. Through a series of experiments, we demonstrate that the proposed CorrNet is better than the above mentioned approaches with respect to its ability to learn correlated common representations. Further, we employ CorrNet for several cross language tasks and show that the representations learned using CorrNet perform better than the ones learned using other state of the art approaches.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。