arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1909.09177cs.LGstat.ML
收藏

非线性多视图分析的可辨识性及神经网络辅助实现

Nonlinear Multiview Analysis: Identifiability and Neural Network-assisted Implementation

Oregon State University(俄勒冈州立大学)

Qi Lyu, Xiao Fu

摘要:

多视图分析的目的是从在不同域中获取的数据样本中提取共享的潜在成分,例如,图像、文本和音频。经典的多视图分析,例如,典型相关分析(CCA)通过在特定潜在域中匹配线性变换的视图来解决这个问题。最近,强大的非线性学习工具,如核方法和神经网络被用来增强经典的CCA。然而,与线性CCA的理论方面被清楚地理解不同,非线性CCA方法在很大程度上是直觉驱动的。特别是,目前还不清楚在什么条件下可以识别跨视图的共享潜在组件-而可识别性在许多应用中起着至关重要的作用。在这项工作中,我们重新审视非线性多视图分析和解决的理论和计算方面。我们的工作利用了一个有用的非线性模型,即后非线性模型,从非线性混合物分离文献。结合多视图数据,我们采取了非线性多视图混合学习的观点,这是线性CCA的经典生成模型的自然扩展。从那里,我们得到了一个学习标准。我们表明,最小化这一标准导致识别的潜在共享组件到一定的模糊性,在合理的条件下。我们的推导和公式化也为现有的基于深度神经网络的CCA公式化提供了新的见解和解释。在计算方面,我们提出了一个有效的算法,简单和可扩展的更新规则。一系列的仿真和实际数据实验证实了我们的理论分析。

英文摘要:

Multiview analysis aims at extracting shared latent components from data samples that are acquired in different domains, e.g., image, text, and audio. Classic multiview analysis, e.g., canonical correlation analysis (CCA), tackles this problem via matching the linearly transformed views in a certain latent domain. More recently, powerful nonlinear learning tools such as kernel methods and neural networks are utilized for enhancing the classic CCA. However, unlike linear CCA whose theoretical aspects are clearly understood, nonlinear CCA approaches are largely intuition-driven. In particular, it is unclear under what conditions the shared latent components across the views can be identified---while identifiability plays an essential role in many applications. In this work, we revisit nonlinear multiview analysis and address both the theoretical and computational aspects. Our work leverages a useful nonlinear model, namely, the post-nonlinear model, from the nonlinear mixture separation literature. Combining with multiview data, we take a nonlinear multiview mixture learning viewpoint, which is a natural extension of the classic generative models for linear CCA. From there, we derive a learning criterion. We show that minimizing this criterion leads to identification of the latent shared components up to certain ambiguities, under reasonable conditions. Our derivation and formulation also offer new insights and interpretations to existing deep neural network-based CCA formulations. On the computation side, we propose an effective algorithm with simple and scalable update rules. A series of simulations and real-data experiments corroborate our theoretical analysis.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑