arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1707.09316cs.CV
收藏

稀疏深度非负矩阵分解

Sparse Deep Nonnegative Matrix Factorization

University of Chinese Academy of Sciences(中国科学院大学)

Zhenxing Guo, Shihua Zhang

摘要:

非负矩阵分解是通过单层数据表示学习实现降维和模式识别的有力技术。然而,深度学习凭借其精心设计的分层结构,能够将隐藏特征组合起来,形成更具代表性的特征,用于模式识别。在本文中,我们提出了稀疏深度非负矩阵分解模型来分析复杂数据,以获得更准确的分类和更好的特征解释。这种模型被设计为通过对某些因子的列施加$L_1$ -范数惩罚来学习局部特征或为不同类别中的样本生成更具鉴别力的表示。通过将一层模型扩展为具有稀疏性的多层模型,利用模型的非负性,提供了一种层次化的方法来分析大数据,并直观地提取隐藏的特征。采用Nesterov加速梯度算法加速计算过程,使$k$步迭代后的收敛速度达到$O(1/k^2)$。我们还分析了我们的框架的计算复杂度,以证明他们的效率。为了提高处理线性不可分数据的性能,我们还考虑将流行的非线性函数纳入该框架,并探索其性能。我们将我们的模型应用于两个基准图像数据集,证明我们的模型可以实现有竞争力或更好的分类性能,并与典型的NMF和竞争多层模型相比,产生直观的解释。

英文摘要:

Nonnegative matrix factorization is a powerful technique to realize dimension reduction and pattern recognition through single-layer data representation learning. Deep learning, however, with its carefully designed hierarchical structure, is able to combine hidden features to form more representative features for pattern recognition. In this paper, we proposed sparse deep nonnegative matrix factorization models to analyze complex data for more accurate classification and better feature interpretation. Such models are designed to learn localized features or generate more discriminative representations for samples in distinct classes by imposing $L_1$-norm penalty on the columns of certain factors. By extending one-layer model into multi-layer one with sparsity, we provided a hierarchical way to analyze big data and extract hidden features intuitively due to nonnegativity. We adopted the Nesterov's accelerated gradient algorithm to accelerate the computing process with the convergence rate of $O(1/k^2)$ after $k$ steps iteration. We also analyzed the computing complexity of our framework to demonstrate their efficiency. To improve the performance of dealing with linearly inseparable data, we also considered to incorporate popular nonlinear functions into this framework and explored their performance. We applied our models onto two benchmarking image datasets, demonstrating our models can achieve competitive or better classification performance and produce intuitive interpretations compared with the typical NMF and competing multi-layer models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑