Nonnegative matrix factorization is a powerful technique to realize dimension reduction and pattern recognition through single-layer data representation learning. Deep learning, however, with its carefully designed hierarchical structure, is able to combine hidden features to form more representative features for pattern recognition. In this paper, we proposed sparse deep nonnegative matrix factorization models to analyze complex data for more accurate classification and better feature interpretation. Such models are designed to learn localized features or generate more discriminative representations for samples in distinct classes by imposing $L_1$-norm penalty on the columns of certain factors. By extending one-layer model into multi-layer one with sparsity, we provided a hierarchical way to analyze big data and extract hidden features intuitively due to nonnegativity. We adopted the Nesterov's accelerated gradient algorithm to accelerate the computing process with the convergence rate of $O(1/k^2)$ after $k$ steps iteration. We also analyzed the computing complexity of our framework to demonstrate their efficiency. To improve the performance of dealing with linearly inseparable data, we also considered to incorporate popular nonlinear functions into this framework and explored their performance. We applied our models onto two benchmarking image datasets, demonstrating our models can achieve competitive or better classification performance and produce intuitive interpretations compared with the typical NMF and competing multi-layer models.
Hyperspectral Unmixing Based on Nonnegative Matrix Factorization: A Comprehensive Review
Southwest Jiaotong University(西南交通大学);Mississippi State University(密西西比州立大学);University of New South Wales(新南威尔士大学);University of Extremadura(埃斯特雷马杜拉大学)
Hyperspectral Unmixing via Nonnegative Matrix Factorization with Handcrafted and Learnt Priors
School of Marine Science and Technology, Northwestern Polytechnical University, China(西北工业大学海洋科学与技术学院);State Key Laboratory of Rail Traffic Control and Safety, Beijing Jiaotong University, China(北京交通大学轨道交通控制与安全国家重点实验室)
Kernel Nonnegative Matrix Factorization Without the Curse of the Pre-image - Application to Unmixing Hyperspectral Images
Institut Charles Delaunay (CNRS)(查尔斯·德洛奈研究所(法国国家科学研究中心));Université de Technologie de Troyes(特鲁瓦技术大学);LITIS lab(LITIS实验室);Université de Rouen(鲁昂大学);Centre de Recherche en Automatique de Nancy (CNRS)(南锡自动化研究中心(法国国家科学研究中心));Université de Lorraine(洛林大学)