arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1502.00182math.NAcs.DScs.LGcs.NAstat.ML
收藏

高维低秩加稀疏矩阵分解

High Dimensional Low Rank plus Sparse Matrix Decomposition

University of Central Florida(中佛罗里达大学)

Mostafa Rahmani, George Atia

AI总结:

本文提出一种可扩展的子空间追猎方法,将矩阵分解问题转化为子空间学习问题,通过小数据草稿实现分解,适应性采样算法提升了处理结构化数据的效率。

摘要:

本文关注大数据中的低秩加稀疏矩阵分解问题。传统算法使用全部数据提取低秩和稀疏成分,基于复杂度随数据维度增长的优化问题,限制了可扩展性。现有随机方法多依赖均匀随机采样,对于具有额外结构的数据(如聚类)效率低下。本文提出一种可扩展的子空间追猎方法,将分解问题转化为子空间学习问题。通过采样列/行形成的小数据草稿进行分解。即使均匀随机采样,所需采样列/行数约为O(rμ),其中μ是相干参数,r是低秩成分的秩。此外,提出适应性采样算法以解决结构化数据的列/行采样问题。提供适应性采样方法的分析,证明适应性采样使所需采样列/行数对数据分布不变。所提方法适用于在线实现,并提出在线方案。

英文摘要:

This paper is concerned with the problem of low rank plus sparse matrix decomposition for big data. Conventional algorithms for matrix decomposition use the entire data to extract the low-rank and sparse components, and are based on optimization problems with complexity that scales with the dimension of the data, which limits their scalability. Furthermore, existing randomized approaches mostly rely on uniform random sampling, which is quite inefficient for many real world data matrices that exhibit additional structures (e.g. clustering). In this paper, a scalable subspace-pursuit approach that transforms the decomposition problem to a subspace learning problem is proposed. The decomposition is carried out using a small data sketch formed from sampled columns/rows. Even when the data is sampled uniformly at random, it is shown that the sufficient number of sampled columns/rows is roughly O(rμ), where μis the coherency parameter and r the rank of the low rank component. In addition, adaptive sampling algorithms are proposed to address the problem of column/row sampling from structured data. We provide an analysis of the proposed method with adaptive sampling and show that adaptive sampling makes the required number of sampled columns/rows invariant to the distribution of the data. The proposed approach is amenable to online implementation and an online scheme is proposed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑