arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1107.0789cs.LGcs.DScs.NAmath.NAstat.ML

Distributed Matrix Completion and Robust Factorization

Stanford(斯坦福大学);UC Berkeley(加州大学伯克利分校)

Lester Mackey, Ameet Talwalkar, Michael I. Jordan

英文摘要:

If learning methods are to scale to the massive sizes of modern datasets, it is essential for the field of machine learning to embrace parallel and distributed computing. Inspired by the recent development of matrix factorization methods with rich theory but poor computational complexity and by the relative ease of mapping matrices onto distributed architectures, we introduce a scalable divide-and-conquer framework for noisy matrix factorization. We present a thorough theoretical analysis of this framework in which we characterize the statistical errors introduced by the "divide" step and control their magnitude in the "conquer" step, so that the overall algorithm enjoys high-probability estimation guarantees comparable to those of its base algorithm. We also present experiments in collaborative filtering and video background modeling that demonstrate the near-linear to superlinear speed-ups attainable with this approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑