arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1808.04521cs.CVcs.LG
收藏

低秩正则化方法综述

Low Rank Regularization: A Review

Northwestern Polytechnical University(西北工业大学)

Zhanxuan Hu, Feiping Nie, Rong Wang, Xuelong Li

摘要:

低秩正则化本质上是对所学习的矩阵引入一个低秩或近似低秩的假设,它在机器学习、数据采掘和计算机翻译等领域都取得了巨大的成功。在过去的十年里,在理论和实际应用方面都取得了很大的进展。然而,它们之间的交集非常小。为了在实际应用和理论研究之间架起一座桥梁,本文对低秩正则化进行了全面的综述。我们首先回顾了几种使用低秩正则化的传统机器学习模型,然后展示了它们(或它们的变体)在解决实际问题中的应用,例如非刚性运动恢复结构和图像去噪。随后,我们总结了在传统机器学习任务中取得巨大成功但在解决实际问题中很少见到的正则化器和优化方法。最后,我们对一些有代表性的正则化子(包括凸松弛和非凸松弛)进行了讨论和比较。大量的实验结果表明,非凸正则化可以提供一个很大的优势,核范数,正则化广泛用于解决实际问题。

英文摘要:

Low rank regularization, in essence, involves introducing a low rank or approximately low rank assumption for matrix we aim to learn, which has achieved great success in many fields including machine learning, data mining and computer version. Over the last decade, much progress has been made in theories and practical applications. Nevertheless, the intersection between them is very slight. In order to construct a bridge between practical applications and theoretical research, in this paper we provide a comprehensive survey for low rank regularization. We first review several traditional machine learning models using low rank regularization, and then show their (or their variants) applications in solving practical issues, such as non-rigid structure from motion and image denoising. Subsequently, we summarize the regularizers and optimization methods that achieve great success in traditional machine learning tasks but are rarely seen in solving practical issues. Finally, we provide a discussion and comparison for some representative regularizers including convex and non-convex relaxations. Extensive experimental results demonstrate that non-convex regularizers can provide a large advantage over the nuclear norm, the regularizer widely used in solving practical issues.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑