Low rank regularization, in essence, involves introducing a low rank or approximately low rank assumption for matrix we aim to learn, which has achieved great success in many fields including machine learning, data mining and computer version. Over the last decade, much progress has been made in theories and practical applications. Nevertheless, the intersection between them is very slight. In order to construct a bridge between practical applications and theoretical research, in this paper we provide a comprehensive survey for low rank regularization. We first review several traditional machine learning models using low rank regularization, and then show their (or their variants) applications in solving practical issues, such as non-rigid structure from motion and image denoising. Subsequently, we summarize the regularizers and optimization methods that achieve great success in traditional machine learning tasks but are rarely seen in solving practical issues. Finally, we provide a discussion and comparison for some representative regularizers including convex and non-convex relaxations. Extensive experimental results demonstrate that non-convex regularizers can provide a large advantage over the nuclear norm, the regularizer widely used in solving practical issues.
Hyperspectral Image Denoising Using Non-convex Local Low-rank and Sparse Separation with Spatial-Spectral Total Variation Regularization
Qingdao University(青岛大学);Harbin Institute of Technology(哈尔滨工业大学);University of Electronic Science and Technology of China(电子科技大学);University of Kentucky(肯塔基大学);University of California, Santa Barbara(加州大学圣巴巴拉分校)
From Model Based to Learned Regularization in Medical Image Registration: A Comprehensive Review
School of Computation, Information and Technology, Technical University of Munich (TUM)(慕尼黑工业大学计算、信息与技术学院);Munich Center for Machine Learning (MCML)(慕尼黑机器学习中心);Institute of Machine Learning in Biomedical Imaging, Helmholtz Munich(亥姆霍兹慕尼黑生物医学成像机器学习研究所);Department of Computing, Imperial College London(伦敦帝国理工学院计算机系);School of Biomedical Engineering and Imaging Sciences, King’s College London(伦敦国王学院生物医学工程与影像科学学院);School of Medicine, Klinikum rechts der Isar, Technical University of Munich(慕尼黑工业大学右岸医院医学院)
Super-resolution reconstruction of hyperspectral images via low rank tensor modeling and total variation regularization
1 School of Mathematics;Statistics, Xi'an Jiaotong University 2 School of Mathematics;Information Science, Shaanxi Normal University 3 Shenyang Institute of Automation, Chinese Academy of Sciences
Low-Rank Tensor Recovery via Variational Schatten-p Quasi-Norm and Jacobian Regularization
School of Electronics and Information, Northwestern Polytechnical University(电子与信息学院,西北工业大学);School of Control Science and Engineering, Dalian University of Technology(控制科学与工程学院,大连理工大学);Tsinghua University(清华大学)
Low-Rank Tensor Completion by Truncated Nuclear Norm Regularization
College of Information Science and Electronic Engineering, Zhejiang University(浙江大学信息科学与电子工程学院);Zhejiang University(浙江大学);College of Information Science and Electronic Engineering(信息科学与电子工程学院);Hangzhou, China(中国杭州)
Low-Rank Tensor Completion Based on Fractional Regularization with Ky Fan p-k Norm
School of Mathematics and Statistics, Southwest University(西南大学数学与统计学学院);School of Mathematical Sciences/Research Center for Image and Vision Computing, University of Electronic Science and Technology of China(电子科技大学数学科学学院/图像与视觉计算研究中心);Faculty of Computer Science and Control Engineering, Shenzhen University of Advanced Technology(深圳先进技术大学计算机科学与控制工程学院)
提出张量核范数与Ky Fan p-k范数之比(TNPK)作为非凸替代,逼近张量管秩,并构建低秩张量补全模型,证明低秩张量是局部极小点,设计ADMM算法,实验验证优于现有方法。