arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1203.2210cs.CVcs.NAmath.NA
收藏

固定秩表示用于无监督视觉学习

Fixed-Rank Representation for Unsupervised Visual Learning

Dalian University of Technology(大连理工大学);Carnegie Mellon University(卡内基梅隆大学);Microsoft Research Asia(微软亚洲研究院);Peking University(北京大学)

Risheng Liu, Zhouchen Lin, Fernando De la Torre, Zhixun Su

AI总结:

本文提出固定秩表示(FRR)作为无监督视觉学习的统一框架,通过闭式解揭示多子空间结构,并引入稀疏正则化以增强鲁棒性,同时开发了快速数值求解器。

摘要:

子空间聚类和特征提取是计算机视觉和模式识别中最常用的两种无监督学习技术。最先进的子空间聚类技术利用了稀疏性和秩最小化的最新进展。然而,现有技术计算成本高,并且在数据采样不足的情况下可能导致退化解,从而降低聚类性能。为了部分解决这些问题,并受现有矩阵分解工作的启发,本文提出固定秩表示(FRR)作为无监督视觉学习的统一框架。当数据无噪声时,FRR能够以闭式形式揭示多个子空间的结构。此外,我们证明在某些适当条件下,即使观测不足,FRR仍然能够揭示真实的子空间成员关系。为了实现对异常值和噪声的鲁棒性,我们在FRR框架中引入了稀疏正则化。除了子空间聚类,FRR还可用于无监督特征提取。作为一个非平凡的副产品,我们为FRR开发了一个快速数值求解器。在合成数据和实际应用上的实验结果验证了我们的理论分析,并展示了FRR在无监督视觉学习中的优势。

英文摘要:

Subspace clustering and feature extraction are two of the most commonly used unsupervised learning techniques in computer vision and pattern recognition. State-of-the-art techniques for subspace clustering make use of recent advances in sparsity and rank minimization. However, existing techniques are computationally expensive and may result in degenerate solutions that degrade clustering performance in the case of insufficient data sampling. To partially solve these problems, and inspired by existing work on matrix factorization, this paper proposes fixed-rank representation (FRR) as a unified framework for unsupervised visual learning. FRR is able to reveal the structure of multiple subspaces in closed-form when the data is noiseless. Furthermore, we prove that under some suitable conditions, even with insufficient observations, FRR can still reveal the true subspace memberships. To achieve robustness to outliers and noise, a sparse regularizer is introduced into the FRR framework. Beyond subspace clustering, FRR can be used for unsupervised feature extraction. As a non-trivial byproduct, a fast numerical solver is developed for FRR. Experimental results on both synthetic data and real applications validate our theoretical analysis and demonstrate the benefits of FRR for unsupervised visual learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑