arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2103.11931cs.LG
收藏

基于协同鲁棒框架的增强型主成分分析

Enhanced Principal Component Analysis under A Collaborative-Robust Framework

School of Computer Science(计算机学院);School of Artificial Intelligence, Optics and Electronics (iOPEN)(人工智能、光学与电子学院(iOPEN));Northwestern Polytechnical University(西北工业大学)

Rui Zhang, Hongyuan Zhang, Xuelong Li

摘要:

主成分分析(PCA)经常受到异常值的干扰,因此已经开发了PCA的鲁棒扩展和变化谱。然而,现有的PCA扩展同样对待所有的样本,即使是那些大噪声。在本文中,我们首先介绍了一个通用的协作强大的权重学习框架,结合权重学习和鲁棒损失在一个非平凡的方式。更重要的是,在所提出的框架下,只有一部分拟合良好的样本被激活,这表明在训练过程中更重要,而其他误差较大的样本不会被忽略。特别地,通过稳健的损失函数减轻了失活样品的负面影响。在此基础上,我们进一步提出了一种改进的PCA,该PCA采用了一种插值于L_2,1-范数和平方Frobenius-范数之间的逐点sigma-损失函数,同时保持了旋转不变性。从重建误差和聚类精度两个方面对遮挡数据集进行了大量的实验。实验结果证明了该模型的优越性和有效性。

英文摘要:

Principal component analysis (PCA) frequently suffers from the disturbance of outliers and thus a spectrum of robust extensions and variations of PCA have been developed. However, existing extensions of PCA treat all samples equally even those with large noise. In this paper, we first introduce a general collaborative-robust weight learning framework that combines weight learning and robust loss in a non-trivial way. More significantly, under the proposed framework, only a part of well-fitting samples are activated which indicates more importance during training, and others, whose errors are large, will not be ignored. In particular, the negative effects of inactivated samples are alleviated by the robust loss function. Then we furthermore develop an enhanced PCA which adopts a point-wise sigma-loss function that interpolates between L_2,1-norm and squared Frobenius-norm and meanwhile retains the rotational invariance property. Extensive experiments are conducted on occluded datasets from two aspects including reconstructed errors and clustering accuracy. The experimental results prove the superiority and effectiveness of our model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑