三重分量矩阵分解:解开全局、局部与噪声分量
Triple Component Matrix Factorization: Untangling Global, Local, and Noisy Components
AI总结:
本文提出三重分量矩阵分解(TCMF)算法,通过交替最小化从带噪声的多源观测矩阵中可证明地分离全局、局部和噪声分量,并在视频分割与异常检测中验证了其优越性。
摘要:
在这项工作中,我们研究从噪声数据中提取共同特征和独特特征的问题。当我们拥有来自N个不同且相互关联的数据源的N个观测矩阵,并且这些矩阵受到稀疏且可能严重的噪声污染时,我们能否从这些噪声观测中恢复共同分量和独特分量?这是一项具有挑战性的任务,因为需要估计的参数数量大约是观测数量的三倍。尽管存在困难,我们提出了一种直观的交替最小化算法,称为三重分量矩阵分解(TCMF),以精确恢复这三个分量。TCMF与现有文献中的工作相比,具有两个显著特点。首先,TCMF是一种有原则的方法,能够在给定噪声观测的情况下可证明地分离三个分量。其次,TCMF的大部分计算可以分布式进行。在技术方面,我们将该问题表述为一个带约束的非凸非光滑优化问题。尽管问题性质复杂,我们通过求解相应的Karush-Kuhn-Tucker条件,给出了其解的泰勒级数刻画。利用这一刻画,我们可以证明交替最小化算法在每次迭代中都能取得显著进展,并以线性速率收敛到真实值。视频分割和异常检测中的数值实验凸显了TCMF优越的特征提取能力。
英文摘要:
In this work, we study the problem of common and unique feature extraction from noisy data. When we have N observation matrices from N different and associated sources corrupted by sparse and potentially gross noise, can we recover the common and unique components from these noisy observations? This is a challenging task as the number of parameters to estimate is approximately thrice the number of observations. Despite the difficulty, we propose an intuitive alternating minimization algorithm called triple component matrix factorization (TCMF) to recover the three components exactly. TCMF is distinguished from existing works in literature thanks to two salient features. First, TCMF is a principled method to separate the three components given noisy observations provably. Second, the bulk of the computation in TCMF can be distributed. On the technical side, we formulate the problem as a constrained nonconvex nonsmooth optimization problem. Despite the intricate nature of the problem, we provide a Taylor series characterization of its solution by solving the corresponding Karush-Kuhn-Tucker conditions. Using this characterization, we can show that the alternating minimization algorithm makes significant progress at each iteration and converges into the ground truth at a linear rate. Numerical experiments in video segmentation and anomaly detection highlight the superior feature extraction abilities of TCMF.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。