矩阵分解因子分析的统计性质
Statistical properties of matrix decomposition factor analysis
AI总结:
本文针对矩阵分解因子分析(MDFA)估计量,证明了其一致性和渐近正态性,揭示其本质为基于Bures-Wasserstein距离的MDF估计量,并为包括PCA在内的成分分析提供统一视角。
摘要:
针对因子分析,已有众多估计量被提出,其统计性质也得到了广泛研究。在21世纪初,一种基于矩阵分解的新方法——矩阵分解因子分析(MDFA)被引入,并在计算统计学中得到了积极发展。MDFA估计量具有若干优势,包括保证得到恰当解(即无Heywood情形)以及可扩展到ℓ0稀疏估计。然而,MDFA估计量似乎并未被表述为经典的M估计量或最小差异函数(MDF)估计量,且其统计性质在很大程度上仍未被探索。尽管MDFA估计量最小化的损失函数类似于主成分分析(PCA)的损失函数,但经验上其行为更类似于因子分析中的一致估计量,而非PCA本身。这引出了一个基本问题:矩阵分解因子分析能否真正被视为“因子分析”?为解决此问题,我们建立了MDFA估计量的一致性和渐近正态性。认识到MDFA估计量可表述为半参数极大似然估计量后,我们惊讶地发现,其剖面似然由样本协方差矩阵与模型化协方差矩阵之间的Bures-Wasserstein距离的平方给出。因此,MDFA估计量归根结底是因子分析的MDF估计量。除MDFA外,同样的表示也适用于包括PCA在内的广泛成分分析方法,从而为成分分析提供了统一视角。数值实验表明,MDFA与其他既有估计量相比表现相当,表明它是因子分析中一个具有理论依据且计算上吸引人的替代方案。
英文摘要:
Numerous estimators have been proposed for factor analysis, and their statistical properties have been extensively studied. In the early 2000s, a novel matrix factorization-based approach, known as Matrix Decomposition Factor Analysis (MDFA), was introduced and has been actively developed in computational statistics. The MDFA estimator offers several advantages, including the guarantee of proper solutions (i.e., no Heywood cases) and the extensibility to $\ell_0$-sparse estimation. However, the MDFA estimator does not appear to be formulated as a classical M-estimator or a minimum discrepancy function (MDF) estimator, and the statistical properties of the MDFA estimator have remained largely unexplored. Although the MDFA estimator minimizes a loss function resembling that of principal component analysis (PCA), it empirically behaves more like consistent estimators used in factor analysis than like PCA itself. This raises a fundamental question: can matrix decomposition factor analysis truly be regarded as "factor analysis"? To address this issue, we establish consistency and asymptotic normality of the MDFA estimator. Recognizing that the MDFA estimator can be formulated as a semiparametric maximum likelihood estimator, we surprisingly find that the profile likelihood is given by the squared Bures-Wasserstein distance between the sample covariance matrix and the modeled covariance matrix. As a consequence, the MDFA estimator is ultimately an MDF estimator for factor analysis. Beyond MDFA, the same representation holds for a broad class of component analysis methods, including PCA, thereby offering a unified perspective on component analysis. Numerical experiments demonstrate that MDFA performs competitively with other established estimators, suggesting that it is a theoretically grounded and computationally appealing alternative for factor analysis.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。