arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.24820stat.MEstat.CO
收藏

鲁棒双块同时降维

Robust Twoblock Simultaneous Dimension Reduction and Multivariate Regression

Snow Stallion AI(雪 stallion 人工智能);Department of Mathematics, University of Antwerp(安特卫普大学数学系)

Sven Serneels

AI总结:

本文提出鲁棒双块同时降维方法,能够稳健地处理双变量块的降维问题,并允许单独调整每个块的模型复杂度。该方法在存在异常值时仍能有效提取和总结信息,且在变量数超过样本数时仍可进行多元回归。

摘要:

本文介绍了鲁棒双块(RTB)同时降维方法,这是首个在两个变量块中进行同时降维的统计稳健方法,允许单独调整每个块的模型复杂度。本文提出了该方法的密集和稀疏版本。稀疏RTB是首个允许单独选择每个块的模型复杂度和稀疏度的稳健估计器。RTB因此能够最优地提取和总结每个数据块的相关信息,即使在存在异常值的情况下。作为推论,估计器可以重新组合成一个回归系数的单一估计值,适用于每个块中变量数超过样本数的情况。广泛的模拟研究表明,新方法对不同类型的异常值具有抗性,同时在各种维度设置下保持估计效率。这些发现对于密集和稀疏方法都成立。方法的性能进一步在两个数据集和一个简单算法上得到验证,并在开源仓库中提供。

英文摘要:

This paper introduces robust twoblock (RTB) simultaneous dimension reduction, which is the first statistically robust method to perform simultaneous dimension reduction in two blocks of variables that allows to tune the number of components in each block individually. The paper proposes both a dense and a sparse version of the new method. Sparse RTB is the first robust estimator of this kind that allows to tune both the number of components and the degree of sparsity (i.e.\ the number of variables retained) for each block individually. RTB thereby allows to optimally extract and summarize the relevant portion of information in each block of data, also in the presence of outliers. As a corollary, the estimators can be recombined into a single estimate of regression coefficients for multivariate regression that is operable when the number of variables exceeds the number of cases in each block. An extensive simulation study illustrates that the new methods are resistant to different types of outliers, while maintaining estimation efficiency across a range of dimensionality settings. These findings both hold true for the dense and the sparse method. The methods' performance is further illustrated on two example data sets and a straightforward algorithm is presented and made accessible in an open source repository.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑