基于杠杆得分的无模型变量筛选方法
A Model-free Variable Screening Method Based on Leverage Score
摘要:
随着信息技术的快速发展,在生物学、化学和社会科学等各个科学领域都收集了大量的数据集。通常通过统计学习或模型拟合从这些数据中提取有用或有意义的信息。在大规模数据集中,样本量和预测因子的数量都可能很大,在这种情况下,传统方法面临计算挑战。最近,一个创新的和有效的抽样方案的基础上杠杆得分通过奇异值分解已被提出来选择行的设计矩阵作为替代的全部数据在线性回归。类似地,变量筛选可以被视为选择设计矩阵的行。然而,按照这种思路进行有效的变量选择仍然是难以捉摸的。在这篇文章中,我们弥合这一差距,提出了一个加权杠杆变量筛选方法,利用左,右奇异向量的设计矩阵。我们从理论上和经验表明,使用我们的方法选择的预测可以始终包括真正的预测不仅为线性模型,但也为复杂的一般指数模型。大量的仿真研究表明,加权杠杆筛选方法是高度计算效率和有效的。我们还证明了它在使用空间转录组数据识别癌症相关基因方面的成功。
英文摘要:
With rapid advances in information technology, massive datasets are collected in all fields of science, such as biology, chemistry, and social science. Useful or meaningful information is extracted from these data often through statistical learning or model fitting. In massive datasets, both sample size and number of predictors can be large, in which case conventional methods face computational challenges. Recently, an innovative and effective sampling scheme based on leverage scores via singular value decompositions has been proposed to select rows of a design matrix as a surrogate of the full data in linear regression. Analogously, variable screening can be viewed as selecting rows of the design matrix. However, effective variable selection along this line of thinking remains elusive. In this article, we bridge this gap to propose a weighted leverage variable screening method by utilizing both the left and right singular vectors of the design matrix. We show theoretically and empirically that the predictors selected using our method can consistently include true predictors not only for linear models but also for complicated general index models. Extensive simulation studies show that the weighted leverage screening method is highly computationally efficient and effective. We also demonstrate its success in identifying carcinoma related genes using spatial transcriptome data.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。