arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1708.00205stat.MEmath.STstat.TH
收藏

高维空间中的动态线性判别分析

Dynamic Linear Discriminant Analysis in High Dimensional Space

Binyan Jiang, Ziqi Chen, Chenlei Leng

摘要:

动态演化的高维数据是现代数据时代的主要特征。作为对此的部分回应,近年来越来越重视解决维度挑战。然而,这些数据集的非静态性质在很大程度上被忽视了。本文通过提出一种新颖而简单的动态线性规划判别(DLPD)规则来解决这两个挑战。不同于通常的静态线性判别分析,新方法是能够捕捉不断变化的分布的基础人口建模的平均值和协方差作为光滑函数的协变量的利益。在近似稀疏的条件下,我们表明,条件误分类率的DLPD规则收敛到贝叶斯风险的概率均匀的用于建模的动态的变量的范围内,当允许的维数与样本量呈指数增长。同时,我们也建立了贝叶斯风险估计的极小极大下界,这意味着我们所提出的规则的误分类率是极小极大率最优的。通过大量的模拟研究和对乳腺癌数据集的分析,说明了DLPD规则的良好性能。

英文摘要:

High-dimensional data that evolve dynamically feature predominantly in the modern data era. As a partial response to this, recent years have seen increasing emphasis to address the dimensionality challenge. However, the non-static nature of these datasets is largely ignored. This paper addresses both challenges by proposing a novel yet simple dynamic linear programming discriminant (DLPD) rule for binary classification. Different from the usual static linear discriminant analysis, the new method is able to capture the changing distributions of the underlying populations by modeling their means and covariances as smooth functions of covariates of interest. Under an approximate sparse condition, we show that the conditional misclassification rate of the DLPD rule converges to the Bayes risk in probability uniformly over the range of the variables used for modeling the dynamics, when the dimensionality is allowed to grow exponentially with the sample size. The minimax lower bound of the estimation of the Bayes risk is also established, implying that the misclassification rate of our proposed rule is minimax-rate optimal. The promising performance of the DLPD rule is illustrated via extensive simulation studies and the analysis of a breast cancer dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑