arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2102.10080stat.MEmath.STstat.MLstat.TH
收藏

分布式Bootstrap在高精度下的同时推理

Distributed Bootstrap for Simultaneous Inference Under High Dimensionality

Yang Yu, Shih-Kang Chao, Guang Cheng

摘要:

我们提出了一个分布式的引导方法,同时推理的高维海量数据,存储和处理与许多机器。该方法产生一个$\ell_\infty$ -范数置信区域的基础上的通信有效的去偏套索,我们提出了一个有效的交叉验证方法来调整的方法在每次迭代。我们从理论上证明了一个下界的通信轮数$τ_{\min}$,保证统计的准确性和效率。此外,$τ_{\min}$仅随工人数和内在维数的增加而增加,而几乎不随名义维数的增加而变化。我们测试我们的理论,通过广泛的模拟研究,和一个半合成数据集的基础上,美国航空公司的准时性能数据集的变量筛选任务。再现数值结果的代码可在GitHub上获得:https://github.com/skchao74/Distributed-bootstrap。

英文摘要:

We propose a distributed bootstrap method for simultaneous inference on high-dimensional massive data that are stored and processed with many machines. The method produces an $\ell_\infty$-norm confidence region based on a communication-efficient de-biased lasso, and we propose an efficient cross-validation approach to tune the method at every iteration. We theoretically prove a lower bound on the number of communication rounds $τ_{\min}$ that warrants the statistical accuracy and efficiency. Furthermore, $τ_{\min}$ only increases logarithmically with the number of workers and the intrinsic dimensionality, while nearly invariant to the nominal dimensionality. We test our theory by extensive simulation studies, and a variable screening task on a semi-synthetic dataset based on the US Airline On-Time Performance dataset. The code to reproduce the numerical results is available at GitHub: https://github.com/skchao74/Distributed-bootstrap.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑