arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2106.05925math.STstat.TH
收藏

流数据的在线去偏套索

Online Debiased Lasso for Streaming Data

Ruijian Han, Lan Luo, Yuanyuan Lin, Jian Huang

摘要:

提出了一种在线去偏套索(ODL)方法,用于流数据高维线性模型的统计推断。建议的ODL包括一个有效的计算算法的流数据和近似正常的估计的回归系数。它的实现只需要数据流中当前数据批次的可用性和在分析的每个阶段对历史数据的充分统计量。一个动态的过程中,选择和更新的调整参数的到来时,每个新的数据批次,使我们可以调整的正则化量自适应地沿数据流。在与离线条件相似的条件下以及数据流中数据批次大小的温和条件下,建立了ODL估计的渐近正态性,为所提出的在线统计推断方法提供了理论依据.我们进行了大量的数值实验,以评估ODL的性能。这些实验证明了我们的算法的有效性和支持的理论结果。以香港交易所的空气质量数据集和指数基金数据集为例说明了该方法的应用。

英文摘要:

We propose an online debiased lasso (ODL) method for statistical inference in high-dimensional linear models with streaming data. The proposed ODL consists of an efficient computational algorithm for streaming data and approximately normal estimators for the regression coefficients. Its implementation only requires the availability of the current data batch in the data stream and sufficient statistics of the historical data at each stage of the analysis. A dynamic procedure is developed to select and update the tuning parameters upon the arrival of each new data batch so that we can adjust the amount of regularization adaptively along the data stream. The asymptotic normality of the ODL estimator is established under the conditions similar to those in an offline setting and mild conditions on the size of data batches in the stream, which provides theoretical justification for the proposed online statistical inference procedure. We conduct extensive numerical experiments to evaluate the performance of ODL. These experiments demonstrate the effectiveness of our algorithm and support the theoretical results. An air quality dataset and an index fund dataset from Hong Kong Stock Exchange are analyzed to illustrate the application of the proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑