arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.16634stat.CO
收藏

面向大规模网络的空间自回归模型的分布式估计与推断

Distributed Estimation and Inference for Spatial Autoregression Model with Large Scale Networks

Yimeng Ren, Zhe Li, Xuening Zhu, Yuan Gao, Hansheng Wang

AI总结:

针对大规模网络下SAR模型的计算挑战,提出DNLSA分布式估计框架及一步和两步估计量,结合随机投影降低通信成本,并给出理论性质与Spark数值验证。

摘要:

在线网络平台的快速增长产生了大规模网络数据,这给使用空间自回归(SAR)模型进行统计分析带来了巨大挑战。在本工作中,我们为分布式系统上的SAR模型开发了一个新颖的分布式估计与统计推断框架。我们首先提出了一种分布式网络最小二乘近似(DNLSA)方法。这使我们能够通过对每个工作节点上的局部估计量进行加权平均来获得一步估计量。之后,设计了一种改进的两步估计以进一步减小估计偏差。对于统计推断,我们利用随机投影方法来降低昂贵的通信成本。在理论上,我们证明了一步和两步估计量的一致性与渐近正态性。此外,我们为分布式统计推断过程提供了理论保证。通过在Spark系统上实施的若干数值模拟验证了理论发现和计算优势。最后,在Yelp数据集上的实验进一步说明了所提出方法的有用性。

英文摘要:

The rapid growth of online network platforms generates large-scale network data and it poses great challenges for statistical analysis using the spatial autoregression (SAR) model. In this work, we develop a novel distributed estimation and statistical inference framework for the SAR model on a distributed system. We first propose a distributed network least squares approximation (DNLSA) method. This enables us to obtain a one-step estimator by taking a weighted average of local estimators on each worker. Afterwards, a refined two-step estimation is designed to further reduce the estimation bias. For statistical inference, we utilize a random projection method to reduce the expensive communication cost. Theoretically, we show the consistency and asymptotic normality of both the one-step and two-step estimators. In addition, we provide theoretical guarantee of the distributed statistical inference procedure. The theoretical findings and computational advantages are validated by several numerical simulations implemented on the Spark system. Lastly, an experiment on the Yelp dataset further illustrates the usefulness of the proposed methodology.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑