arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.06245stat.CO
收藏

分布式统计推断综述

A review of distributed statistical inference

Yuan Gao, Weidong Liu, Hansheng Wang, Xiaozhou Wang, Yibo Yan, Riquan Zhang

AI总结:

本文系统综述了基于分而治之思想的分布式统计推断方法,涵盖参数、非参数及常用模型,并分析了通信成本与估计精度的权衡。

摘要:

各领域海量数据集的迅速涌现对传统统计方法构成了严峻挑战。与此同时,这也为研究者开发新算法提供了机遇。受分而治之思想的启发,人们提出了各种用于统计估计与推断的分布式框架,这些框架是为处理大规模统计优化问题而开发的。本文旨在对相关文献进行全面综述,涵盖参数模型、非参数模型以及其他常用模型,并总结了这些方法的核心思想和理论性质。文中还讨论了通信成本与估计精度之间的权衡以及其他相关问题。

英文摘要:

The rapid emergence of massive datasets in various fields poses a serious challenge to traditional statistical methods. Meanwhile, it provides opportunities for researchers to develop novel algorithms. Inspired by the idea of divide-and-conquer, various distributed frameworks for statistical estimation and inference have been proposed. They were developed to deal with large-scale statistical optimization problems. This paper aims to provide a comprehensive review for related literature. It includes parametric models, nonparametric models, and other frequently used models. Their key ideas and theoretical properties are summarized. The trade-off between communication cost and estimate precision together with other concerns are discussed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑