arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1505.00869stat.ML
收藏

大数据分布式核回归的可行性研究

On the Feasibility of Distributed Kernel Regression for Big Data

Chen Xu, Yongquan Zhang, Runze Li

摘要:

在现代科学研究中,经常会遇到具有大量观测数据的海量数据集。为了便于计算过程,分而治之的方案通常用于大数据的分析。在这种策略中,完整的数据集首先被分成几个可管理的部分;然后从各个部分的输出中平均最终输出。尽管它在实践中的普及,它仍然在很大程度上是未知的,这样的分配策略是否提供了有效的理论推断的原始数据。在本文中,我们解决了这个基本问题的分布式核回归(DKR),其中算法的可行性是衡量所得到的估计的泛化性能。为了证明DKR,需要统一的收敛速度来限制各个输出的泛化误差,这在大数据设置中带来了新的和具有挑战性的问题。在较弱的条件下,我们证明了在适当的分段数下,DKR得到的估计量对未知回归函数是广义一致的。所得到的结果证明了DKR的方法,并揭示了使用其他分布式算法处理大数据的可行性。仿真和实际数据的例子都支持该方法有前途的偏好。

英文摘要:

In modern scientific research, massive datasets with huge numbers of observations are frequently encountered. To facilitate the computational process, a divide-and-conquer scheme is often used for the analysis of big data. In such a strategy, a full dataset is first split into several manageable segments; the final output is then averaged from the individual outputs of the segments. Despite its popularity in practice, it remains largely unknown that whether such a distributive strategy provides valid theoretical inferences to the original data. In this paper, we address this fundamental issue for the distributed kernel regression (DKR), where the algorithmic feasibility is measured by the generalization performance of the resulting estimator. To justify DKR, a uniform convergence rate is needed for bounding the generalization error over the individual outputs, which brings new and challenging issues in the big data setup. Under mild conditions, we show that, with a proper number of segments, DKR leads to an estimator that is generalization consistent to the unknown regression function. The obtained results justify the method of DKR and shed light on the feasibility of using other distributed algorithms for processing big data. The promising preference of the method is supported by both simulation and real data examples.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑