arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1306.4734stat.ME
收藏

分布式数据集的实时半参数回归

Real-time semiparametric regression for distributed data sets

Jan Luts

摘要:

本文提出了一种大规模多主机数据半参数回归分析的方法。这使得非线性关系的建模和批处理方法(在收集所有数据后开始分析)和实时设置都得到解决。该方法被扩展到在不断变化的环境中运行,在这种环境中,不能再假设模型参数随时间保持不变。该方法的两个应用领域:当有多个数据所有者和回归建模MapReduce框架内的回归建模。一个网站realtime-semiparametric-regression.net说明了如何将拟议方法用于美国国内航空公司的实时数据。

英文摘要:

This paper proposes a method for semiparametric regression analysis of large-scale data which are distributed over multiple hosts. This enables modeling of nonlinear relationships and both the batch approach, where analysis starts after all data have been collected, and the real-time setting are addressed. The methodology is extended to operate in evolving environments, where it can no longer be assumed that model parameters remain constant over time. Two areas of application for the methodology are presented: regression modeling when there are multiple data owners and regression modeling within the MapReduce framework. A website, realtime-semiparametric-regression.net, illustrates the use of the proposed method on United States domestic airline data in real-time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑