arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1410.7414stat.MLcs.LG
收藏

快速函数到函数回归

Fast Function to Function Regression

Carnegie Mellon University(卡内基梅隆大学)

Junier Oliva, Willie Neiswanger, Barnabas Poczos, Eric Xing, Jeff Schneider

摘要:

我们分析了当输入协变量和输出响应都是来自非参数函数类的函数时的回归问题。函数到函数回归(FFR)涵盖了大量有趣的应用,包括时间序列预测问题,以及更一般的任务,如研究两种不同类型的分布之间的映射。然而,以前的FFR类型问题的非参数估计量在计算上与数据集中的输入/输出对的数量成比例。考虑到一般函数之间映射的复杂性,可能有必要考虑大型数据集,以实现低估计风险。为了解决这个问题,我们开发了一种新的可扩展的非参数估计,三重基估计(3BE),这是能够操作的数据集与许多实例。据我们所知,3BE是第一个可以扩展到大规模数据集的非参数FFR估计器。我们分析了3BE的风险,并得出一个上限率。此外,我们在预测速度和减少误差方面显示了几个数量级的改进,在各种现实世界的数据集,比以前的估计。

英文摘要:

We analyze the problem of regression when both input covariates and output responses are functions from a nonparametric function class. Function to function regression (FFR) covers a large range of interesting applications including time-series prediction problems, and also more general tasks like studying a mapping between two separate types of distributions. However, previous nonparametric estimators for FFR type problems scale badly computationally with the number of input/output pairs in a data-set. Given the complexity of a mapping between general functions it may be necessary to consider large data-sets in order to achieve a low estimation risk. To address this issue, we develop a novel scalable nonparametric estimator, the Triple-Basis Estimator (3BE), which is capable of operating over datasets with many instances. To the best of our knowledge, the 3BE is the first nonparametric FFR estimator that can scale to massive datasets. We analyze the 3BE's risk and derive an upperbound rate. Furthermore, we show an improvement of several orders of magnitude in terms of prediction speed and a reduction in error over previous estimators in various real-world data-sets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑