arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1610.00951stat.MEmath.STstat.TH
收藏

泛函线性模型的混合正则化

Hybrid Regularisation of Functional Linear Models

Anirvan Chakraborty, Victor M. Panaretos

摘要:

本文研究了具有标量响应和函数协变量的函数回归中的斜率函数的估计问题。众所周知,函数数据分析的这个中心问题是不适定的,因此需要正则化的估计过程。两种最常用的方法是基于谱截断或Tikhonov正则化的经验协方差算子。原则上,吉洪诺夫正则化是更规范的选择。与谱截断相比,它对特征值关系是鲁棒的,同时它在均方意义上达到最优的Minimax收敛速度,而不仅仅是在浓度概率意义上。在本文中,我们表明,令人惊讶的是,可以严格提高性能的Tikhonov估计在有限样本的线性估计,同时保持其稳定性和渐近性质相结合,它与一种形式的谱截断。具体来说,我们构建了一个估计器,通过将其投影到通过函数PCA定义的两个正交子空间上来对函数协变量进行加法分解;然后将Tikhonov正则化应用于一个分量,同时使其他分量不正则化。我们证明,当协变量是高斯,这种混合估计一致提高后的MSE的Tikhonov估计在非渐近意义上,有效地使其不可接受。这种支配下的协变量函数的离散观测也持续存在。混合估计是线性的,在实践中构造简单,并且相对于标准正则化方法没有计算开销。通过模拟,它被证明提供相当大的收益,即使是适度的样本量。

英文摘要:

We consider the problem of estimating the slope function in a functional regression with a scalar response and a functional covariate. This central problem of functional data analysis is well known to be ill-posed, thus requiring a regularised estimation procedure. The two most commonly used approaches are based on spectral truncation or Tikhonov regularisation of the empirical covariance operator. In principle, Tikhonov regularisation is the more canonical choice. Compared to spectral truncation, it is robust to eigenvalue ties, while it attains the optimal minimax rate of convergence in the mean squared sense, and not just in a concentration probability sense. In this paper, we show that, surprisingly, one can strictly improve upon the performance of the Tikhonov estimator in finite samples by means of a linear estimator, while retaining its stability and asymptotic properties by combining it with a form of spectral truncation. Specifically, we construct an estimator that additively decomposes the functional covariate by projecting it onto two orthogonal subspaces defined via functional PCA; it then applies Tikhonov regularisation to the one component, while leaving the other component unregularised. We prove that when the covariate is Gaussian, this hybrid estimator uniformly improves upon the MSE of the Tikhonov estimator in a non-asymptotic sense, effectively rendering it inadmissible. This domination is shown to also persist under discrete observation of the covariate function. The hybrid estimator is linear, straightforward to construct in practice, and with no computational overhead relative to the standard regularisation methods. By means of simulation, it is shown to furnish sizeable gains even for modest sample sizes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑