arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.11282stat.MEmath.STstat.MLstat.TH
收藏

支撑杆局部多项式回归

Outrigger local polynomial regression

Statistical Laboratory, University of Cambridge(剑桥大学统计实验室)

Elliot H. Young, Rajen D. Shah, Richard J. Samworth

AI总结:

支撑杆局部多项式回归通过改进估计方法,在不同误差分布下实现分布适应性,并证明其在Hölder类上为minimax最优。

摘要:

标准的非参数回归函数局部多项式估计器采用了一个针对同方差高斯误差设置设计的加权最小二乘损失函数。我们引入了支撑杆局部多项式估计器,其设计目的是在不同的条件误差分布下实现分布适应性。它通过使用误差的条件分数函数的估计和一个'支撑杆',从更广的局部窗口中获取数据,以稳定条件分数估计的影响。在光滑性和矩条件的前提下,并且仅要求条件分数估计的一致性,我们首先证明,即使在支撑杆估计器最不利的设置下,两种估计器的局部风险的渐近比率至多为1,当且仅当条件误差分布为高斯分布时才相等。此外,我们证明支撑杆估计器在Hölder类上是minimax最优的,误差上限取决于回归函数的光滑度β∈(0,∞)和协变量的维度d。当β∈(0,1]时,我们发现A_{β,d} ≤1.69,且当β趋近于0时,A_{β,d}趋近于1。我们方法的另一个优点是不需要诸如误差和协变量独立性或条件误差分布对称性的结构假设。在模拟和真实数据上的数值结果验证了我们的理论发现;我们的方法在R中实现,并可在https://github.com/elliot-young/outrigger上获得。

英文摘要:

Standard local polynomial estimators of a nonparametric regression function employ a weighted least squares loss function that is tailored to the setting of homoscedastic Gaussian errors. We introduce the outrigger local polynomial estimator, which is designed to achieve distributional adaptivity across different conditional error distributions. It modifies a standard local polynomial estimator by employing an estimate of the conditional score function of the errors and an 'outrigger' that draws on the data in a broader local window to stabilise the influence of the conditional score estimate. Subject to smoothness and moment conditions, and only requiring consistency of the conditional score estimate, we first establish that even under the least favourable settings for the outrigger estimator, the asymptotic ratio of the worst-case local risks of the two estimators is at most $1$, with equality if and only if the conditional error distribution is Gaussian. Moreover, we prove that the outrigger estimator is minimax optimal over Hölder classes up to a multiplicative factor $A_{β,d}$, depending only on the smoothness $β\in (0,\infty)$ of the regression function and the dimension~$d$ of the covariates. When $β\in (0,1]$, we find that $A_{β,d} \leq 1.69$, with $\lim_{β\searrow 0} A_{β,d} = 1$. A further attraction of our proposal is that we do not require structural assumptions such as independence of errors and covariates, or symmetry of the conditional error distribution. Numerical results on simulated and real data validate our theoretical findings; our methodology is implemented in R and available at https://github.com/elliot-young/outrigger.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑