arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2107.07257stat.MEmath.STstat.TH
收藏

S形函数的非参数、无调参估计

Nonparametric, tuning-free estimation of S-shaped functions

Oliver Y. Feng, Yining Chen, Qiyang Han, Raymond J. Carroll, Richard J. Samworth

AI总结:

针对S形回归函数非参数估计的非凸优化难题,提出将估计器视为凸锥并集投影的视角,设计混合原始-对偶基高效算法,证明其达到极小极大最优收敛速率,且在分段仿射场景下可达近似参数化速率,已在R包Sshaped中实现。

摘要:

我们研究S形回归函数的非参数估计问题。最小二乘估计器是一种非常自然的无调参方法,但由于拐点未知,会导致非凸优化问题。我们证明该估计器仍可被视为向有限个凸锥之并的投影,据此我们提出一种混合原始-对偶基算法,用于实现其高效的序列计算。在构建了证明估计器一致性和对模型误设鲁棒性的投影框架后,我们的核心理论结果给出了精确的神谕不等式,可得到回归函数估计的最坏情况风险界和自适应风险界,以及拐点估计的收敛速率。这些结果不仅表明该估计器在回归函数及其拐点估计上均达到极小极大最优收敛速率(后者相差一个对数因子),还证明当真回归函数为分段仿射且仿射段数量不多时,它能达到近似参数化速率。模拟实验以及在空气污染建模中的真实数据应用也证实了该估计器良好的有限样本性质,我们的算法已在R包Sshaped中实现。

英文摘要:

We consider the nonparametric estimation of an S-shaped regression function. The least squares estimator provides a very natural, tuning-free approach, but results in a non-convex optimisation problem, since the inflection point is unknown. We show that the estimator may nevertheless be regarded as a projection onto a finite union of convex cones, which allows us to propose a mixed primal-dual bases algorithm for its efficient, sequential computation. After developing a projection framework that demonstrates the consistency and robustness to misspecification of the estimator, our main theoretical results provide sharp oracle inequalities that yield worst-case and adaptive risk bounds for the estimation of the regression function, as well as a rate of convergence for the estimation of the inflection point. These results reveal not only that the estimator achieves the minimax optimal rate of convergence for both the estimation of the regression function and its inflection point (up to a logarithmic factor in the latter case), but also that it is able to achieve an almost-parametric rate when the true regression function is piecewise affine with not too many affine pieces. Simulations and a real data application to air pollution modelling also confirm the desirable finite-sample properties of the estimator, and our algorithm is implemented in the R package Sshaped.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑