arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.02044math.STstat.MLstat.TH
收藏

多维凸回归:最小二乘估计量的次优性

Convex Regression in Multidimensions: Suboptimality of Least Squares Estimators

Gil Kur, Fuchang Gao, Adityanand Guntuboyina, Bodhisattva Sen

AI总结:

本文证明当维数d≥5时,凸函数类上的最小二乘估计量在平方误差损失下达到n^{-2/d}速率,次优于n^{-4/(d+4)}的极小极大速率,并建立了无约束凸LSE在多面体域固定设计下的首个收敛速率结果。

摘要:

在通常的带高斯误差的非参数回归模型下,对于自然子类中的凸函数,最小二乘估计量(LSEs)在平方误差损失下估计一个d维凸函数时,当维数d为5或更大时被证明是次优的。所考虑的具体函数类包括:(i)支撑在多面体上的有界凸函数(随机设计),(ii)支撑在任意凸域上的Lipschitz凸函数(随机设计),(iii)支撑在多面体上的凸函数(固定设计)。对于这些类中的每一个,当d≥5时,LSE的风险被证明为n^{-2/d}阶(最多相差对数因子),而极小极大风险为n^{-4/(d+4)}阶。此外,对于所有d≥1,在多面体域上的固定设计下,建立了无约束凸LSE的首个收敛速率结果(最坏情况和自适应)。还证明了一些关于凸函数的新的度量熵结果,这些结果具有独立的意义。

英文摘要:

Under the usual nonparametric regression model with Gaussian errors, Least Squares Estimators (LSEs) over natural subclasses of convex functions are shown to be suboptimal for estimating a $d$-dimensional convex function in squared error loss when the dimension $d$ is 5 or larger. The specific function classes considered include: (i) bounded convex functions supported on a polytope (in random design), (ii) Lipschitz convex functions supported on any convex domain (in random design), (iii) convex functions supported on a polytope (in fixed design). For each of these classes, the risk of the LSE is proved to be of the order $n^{-2/d}$ (up to logarithmic factors) while the minimax risk is $n^{-4/(d+4)}$, when $d \ge 5$. In addition, the first rate of convergence results (worst case and adaptive) for the unrestricted convex LSE are established in fixed-design for polytopal domains for all $d \geq 1$. Some new metric entropy results for convex functions are also proved which are of independent interest.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑