最近邻经验过程
Nearest neighbor empirical processes
AI总结:
本文研究回归中基于最近邻响应的经验测度,证明其经验过程的一致中心极限定理与非渐近界,并用于仅靠最近邻估计方差。
摘要:
在回归框架中,引入并研究了一种经验测度,它基于协变量中距给定点 $x$ 的最近邻所对应的响应,并被视为一个核心统计量。首先,在底层函数类满足局部括号熵条件(该条件反映了最近邻算法的局部化性质)的情况下,证明了相关经验过程满足一致中心极限定理。其次,在关于一致熵数的著名条件(通常称为 Vapnik-Chervonenkis 条件)下,建立了一致非渐近界。一致中心极限定理中得到的高斯极限的协方差,简单地等于给定协变量值下的条件协方差算子。这表明有可能仅利用最近邻而非全部数据,使用标准公式来估计方差。文中通过两个问题对此进行了说明:条件累积分布函数的估计和局部线性回归。
英文摘要:
In the regression framework, the empirical measure based on the responses resulting from the nearest neighbors, among the covariates, to a given point $x$ is introduced and studied as a central statistical quantity. First, the associated empirical process is shown to satisfy a uniform central limit theorem under a local bracketing entropy condition on the underlying class of functions reflecting the localizing nature of the nearest neighbor algorithm. Second a uniform non-asymptotic bound is established under a well-known condition, often referred to as Vapnik-Chervonenkis, on the uniform entropy numbers. The covariance of the Gaussian limit obtained in the uniform central limit theorem is simply equal to the conditional covariance operator given the covariate value. This suggests the possibility of using standard formulas to estimate the variance by using only the nearest neighbors instead of the full data. This is illustrated on two problems: the estimation of the conditional cumulative distribution function and local linear regression.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。