For the past two decades, single-index model, a special case of projection pursuit regression, has proven to be an efficient way of coping with the high dimensional problem in nonparametric regression. In this paper, based on weakly dependent sample, we investigate the single-index prediction (SIP) model which is robust against deviation from the single-index model. The single-index is identified by the best approximation to the multivariate prediction function of the response variable, regardless of whether the prediction function is a genuine single-index function. A polynomial spline estimator is proposed for the single-index prediction coefficients, and is shown to be root-n consistent and asymptotically normal. An iterative optimization routine is used which is sufficiently fast for the user to analyze large data of high dimension within seconds. Simulation experiments have provided strong evidence that corroborates with the asymptotic theory. Application of the proposed procedure to the rive flow data of Iceland has yielded superior out-of-sample rolling forecasts.
Efficient Estimation in Single Index Models through Smoothing splines
本文研究了具有未知光滑连接函数的单指标回归模型的估计和推断问题。与使用核函数或回归样条函数的标准方法相比,我们使用平滑样条函数来估计平滑连接函数。在独立同分布(independent and identical distributed,i.i.d.)~(?)的情况下,我们给出了一种计算参数和非参数分量的惩罚最小二乘估计(penalized least squares estimator,PLSE)的方法。数据我们证明的一致性,并找到估计的收敛速度。在较弱的假设下建立了参数分量的渐近正态性,并证明了参数分量在同方差误差下的渐近有效性。有限样本模拟证实了我们的渐近理论。我们还分析了汽车里程数据集和臭氧浓度数据集。最后,研究了偏最小二乘估计的可辨识性和存在性。
Higher Order Spline Highly Adaptive Lasso Estimators of Functional Parameters: Pointwise Asymptotic Normality and Uniform Convergence Rates
We consider estimation of a functional of the data distribution based on i.i.d. observations. We assume the target function can be defined as the minimizer of the expectation of a loss function over a class of $d$ -variate real valued cadlag functions that have finite sectional variation norm. For all $k=0,1,\ldots$ , we define a $k$ -th order smoothness class of functions as $d$ -variate functions on the unit cube for which each of a sequentially defined $k$ -th order Radon-Nikodym derivative w.r.t. Lebesgue measure is cadlag and of bounded variation. For a target function in this $k$ -th ord…