arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.04729math.STmath.FAstat.MLstat.TH
收藏

增长维部分泛函线性模型的非渐近最优预报误差

Non-asymptotic Optimal Prediction Error for Growing-dimensional Partially Functional Linear Models

Huiming Zhang, Xiaoyu Lei

摘要:

在再生核希尔伯特空间(RKHS)下,研究了部分泛函线性模型(PFLM)的惩罚最小二乘估计问题,PFLM的预测量包含泛函部分和传统多元部分,且多元部分允许参数个数不同.从非渐近的角度,我们专注于速率最优的上界和下界的预测误差。在一个更一般的假设下,即模型的有效维数下,以非渐近形式显示了超额预测风险的精确上界,通过该假设,我们还显示了当多变量协变量$p$的数量随样本量$n$略微增加时的预测一致性。我们的新发现意味着非功能性预测因子的数量和内核主成分的有效维度之间的权衡,以确保在增加的维度设置中的预测一致性。证明中的分析依赖于协方差算子和再生核的夹心算子的谱条件,以及希尔伯特空间中随机元的次高斯和Berstein集中不等式.最后,在Kullback-Leibler发散的正则性假设下,得到了模型的非渐近极大极小下界.

英文摘要:

Under the reproducing kernel Hilbert spaces (RKHS), we consider the penalized least-squares of the partially functional linear models (PFLM), whose predictor contains both functional and traditional multivariate parts, and the multivariate part allows a divergent number of parameters. From the non-asymptotic point of view, we focus on the rate-optimal upper and lower bounds of the prediction error. An exact upper bound for the excess prediction risk is shown in a non-asymptotic form under a more general assumption known as the effective dimension to the model, by which we also show the prediction consistency when the number of multivariate covariates $p$ slightly increases with the sample size $n$. Our new finding implies a trade-off between the number of non-functional predictors and the effective dimension of the kernel principal components to ensure prediction consistency in the increasing-dimensional setting. The analysis in our proof hinges on the spectral condition of the sandwich operator of the covariance operator and the reproducing kernel, and on sub-Gaussian and Berstein concentration inequalities for the random elements in Hilbert space. Finally, we derive the non-asymptotic minimax lower bound under the regularity assumption of the Kullback-Leibler divergence of the models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑