arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1904.01003math.STstat.TH
收藏

投影结构的一般框架

General framework for projection structures

Eduard Belitser, Nurzhan Nurushev

摘要:

在第一部分中,我们开发了一个一般框架的投影结构,并在此框架内研究了几个推理问题。我们提出了基于数据相关措施(DDM)的程序,并与经验贝叶斯和惩罚方法的连接。主要的推理问题是不确定性量化(UQ),但在此过程中,我们解决了估计,DDM收缩问题,以及弱版本的结构恢复问题。该方法是局部的,因为推理过程的质量是由局部量,预言率,这是由投影结构的近似误差和近似投影结构的复杂性之间的最佳权衡来衡量的。像在统计学习环境中一样,我们发展了无分布理论,因为没有强加特定的模型,我们只假设投影预测器的随机部分有一定的温和条件。我们引入了过度偏差限制(EBR),我们建立了局部置信最优的构造的信心球。建议的一般框架统一了一个非常广泛的类高维模型和结构,有趣的和重要的本身。在第二部分中,我们应用所发展的理论,并展示了一般结果如何提供一个整体的局部和全局极大极小结果(许多新的,一些文献中已知的结果被改进)为特定的模型和结构作为结果,包括白噪声模型和光滑结构的密度估计,线性回归和稀疏结构的字典学习,具有聚类结构的双聚类和随机块模型、具有带状和稀疏结构的协方差阵估计,以及许多其它模型。各种自适应极大极小的结果在不同的尺度也遵循我们的本地结果。

英文摘要:

In the first part, we develop a general framework for projection structures and study several inference problems within this framework. We propose procedures based on data dependent measures (DDM) and make connections with empirical Bayes and penalization methods. The main inference problem is the uncertainty quantification (UQ), but on the way we solve the estimation, DDM-contraction problems, and a weak version of the structure recovery problem. The approach is local in that the quality of the inference procedures is measured by the local quantity, the oracle rate, which is the best trade-off between the approximation error by a projection structure and the complexity of that approximating projection structure. Like in statistical learning settings, we develop distribution-free theory as no particular model is imposed, we only assume certain mild condition on the stochastic part of the projection predictor. We introduce the excessive bias restriction (EBR) under which we establish the local confidence optimality of the constructed confidence ball. The proposed general framework unifies a very broad class of high-dimensional models and structures, interesting and important on their own right. In the second part, we apply the developed theory and demonstrate how the general results deliver a whole avenue of local and global minimax results (many new ones, some known results from the literature are improved) for particular models and structures as consequences, including white noise model and density estimation with smoothness structure, linear regression and dictionary learning with sparsity structures, biclustering and stochastic block models with clustering structure, covariance matrix estimation with banding and sparsity structures, and many others. Various adaptive minimax results over various scales follow also from our local results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑