arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2205.08609stat.MLcs.LGstat.ME
收藏

Bagged Polynomial Regression and Neural Networks

Bagged Polynomial Regression and Neural Networks

Department of Agricultural and Resource Economics, UC Davis(加州大学戴维斯分校农业与资源经济学系);Stanford Graduate School of Business(斯坦福商学院)

Sylvia Klosin, Jaume Vives-i-Bastida

AI总结:

针对高维预测问题,提出基于随机投影的袋装多项式回归(BPR),在保持与神经网络相当精度的同时提供可解释性和诊断工具。

摘要:

气候和环境应用越来越依赖于从遥感和其他科学数据中进行高维预测。神经网络(NN)在这些场景中能够提供强大的准确性,但往往难以审计且难以与领域知识对齐。作为替代方案,我们提出了基于随机投影的袋装多项式回归(BPR),这是一种计量经济学原生的集成方法,它对在随机选择的协变量组上拟合的多个正则化低次多项式模型进行平均。我们提供了新颖的有限样本和渐近风险界,并展示了协变量划分如何通过控制字典基增长来改善光滑目标函数的速率。速率改进对于边际效应的估计可能尤其重要。在使用光学和雷达图像进行基于卫星的作物分类的应用中,BPR 在保持易于诊断的同时达到了与 NN 相当的准确性。我们提供了实用的透明度工具、系数汇总和偏依赖诊断,表明 BPR 捕捉到了 NN 未能捕捉到的直观特征关系。

英文摘要:

Climate and environmental applications increasingly rely on high-dimensional prediction from remote sensing and other scientific data. Neural networks (NN) can deliver strong accuracy in these settings, but they are often hard to audit and hard to align with domain knowledge. As an alternative, we propose bagged polynomial regression with random projections (BPR), an econometrics-native ensemble that averages many regularized low-degree polynomial models fit on randomly selected covariate groups. We provide novel finite-sample and asymptotic risk bounds and show how covariate partitioning can improve rates for smooth target functions by controlling dictionary basis growth. Rate improvements may be particularly relevant for the estimation of marginal effects. In an application to satellite-based crop classification using optical and radar imagery, BPR matches NN accuracy while remaining straightforward to diagnose. We provide practical transparency tools, coefficient summaries and partial-dependence diagnostics, that show BPR captures intuitive feature relationships that NNs do not.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑