arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2009.07934stat.ME
收藏

信息抽样下小区域估计的深度贝叶斯单元级建模

Computationally Efficient Deep Bayesian Unit-Level Modeling of Survey Data under Informative Sampling for Small Area Estimation

Paul A. Parker, Scott H. Holan

摘要:

近年来,深度学习的话题在统计学领域内外都引起了极大的兴趣。与线性或广义线性模型相比,深度模型利用非线性和交互效应在许多情况下提供更好的预测。然而,深度建模方法的主要挑战之一是量化不确定性。随机权重模型的使用,如流行的“极限学习机”,在这方面提供了一个潜在的解决方案。除了不确定性量化之外,这些模型的计算效率非常高,因为它们不需要通过随机梯度下降进行优化,而这正是深度学习的典型做法。我们展示了如何在深度模型中使用随机权重来适应基于似然的框架,以允许对模型参数和任何期望的估计进行不确定性量化。此外,我们展示了如何使用这种方法可以通过使用伪似然来解释调查数据的信息抽样。我们说明了这种方法的有效性,通过模拟和一个真正的调查数据应用程序,涉及美国全国选举研究数据。

英文摘要:

The topic of deep learning has seen a surge of interest in recent years both within and outside of the field of Statistics. Deep models leverage both nonlinearity and interaction effects to provide superior predictions in many cases when compared to linear or generalized linear models. However, one of the main challenges with deep modeling approaches is quantification of uncertainty. The use of random weight models, such as the popularized "Extreme Learning Machine," offer a potential solution in this regard. In addition to uncertainty quantification, these models are extremely computationally efficient as they do not require optimization through stochastic gradient descent, which is what is typically done for deep learning. We show how the use of random weights in a deep model can fit into a likelihood based framework to allow for uncertainty quantification of the model parameters and any desired estimates. Furthermore, we show how this approach can be used to account for informative sampling of survey data through the use of a pseudo-likelihood. We illustrate the effectiveness of this methodology through simulation and with a real survey data application involving American National Election Studies data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑