arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2306.03384stat.ME
收藏

使用大数据进行小区域估计的校准数据驱动方法

A Calibrated Data-Driven Approach for Small Area Estimation using Big Data

Siu-Ming Tam, Shaila Sharmeen

AI总结:

本文提出一种基于校准kNN算法的小区域估计方法,利用概率调查数据作为训练集插补大数据缺失值并调整测量误差,通过固定渐近自助法估计方差,并与Fay-Harriot估计量进行了准确度和精度的比较。

摘要:

当大数据集中的响应变量与小区域估计的目标变量一致时,大数据本身可以为小区域提供估计值。这些估计值通常受到大数据固有的覆盖和测量误差偏差的影响。然而,如果存在针对同一目标变量的概率调查,调查数据可作为训练数据集,用于开发算法来插补大数据遗漏的数据并调整测量误差。在本文中,我们概述了基于kNN算法的此类插补方法,该校准至国家总量的渐近设计无偏估计,并说明了如何使用训练数据集估计插补偏差,以及使用固定渐近自助法估计小区域混合估计量的方差。我们使用一个公共数据集说明了本文的方法,并以此比较了我们的混合估计量与Fay-Harriot (FH)估计量的准确度和精度。最后,我们还通过数值检验了当链接模型中使用的辅助变量存在覆盖不足误差时FH估计量的准确度和精度。

英文摘要:

Where the response variable in a big data set is consistent with the variable of interest for small area estimation, the big data by itself can provide the estimates for small areas. These estimates are often subject to the coverage and measurement error bias inherited from the big data. However, if a probability survey of the same variable of interest is available, the survey data can be used as a training data set to develop an algorithm to impute for the data missed by the big data and adjust for measurement errors. In this paper, we outline a methodology for such imputations based on an kNN algorithm calibrated to an asymptotically design-unbiased estimate of the national total and illustrate the use of a training data set to estimate the imputation bias and the fixed - asymptotic bootstrap to estimate the variance of the small area hybrid estimator. We illustrate the methodology of this paper using a public use data set and use it to compare the accuracy and precision of our hybrid estimator with the Fay-Harriot (FH) estimator. Finally, we also examine numerically the accuracy and precision of the FH estimator when the auxiliary variables used in the linking models are subject to under-coverage errors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑