arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2109.00644cs.LGcs.MS
收藏

RIFLE:基于低阶边缘分布的插补与稳健推断

RIFLE: Imputation and Robust Inference from Low Order Marginals

University of Southern California(南加州大学)

Sina Baharlouei, Kelechi Ogudu, Sze-chuan Suen, Meisam Razaviyayn

AI总结:

针对高缺失率和低样本量下传统插补方法表现差的问题,提出无需插补的统计推断框架RIFLE,通过估计低阶矩及置信区间学习分布稳健模型,在高缺失值或小样本场景下优于MICE等基准算法。

摘要:

现实世界数据集中缺失值的普遍存在对统计推断构成了挑战,并可能阻碍相似数据集在同一研究中被分析,从而排除了许多现有数据集用于新分析的可能性。尽管已开发了大量用于数据插补的包和算法,但如果存在大量缺失值和低样本量,绝大多数算法表现不佳,而这些不幸是实证数据中的常见特征。这种低准确度的估计会不利地影响下游统计模型的性能。我们开发了一个在存在缺失数据且无需插补的情况下进行回归和分类的统计推断框架。我们的框架RIFLE(通过低阶矩估计进行稳健推断,Robust InFerence via Low-order moment Estimations)估计底层数据分布的低阶矩及相应的置信区间,以学习一个分布稳健的模型。我们将该框架专门应用于线性回归和正态判别分析,并提供了收敛性和性能保证。该框架也可适配用于插补缺失数据。在数值实验中,我们在存在缺失值的情况下,将RIFLE与几种最先进的方法(包括MICE、Amelia、MissForest、KNN-imputer、MIDA和Mean Imputer)在插补和推断方面进行了比较。我们的实验表明,当缺失值百分比较高和/或数据点数量相对较少时,RIFLE优于其他基准算法。RIFLE已在 https://github.com/optimization-for-data-driven-science/RIFLE 上公开提供。

英文摘要:

The ubiquity of missing values in real-world datasets poses a challenge for statistical inference and can prevent similar datasets from being analyzed in the same study, precluding many existing datasets from being used for new analyses. While an extensive collection of packages and algorithms have been developed for data imputation, the overwhelming majority perform poorly if there are many missing values and low sample sizes, which are unfortunately common characteristics in empirical data. Such low-accuracy estimations adversely affect the performance of downstream statistical models. We develop a statistical inference framework for regression and classification in the presence of missing data without imputation. Our framework, RIFLE (Robust InFerence via Low-order moment Estimations), estimates low-order moments of the underlying data distribution with corresponding confidence intervals to learn a distributionally robust model. We specialize our framework to linear regression and normal discriminant analysis, and we provide convergence and performance guarantees. This framework can also be adapted to impute missing data. In numerical experiments, we compare RIFLE to several state-of-the-art approaches (including MICE, Amelia, MissForest, KNN-imputer, MIDA, and Mean Imputer) for imputation and inference in the presence of missing values. Our experiments demonstrate that RIFLE outperforms other benchmark algorithms when the percentage of missing values is high and/or when the number of data points is relatively small. RIFLE is publicly available at https://github.com/optimization-for-data-driven-science/RIFLE.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑