混合数据的多级奇异值分解插补
Imputation of mixed data with multilevel singular value decomposition
摘要:
大型数据集的统计分析为更好地理解许多过程提供了新的机会。然而,数据积累往往意味着放松获取程序或将各种来源混合起来。因此,这类数据集往往包含混合数据,即数量和质量数据以及许多缺失值。此外,聚合数据呈现自然的\textit{multilevel}结构,其中个体或样本嵌套在不同的站点(例如国家或医院)内。因此,多级数据的插补最近引起了一些关注,但目前的解决方案并没有被设计为处理混合数据,并遭受重要的缺点,如它们的计算成本。本文提出了一种适用于多水平数据的单次插补方法,该方法可用于完成定量、分类或混合数据。该方法是基于多层次奇异值分解(SVD),其中包括在分解成两个组成部分,组间和组内的变异性的数据的变异性,并执行SVD的两个部分。我们的模拟研究表明,与竞争对手相比,该方法具有很大的优势,处理各种大小的数据集,计算速度更快。此外,它是迄今为止第一个处理混合数据的系统。我们应用该方法来填补一个医疗数据集来自不同医院的几个数据集的聚合。该应用程序属于一个更大的创伤患者项目的框架。为了克服与医疗数据聚合相关的障碍,我们转向分布式计算。该方法在R包中实现。
英文摘要:
Statistical analysis of large data sets offers new opportunities to better understand many processes. Yet, data accumulation often implies relaxing acquisition procedures or compounding diverse sources. As a consequence, such data sets often contain mixed data, i.e. both quantitative and qualitative and many missing values. Furthermore, aggregated data present a natural \textit{multilevel} structure, where individuals or samples are nested within different sites, such as countries or hospitals. Imputation of multilevel data has therefore drawn some attention recently, but current solutions are not designed to handle mixed data, and suffer from important drawbacks such as their computational cost. In this article, we propose a single imputation method for multilevel data, which can be used to complete either quantitative, categorical or mixed data. The method is based on multilevel singular value decomposition (SVD), which consists in decomposing the variability of the data into two components, the between and within groups variability, and performing SVD on both parts. We show on a simulation study that in comparison to competitors, the method has the great advantages of handling data sets of various size, and being computationally faster. Furthermore, it is the first so far to handle mixed data. We apply the method to impute a medical data set resulting from the aggregation of several data sets coming from different hospitals. This application falls in the framework of a larger project on Trauma patients. To overcome obstacles associated to the aggregation of medical data, we turn to distributed computation. The method is implemented in an R package.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。