arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.09680stat.MLcs.LGstat.AP
收藏

面向海量医疗数据记录插补的多层随机优化

Multilevel Stochastic Optimization for Imputation in Massive Medical Data Records

Sunovion Pharmaceuticals(Sunovion制药公司);Boston University(波士顿大学)

Wenrui Li, Xiaoyu Wang, Yuetian Sun, Snezana Milanovic, Mark Kon, Julio Enrique Castrillon-Candas

AI总结:

本文提出用多层随机优化解决海量医疗记录缺失值插补,基于 BLUP 的精确多层表述实现快速稳定的 Kriging 插补,并在 NIS 数据上显著优于 HCUP 推荐方法及判别式深度学习。

摘要:

长期以来,许多数据集都包含大量缺失数值数据,这一直是一个公认的问题。将机器学习方法应用于数据集时,一个可能至关重要的前提就是解决这一问题。然而,这是一项具有挑战性的任务。本文将近期发展的多层随机优化方法应用于海量医疗记录中的插补问题。该方法基于计算应用数学技术,具有很高的精度。特别是,对于最佳线性无偏预测量(Best Linear Unbiased Predictor,BLUP),这种多层表述是精确的,并且在速度上显著更快、数值上更稳定。这使得 Kriging 方法能够实际应用于海量数据集的数据插补问题。我们在医疗保健研究与质量局(Agency for Healthcare Research and Quality)、医疗保健成本与利用项目(Healthcare Cost and Utilization Project,HCUP)的全国住院患者样本(National Inpatient Sample,NIS)数据记录上测试了该方法。数值结果表明,多层方法显著优于现有方法,并且具有数值稳健性。与 HCUP 近期报告推荐的方法相比,它具有更高的准确性。基准测试显示,误差最多降低 75%。此外,其结果也优于判别式深度学习等近期最先进方法。

英文摘要:

It has long been a recognized problem that many datasets contain significant levels of missing numerical data. A potentially critical predicate for application of machine learning methods to datasets involves addressing this problem. However, this is a challenging task. In this paper, we apply a recently developed multi-level stochastic optimization approach to the problem of imputation in massive medical records. The approach is based on computational applied mathematics techniques and is highly accurate. In particular, for the Best Linear Unbiased Predictor (BLUP) this multi-level formulation is exact, and is significantly faster and more numerically stable. This permits practical application of Kriging methods to data imputation problems for massive datasets. We test this approach on data from the National Inpatient Sample (NIS) data records, Healthcare Cost and Utilization Project (HCUP), Agency for Healthcare Research and Quality. Numerical results show that the multi-level method significantly outperforms current approaches and is numerically robust. It has superior accuracy as compared with methods recommended in the recent report from HCUP. Benchmark tests show up to 75% reductions in error. Furthermore, the results are also superior to recent state of the art methods such as discriminative deep learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑