arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.13306cs.LGcs.GRcs.HCstat.ML
收藏

科学仿真数据的多变量抽样策略

Relationship-aware Multivariate Sampling Strategy for Scientific Simulation Data

Los Alamos National Laboratory(洛斯阿拉莫斯国家实验室)

Subhashis Hazarika, Ayan Biswas, Phillip J. Wolfram, Earl Lawrence, Nathan Urban

摘要:

随着当前超级计算机计算能力的不断提高,科学模拟产生的数据规模正在迅速增长。为了减少存储占用空间并便于对此类科学数据集进行可扩展的事后分析,多年来已经提出了各种数据缩减/汇总方法。存在不同风格的采样算法来对高分辨率的科学数据进行采样,同时保留后续分析所需的重要数据属性。然而,大多数这些抽样算法是专为单变量数据,并迎合事后分析的单变量。在这项工作中,我们提出了一个多变量抽样策略,它保留了原始变量的关系,使不同的多元分析直接对采样数据。我们提出的策略利用主成分分析来捕获多变量数据的方差,可以建立在任何现有的最先进的单变量采样算法之上。此外,我们还提出了不同的数据分区方案(规则和不规则)的变体,以有效地模拟本地多变量关系。使用两个真实世界的多变量数据集,我们证明了我们提出的多变量抽样策略的有效性,其数据减少的能力,以及易于执行有效的事后多变量分析。

英文摘要:

With the increasing computational power of current supercomputers, the size of data produced by scientific simulations is rapidly growing. To reduce the storage footprint and facilitate scalable post-hoc analyses of such scientific data sets, various data reduction/summarization methods have been proposed over the years. Different flavors of sampling algorithms exist to sample the high-resolution scientific data, while preserving important data properties required for subsequent analyses. However, most of these sampling algorithms are designed for univariate data and cater to post-hoc analyses of single variables. In this work, we propose a multivariate sampling strategy which preserves the original variable relationships and enables different multivariate analyses directly on the sampled data. Our proposed strategy utilizes principal component analysis to capture the variance of multivariate data and can be built on top of any existing state-of-the-art sampling algorithms for single variables. In addition, we also propose variants of different data partitioning schemes (regular and irregular) to efficiently model the local multivariate relationships. Using two real-world multivariate data sets, we demonstrate the efficacy of our proposed multivariate sampling strategy with respect to its data reduction capabilities as well as the ease of performing efficient post-hoc multivariate analyses.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑