大规模环境数据科学与ExaGeoStatR
Large-scale Environmental Data Science with ExaGeoStatR
摘要:
高斯过程计算中的并行计算对于避免与大规模环境数据科学应用相关的计算和内存限制变得必要。计算高斯对数似然函数需要O(n^2)存储和O(n^3)操作,其中n是地理位置的数量。因此,计算具有大量位置的对数似然函数需要利用现有并行计算硬件系统的能力来解决该计算复杂性,所述并行计算硬件系统诸如可能配备有GPU的共享存储器和分布式存储器系统。在本文中,我们提倡使用ExaGeoStatR,一个包exascale地质统计学在R中,支持并行计算的精确最大似然函数的各种并行架构。ExaGeoStatR中的并行化依赖于将对数似然函数中的数值线性代数运算分解为一组任务,并将其渲染为基于任务的编程模型。该包可以直接通过R环境在并行系统上使用。目前,ExaGeoStatR支持几种最大似然计算变体,例如精确、对角超级瓦片(DST)、瓦片低秩(TLR)近似和混合精度(MP)。ExaGeoStatR还提供了一个模拟大规模合成数据集的工具。这些数据集可以帮助评估最大对数似然近似方法的不同实现。在这里,我们展示了ExaGeoStatR的实现细节,分析了它在各种并行架构上的性能,并使用具有高达250K观测值的合成数据集评估了它的准确性。我们提供了一个动手教程来分析海表温度真实数据集。性能评估涉及与流行的软件包geoR和字段进行比较,以进行精确的似然评估。
英文摘要:
Parallel computing in Gaussian process calculations becomes necessary for avoiding computational and memory restrictions associated with large-scale environmental data science applications. The evaluation of the Gaussian log-likelihood function requires O(n^2) storage and O(n^3) operations where n is the number of geographical locations. Thus, computing the log-likelihood function with a large number of locations requires exploiting the power of existing parallel computing hardware systems, such as shared-memory, possibly equipped with GPUs, and distributed-memory systems, to solve this computational complexity. In this paper, we advocate the use of ExaGeoStatR, a package for exascale Geostatistics in R that supports a parallel computation of the exact maximum likelihood function on a wide variety of parallel architectures. Parallelization in ExaGeoStatR depends on breaking down the numerical linear algebra operations in the log-likelihood function into a set of tasks and rendering them for a task-based programming model. The package can be used directly through the R environment on parallel systems. Currently, ExaGeoStatR supports several maximum likelihood computation variants such as exact, Diagonal Super Tile (DST), Tile Low-Rank (TLR) approximations, and Mixed-Precision (MP). ExaGeoStatR also provides a tool to simulate large-scale synthetic datasets. These datasets can help to assess different implementations of the maximum log-likelihood approximation methods. Here, we demonstrate ExaGeoStatR by illustrating its implementation details, analyzing its performance on various parallel architectures, and assessing its accuracy using synthetic datasets with up to 250K observations. We provide a hands-on tutorial to analyze a sea surface temperature real dataset. The performance evaluation involves comparisons with the popular packages geoR and fields for exact likelihood evaluation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。