arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.06958cs.CEphysics.comp-ph
收藏

基于时变基的瞬态模拟数据可伸缩原位压缩

Scalable In Situ Compression of Transient Simulation Data Using Time-Dependent Bases

Shaghayegh Zamani Ashtiani, Mujeeb R. Malik, Hessam Babaee

摘要:

大规模的时间依赖性问题的模拟产生了大量的数据,随着计算资源的爆炸性增加,这些模拟产生的数据的大小显着增加。这对可以存储的数据量施加了严重的限制,并且将输入/输出(I/O)问题提升为高性能计算的主要瓶颈之一。在这项工作中,我们提出了一种原位压缩技术,以减少数量级的数据存储的大小。该方法基于时间相关子空间,通过将数据分解为一组时间相关基和一个核张量,从多维流数据中提取低秩结构。我们推导出封闭形式的核心张量以及随时间变化的基础的演化方程。所提出的方法不需要数据历史,其提取的计算成本与数据大小呈线性关系-使其适用于大规模流数据集。为了控制压缩误差,我们提出了一种自适应策略来添加/删除模式,以将重建误差保持在给定阈值以下。我们提出了四个演示案例:(i)分析的例子,(ii)不可压缩的非定常反应流,(iii)随机湍流反应流,(iv)三维湍流槽道流。

英文摘要:

Large-scale simulations of time-dependent problems generate a massive amount of data and with the explosive increase in computational resources the size of the data generated by these simulations has increased significantly. This has imposed severe limitations on the amount of data that can be stored and has elevated the issue of input/output (I/O) into one of the major bottlenecks of high-performance computing. In this work, we present an in situ compression technique to reduce the size of the data storage by orders of magnitude. This methodology is based on time-dependent subspaces and it extracts low-rank structures from multidimensional streaming data by decomposing the data into a set of time-dependent bases and a core tensor. We derive closed-form evolution equations for the core tensor as well as the time-dependent bases. The presented methodology does not require the data history and the computational cost of its extractions scales linearly with the size of data -- making it suitable for large-scale streaming datasets. To control the compression error, we present an adaptive strategy to add/remove modes to maintain the reconstruction error below a given threshold. We present four demonstration cases: (i) analytical example, (ii) incompressible unsteady reactive flow, (iii) stochastic turbulent reactive flow, and (iv) three-dimensional turbulent channel flow.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑