arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.05357cs.LG
收藏

基于注意力的机器学习方法用于具有保证误差界限的数据约简

Attention Based Machine Learning Methods for Data Reduction with Guaranteed Error Bounds

University of Florida(佛罗里达大学)

Xiao Li, Jaemoon Lee, Anand Rangarajan, Sanjay Ranka

AI总结:

针对科学模拟数据的时空与变量间相关性,本文提出注意力超块自编码器、分块编码器及PCA误差保证后处理的分层压缩框架,在S3D、E3SM和XGC上显著优于SZ3。

摘要:

高能物理、计算流体动力学和气候科学等领域的科学应用以高速率生成海量数据。数据生产的这种指数级增长正在超越计算能力、网络能力和存储容量的进步。为应对这一挑战,数据压缩或约简技术至关重要。这些科学数据集具有由结构化和块结构化多维网格组成的底层数据结构,其中每个网格点对应一个张量。数据约简技术必须利用这些应用中普遍存在的强空间和时间相关性,这一点十分重要。此外,CFD等应用会处理在每个网格点包含一百多种组分及其属性的张量。约简技术应能够利用每个张量中各元素之间的相互关系。本文提出一种基于注意力的分层压缩方法,采用分块压缩设置。我们引入一种基于注意力的超块自编码器来捕获块间相关性,随后使用分块编码器捕获块特定信息。采用基于PCA的后处理步骤来保证每个数据块的误差界限。该方法有效捕获数据块内部和之间的时空及变量间相关性。与最先进的SZ3相比,本方法在多变量S3D数据集上实现最高8倍的压缩比。在使用E3SM和XGC数据集的单变量设置上评估时,本方法仍分别实现最高3倍和2倍的压缩比。

英文摘要:

Scientific applications in fields such as high energy physics, computational fluid dynamics, and climate science generate vast amounts of data at high velocities. This exponential growth in data production is surpassing the advancements in computing power, network capabilities, and storage capacities. To address this challenge, data compression or reduction techniques are crucial. These scientific datasets have underlying data structures that consist of structured and block structured multidimensional meshes where each grid point corresponds to a tensor. It is important that data reduction techniques leverage strong spatial and temporal correlations that are ubiquitous in these applications. Additionally, applications such as CFD, process tensors comprising hundred plus species and their attributes at each grid point. Reduction techniques should be able to leverage interrelationships between the elements in each tensor. In this paper, we propose an attention-based hierarchical compression method utilizing a block-wise compression setup. We introduce an attention-based hyper-block autoencoder to capture inter-block correlations, followed by a block-wise encoder to capture block-specific information. A PCA-based post-processing step is employed to guarantee error bounds for each data block. Our method effectively captures both spatiotemporal and inter-variable correlations within and between data blocks. Compared to the state-of-the-art SZ3, our method achieves up to 8 times higher compression ratio on the multi-variable S3D dataset. When evaluated on single-variable setups using the E3SM and XGC datasets, our method still achieves up to 3 times and 2 times higher compression ratio, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑