使用百分位抽样的自适应科学工作流的触发检测
Trigger detection for adaptive scientific workflows using percentile sampling
摘要:
科学模拟和HPC架构的复杂性日益增加,这推动了对自适应工作流的需求,其中计算和数据操作步骤的组成和执行动态地取决于模拟本身的演变状态。例如,考虑数据存储的频率。模拟的关键阶段应该以高频率和高保真度进行捕获,以进行后期分析,但是由于数据移动的高成本,我们无法为完整模拟保留相同的频率。相反,我们可以寻找触发器,即模拟将进入关键阶段的指示器,并相应地调整工作流程。我们提出了一种检测触发器的方法,并证明其使用直接数值模拟湍流燃烧使用S3 D。我们表明,化学爆炸模式分析(CEMA)可以用来设计一个噪声耐受指标快速增加的热释放。然而,CEMA值的穷举计算占主导地位的总模拟,因此是昂贵的。为了克服这个瓶颈,我们提出了一种分位数抽样方法。我们的算法带有可证明的误差/置信界限,作为样本数量的函数。最重要的是,样本的数量是独立的问题的大小,因此我们提出的算法提供了完美的可扩展性。均质充量压燃(HCCI)和反应性控制压燃(RCCI)模拟实验表明,该方法能够检测到放热的快速增加,且计算开销可以忽略不计。我们的研究结果将用于动态工作流程的数据存储和网格分辨率在未来的燃烧模拟决策。建议的框架是可推广的,我们详细介绍了它如何可以应用到广泛的一类科学模拟工作流程。
英文摘要:
Increasing complexity of scientific simulations and HPC architectures are driving the need for adaptive workflows, where the composition and execution of computational and data manipulation steps dynamically depend on the evolutionary state of the simulation itself. Consider for example, the frequency of data storage. Critical phases of the simulation should be captured with high frequency and with high fidelity for post-analysis, however we cannot afford to retain the same frequency for the full simulation due to the high cost of data movement. We can instead look for triggers, indicators that the simulation will be entering a critical phase and adapt the workflow accordingly. We present a method for detecting triggers and demonstrate its use in direct numerical simulations of turbulent combustion using S3D. We show that chemical explosive mode analysis (CEMA) can be used to devise a noise-tolerant indicator for rapid increase in heat release. However, exhaustive computation of CEMA values dominates the total simulation, thus is prohibitively expensive. To overcome this bottleneck, we propose a quantile-sampling approach. Our algorithm comes with provable error/confidence bounds, as a function of the number of samples. Most importantly, the number of samples is independent of the problem size, thus our proposed algorithm offers perfect scalability. Our experiments on homogeneous charge compression ignition (HCCI) and reactivity controlled compression ignition (RCCI) simulations show that the proposed method can detect rapid increases in heat release, and its computational overhead is negligible. Our results will be used for dynamic workflow decisions about data storage and mesh resolution in future combustion simulations. Proposed framework is generalizable and we detail how it could be applied to a broad class of scientific simulation workflows.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。