机器学习流体模拟的网络压缩
Network Compression for Machine-Learnt Fluid Simulations
摘要:
多尺度、多保真度的数值模拟是流体数值建模相关科学应用的支柱。然而,模拟由非线性纳维-斯托克斯方程表征的流体行为通常是计算昂贵的。物理信息机器学习方法是一种可行的替代方法,因此在社区中引起了极大的兴趣[参考Kutz(2017); Brunton et al.(2020); Duraisamy et al.(2019)关于这个主题的详细评论]。对于完整的物理仿真器,网络推理的成本往往微不足道。然而,在当前数据驱动的流体力学范例中,模型被构建为复杂子过程的替代物。然后将这些模型与Navier Stokes求解器结合使用,这使得ML模型推理成为算法延迟方面的一个重要因素。随着网络规模的不断增长,并且经常过度参数化,探索有效的网络压缩技术不仅与工程系统设计相关,而且至关重要。在这项研究中,我们探讨了修剪和量化(FP 32到int 8)方法的适用性,这样一个应用程序相关的建模流体湍流。压缩后,我们通过将压缩后的网络状态与原始网络状态进行比较,证明了网络预测准确性的提高,并在此过程中建立了直观性。
英文摘要:
Multi-scale, multi-fidelity numerical simulations form the pillar of scientific applications related to numerically modeling fluids. However, simulating the fluid behavior characterized by the non-linear Navier Stokes equations are often times computational expensive. Physics informed machine learning methods is a viable alternative and as such has seen great interest in the community [refer to Kutz (2017); Brunton et al. (2020); Duraisamy et al. (2019) for a detailed review on this topic]. For full physics emulators, the cost of network inference is often trivial. However, in the current paradigm of data-driven fluid mechanics models are built as surrogates for complex sub-processes. These models are then used in conjunction to the Navier Stokes solvers, which makes ML model inference an important factor in the terms of algorithmic latency. With the ever growing size of networks, and often times overparameterization, exploring effective network compression techniques becomes not only relevant but critical for engineering systems design. In this study, we explore the applicability of pruning and quantization (FP32 to int8) methods for one such application relevant to modeling fluid turbulence. Post-compression, we demonstrate the improvement in the accuracy of network predictions and build intuition in the process by comparing the compressed to the original network state.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。