arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.10652cs.LGcs.PL
收藏

面向科学计算的Fortransan-Keras深度学习桥梁

A Fortran-Keras Deep Learning Bridge for Scientific Computing

University of California, Irvine(加州大学尔湾分校);Chapman University(查普曼大学);University of Miami(迈阿密大学)

Jordan Ott, Mike Pritchard, Natalie Best, Erik Linstead, Milan Curcic, Pierre Baldi

摘要:

实现人工神经网络通常是通过Python等高级程序设计语言和Keras等易于使用的深度学习库来实现的。这些软件库预装了各种网络架构,提供自动微分功能,并支持GPU进行快速高效的计算。因此,深度学习从业者将倾向于用Python训练神经网络模型,因为这些工具很容易获得。然而,许多大型科学计算项目都是用Fortran编写的,这使得它很难与现代深度学习方法集成。为了缓解这个问题,我们引入了一个软件库,即Fortran-Keras Bridge(FKB)。这种双向桥梁将深度学习资源丰富的环境与资源稀缺的环境连接起来。本文介绍了FKB提供的几个独特功能,如可定制的层,损失函数和网络集成。最后,本文的案例研究,适用于FKB解决开放的问题的鲁棒性的实验方法,全球气候模拟,其中亚网格物理外包给深神经网络仿真器。在这种情况下,FKB可以对100多个亚网格云和辐射物理学候选模型进行超参数搜索,这些模型最初在Keras中实现,然后在Fortran中传输和使用。这样一个过程允许模型的紧急行为进行评估,即当拟合缺陷耦合到明确的行星尺度流体动力学。结果揭示了离线验证错误和在线性能之间先前未被认识到的强关系,其中优化器的选择被证明是意想不到的关键。这揭示了许多神经网络架构,这些架构在稳定性方面产生了相当大的改进,包括一些减少了错误,对于一个特别具有挑战性的训练数据集。

英文摘要:

Implementing artificial neural networks is commonly achieved via high-level programming languages like Python and easy-to-use deep learning libraries like Keras. These software libraries come pre-loaded with a variety of network architectures, provide autodifferentiation, and support GPUs for fast and efficient computation. As a result, a deep learning practitioner will favor training a neural network model in Python, where these tools are readily available. However, many large-scale scientific computation projects are written in Fortran, making it difficult to integrate with modern deep learning methods. To alleviate this problem, we introduce a software library, the Fortran-Keras Bridge (FKB). This two-way bridge connects environments where deep learning resources are plentiful, with those where they are scarce. The paper describes several unique features offered by FKB, such as customizable layers, loss functions, and network ensembles. The paper concludes with a case study that applies FKB to address open questions about the robustness of an experimental approach to global climate simulation, in which subgrid physics are outsourced to deep neural network emulators. In this context, FKB enables a hyperparameter search of one hundred plus candidate models of subgrid cloud and radiation physics, initially implemented in Keras, to be transferred and used in Fortran. Such a process allows the model's emergent behavior to be assessed, i.e. when fit imperfections are coupled to explicit planetary-scale fluid dynamics. The results reveal a previously unrecognized strong relationship between offline validation error and online performance, in which the choice of optimizer proves unexpectedly critical. This reveals many neural network architectures that produce considerable improvements in stability including some with reduced error, for an especially challenging training dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑