arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.13432cs.DCcs.PL
收藏

使大代码库的根本原因分析可行:气候模型的解决方案

Making root cause analysis feasible for large code bases: a solution approach for a climate model

Daniel J. Milroy, Allison H. Baker, Dorit M. Hammerling, Youngsung Kim, Elizabeth R. Jessup, Thomas Hauser

摘要:

对于具有巨大且复杂的代码库的大规模仿真代码,其中逐位比较过于限制,找到统计上显著差异的来源(例如,来自先前版本、替代硬件或支持软件栈)在输出中最多是不平凡的。虽然有许多工具通过调试或切片来理解程序,但很少(如果有的话)能扩展到像社区地球系统模型(CESM;注册商标)这样大的模型,该模型由超过150万行Fortran代码组成。目前,对于CESM,我们可以很容易地确定是否存在差异,在输出使用一个现在已经建立良好的统计一致性测试工具。然而,这个工具没有提供关于检测到的差异的可能原因的信息,这让开发人员处于一个看似不可能(和令人沮丧)的境地。因此,我们在这项工作中的目标是提供工具,使开发人员能够跟踪通过CESM输出检测到的问题的来源。为此,我们的策略是通过一系列技术将根本原因的搜索空间减少到易于处理的大小,这些技术包括创建内部CESM变量的有向图,提取子图(使用混合程序切片的形式),划分为社区,并按中心性对节点进行排名。然后,在该减小的搜索空间中,可变采样变得可行。我们演示了这个过程的效用CESM仿真输出的多个例子,说明如何采样可以作为一个有效的并行迭代细化过程的一部分,以定位误差源,包括CPU指令的敏感性。通过为CESM开发人员提供工具来识别和理解统计上不同的输出的原因,我们对CESM软件开发周期产生了积极的影响,特别是对质量保证的关注。

英文摘要:

For large-scale simulation codes with huge and complex code bases, where bit-for-bit comparisons are too restrictive, finding the source of statistically significant discrepancies (e.g., from a previous version, alternative hardware or supporting software stack) in output is non-trivial at best. Although there are many tools for program comprehension through debugging or slicing, few (if any) scale to a model as large as the Community Earth System Model (CESM; trademarked), which consists of more than 1.5 million lines of Fortran code. Currently for the CESM, we can easily determine whether a discrepancy exists in the output using a by now well-established statistical consistency testing tool. However, this tool provides no information as to the possible cause of the detected discrepancy, leaving developers in a seemingly impossible (and frustrating) situation. Therefore, our aim in this work is to provide the tools to enable developers to trace a problem detected through the CESM output to its source. To this end, our strategy is to reduce the search space for the root cause(s) to a tractable size via a series of techniques that include creating a directed graph of internal CESM variables, extracting a subgraph (using a form of hybrid program slicing), partitioning into communities, and ranking nodes by centrality. Runtime variable sampling then becomes feasible in this reduced search space. We demonstrate the utility of this process on multiple examples of CESM simulation output by illustrating how sampling can be performed as part of an efficient parallel iterative refinement procedure to locate error sources, including sensitivity to CPU instructions. By providing CESM developers with tools to identify and understand the reason for statistically distinct output, we have positively impacted the CESM software development cycle and, in particular, its focus on quality assurance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑