arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.10370cs.PL
收藏

Passport:利用标识符改进自动化形式验证

Passport: Improving Automated Formal Verification Using Identifiers

Alex Sanchez-Stern, Emily First, Timothy Zhou, Zhanna Kaufman, Yuriy Brun, Talia Ringer

AI总结:

本文提出全自动证明合成工具 Passport,通过类别词汇索引、子词序列建模和路径展开三种标识符编码机制增强 Coq 模型,实验表明其能显著提升自动证明定理数量,证明对标识符建模可有效改进证明合成与软件质量。

摘要:

形式化验证系统性质是提高系统质量的最有效方法之一,但其高昂的人工工作量往往使其成本过高。通过学习证明语料库来建议证明的自动化形式验证工具刚刚开始展现其潜力。这些工具之所以有效,是因为证明语料库所包含的数据非常丰富。这种丰富性来自证明开发者社区遵循的风格惯例,以及证明助手背后的逻辑系统。然而,这种丰富性仍未得到充分利用,迄今为止大多数工作侧重于架构,而不是充分利用证明数据。在本文中,我们开发了 Passport,一个全自动证明合成工具,它系统地探索如何最有效地利用证明数据的一个方面:标识符。Passport 通过三种新的标识符编码机制来增强预测性 Coq 模型:类别词汇索引、子词序列建模和路径展开。我们将 Passport 与它可以增强的三个现有基础工具进行了比较:ASTactic、Tac 和 Tok。在直接对比中,Passport 自动证明的定理比这些基础工具中表现最好的多 29%。将三个经 Passport 增强的工具组合起来,自动证明的定理比三个基础工具合计多 38%,且无需 Passport 的增强。最后,这些基础工具和经 Passport 增强的工具一起,比未使用 Passport 增强的组合基础工具多证明了 45% 的定理。总体而言,我们的发现表明,对标识符建模可以在改进证明合成方面发挥重要作用,从而带来更高质量的软件。

英文摘要:

Formally verifying system properties is one of the most effective ways of improving system quality, but its high manual effort requirements often render it prohibitively expensive. Tools that automate formal verification, by learning from proof corpora to suggest proofs, have just begun to show their promise. These tools are effective because of the richness of the data the proof corpora contain. This richness comes from the stylistic conventions followed by communities of proof developers, together with the logical systems beneath proof assistants. However, this richness remains underexploited, with most work thus far focusing on architecture rather than making the most of the proof data. In this paper, we develop Passport, a fully-automated proof-synthesis tool that systematically explores how to most effectively exploit one aspect of that proof data: identifiers. Passport enriches a predictive Coq model with three new encoding mechanisms for identifiers: category vocabulary indexing, subword sequence modeling, and path elaboration. We compare Passport to three existing base tools which Passport can enhance: ASTactic, Tac, and Tok. In head-to-head comparisons, Passport automatically proves 29% more theorems than the best-performing of these base tools. Combining the three Passport-enhanced tools automatically proves 38% more theorems than the three base tools together, without Passport's enhancements. Finally, together, these base tools and Passport-enhanced tools prove 45% more theorems than the combined base tools without Passport's enhancements. Overall, our findings suggest that modeling identifiers can play a significant role in improving proof synthesis, leading to higher-quality software.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑