arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.10486cs.LOcs.IRcs.LG
收藏

CoProver:一个用于证明构造的推荐系统

CoProver: A Recommender System for Proof Construction

SRI International(国际斯坦福研究所)

Eric Yeh, Briland Hitaj, Sam Owre, Maena Quemener, Natarajan Shankar

AI总结:

本文提出基于 transformer 的证明推荐系统 CoProver,结合 PVS,从历史证明动作和理论库中学习,以推荐下一证明动作并检索相关引理,性能超越先前最先进方法。

摘要:

交互式定理证明器(ITP)是形式化方法专家工具库中不可或缺的工具,作为构造和(形式化)验证证明的平台。证明的复杂性,加上该过程成功通常所需的专业水平,往往会阻碍 ITP 的采用。最近一系列工作研究了将基于 ITP 用户活动轨迹训练的机器学习模型纳入其中的方法,将其作为实现完全自动化的可行路径。尽管这是一条有价值的研究路线,但许多问题仍需人工监督才能完全完成,因此应用学习方法以有用的推荐来协助用户可能更有成效。遵循用户辅助的思路,我们推出了 CoProver,这是一个基于 transformer 的证明推荐系统,能够从证明构造过程中的过往动作中学习,同时探索 ITP 中存储的有关先前证明的知识。CoProver 采用神经学习的、基于序列的相继式编码,捕捉词项之间的长距离关系以及其中隐藏的线索。我们将 CoProver 与 Prototype Verification System(PVS)结合,并在两个关键领域评估其性能,即:(1)下一证明动作推荐,以及(2)给定理论库的相关引理检索。我们分别使用源自推荐系统和信息检索社区的一系列成熟指标评估 CoProver。我们表明,CoProver 成功优于先前应用于该领域推荐任务的最先进方法。最后,我们讨论了 CoProver(及类似方法)可行的未来方向,例如参数预测、证明摘要等。

英文摘要:

Interactive Theorem Provers (ITPs) are an indispensable tool in the arsenal of formal method experts as a platform for construction and (formal) verification of proofs. The complexity of the proofs in conjunction with the level of expertise typically required for the process to succeed can often hinder the adoption of ITPs. A recent strain of work has investigated methods to incorporate machine learning models trained on ITP user activity traces as a viable path towards full automation. While a valuable line of investigation, many problems still require human supervision to be completed fully, thus applying learning methods to assist the user with useful recommendations can prove more fruitful. Following the vein of user assistance, we introduce CoProver, a proof recommender system based on transformers, capable of learning from past actions during proof construction, all while exploring knowledge stored in the ITP concerning previous proofs. CoProver employs a neurally learnt sequence-based encoding of sequents, capturing long distance relationships between terms and hidden cues therein. We couple CoProver with the Prototype Verification System (PVS) and evaluate its performance on two key areas, namely: (1) Next Proof Action Recommendation, and (2) Relevant Lemma Retrieval given a library of theories. We evaluate CoProver on a series of well-established metrics originating from the recommender system and information retrieval communities, respectively. We show that CoProver successfully outperforms prior state of the art applied to recommendation in the domain. We conclude by discussing future directions viable for CoProver (and similar approaches) such as argument prediction, proof summarization, and more.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑