arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2511.09008cs.CLcs.AIcs.LGcs.LO
收藏

一种用于自然语言形式化和验证的神经符号方法

A Neurosymbolic Approach to Natural Language Formalization and Verification

Amazon Web Services(亚马逊网络服务);University College London(伦敦大学学院);University of Toronto(多伦多大学);Queen Mary University of London(伦敦大学女王学院)
Chenyang An, Sam Bayless, Stefano Buliani, Darion Cassel, Byron Cook, Duncan Clough, Rémi Delmas, Nafi Diallo, Ferhat Erata, Nick Feng, Dimitra Giannakopoulou, … 展开作者

Chenyang An, Sam Bayless, Stefano Buliani, Darion Cassel, Byron Cook, Duncan Clough, Rémi Delmas, Nafi Diallo, Ferhat Erata, Nick Feng, Dimitra Giannakopoulou, Aman Goel, Aditya Gokhale, Joe Hendrix, Victor Heorhiadi, Marc Hudak, Dejan Jovanović, Andrew M. Kent, Benjamin Kiesl-Reiter, Jeffrey J. Kuna, Nadia Labai, Joseph Lilien, Divya Raghunathan, Zvonimir Rakamarić, Niloofar Razavi, Michael Tautschnig, Ali Torkamani, Nathaniel Weir, Michael W. Whalen, Jianan Yao

AI总结:

针对大型语言模型缺乏形式正确性保证的问题,提出神经符号方法ARc,通过使用带人工指导的大型语言模型形式化自然语言政策,并在推理时验证逻辑正确性,实现高健全性和低误报率,还能产生可审计工件。

摘要:

大型语言模型在自然语言解释和推理方面表现出色,但缺乏形式正确性保证限制了它们在金融和医疗等受严格政策监管行业的应用。为解决这一限制,我们推出了自动推理检查(ARc):一项公共服务,它(1)使用带有可选人工指导的大型语言模型来形式化自然语言政策,实现对形式化过程的细粒度控制,(2)在推理时使用推理时自动形式化来根据这些政策验证自然语言语句的逻辑正确性。ARc在推理时执行多个冗余形式化步骤,检查形式化的语义等价性。我们的基准测试表明,ARc的健全性超过99%,在识别逻辑有效性方面实现了近乎零的误报率。我们的方法产生可审计的工件,证实验证结果并可用于改进原始文本。ARc是主要云提供商首次将自动推理集成到生成式人工智能护栏中的商业产品。

英文摘要:

Large Language Models perform well at natural language interpretation and reasoning, but their lack of formal correctness guarantees limits their adoption in regulated industries like finance and health-care that operate under strict policies. To address this limitation, we launched Automated Reasoning checks (ARc): a public service that (1) uses LLMs with optional human guidance to formalize natural language policies, allowing fine-grained control of the formalization process, and (2) uses inference-time autoformalization to validate logical correctness of natural language statements against those policies. ARc performs multiple redundant formalization steps at inference time, checking the formalizations for semantic equivalence. Our benchmarks show that ARc exceeds 99% soundness and achieves a near-zero false positive rate in identifying logical validity. Our approach produces auditable artifacts that substantiate the verification outcomes and can be used to improve the original text. ARc is the first commercial offering from a major cloud provider to integrate automated reasoning into a generative AI guardrail.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑