融合、推理与验证:利用从图中解析的子句求解几何问题
Fuse, Reason and Verify: Geometry Problem Solving with Parsed Clauses from Diagram
AI总结:
针对几何问题求解的多模态理解与推理需求,提出含模态融合、自受限推理、多级验证的神经符号模型PGPSNet-v2,构建PGPS9K数据集,实验显示其性能优于现有求解器且各组件有效。
摘要:
几何问题求解(GPS)需要多模态理解、多跳推理和定理知识应用的能力。本文提出了一种用于平面几何问题求解(PGPS)的神经符号模型,名为PGPSNet-v2,包含三个关键步骤:模态融合、推理过程和知识验证。在模态融合阶段,我们利用文本子句表达几何图的细粒度结构与语义内容,并通过结构-语义预训练将图与文本问题高效融合。推理阶段,我们设计了可解释的求解程序来描述几何推理过程,并采用自受限解码器以自回归方式生成求解程序。为减少求解错误,我们提出了多级定理验证器,用于剔除不符合几何原理的解,缓解神经模型的幻觉问题。我们还构建了一个名为PGPS9K的大规模几何问题数据集,包含文本子句、求解程序和涉及的知识元组的细粒度标注。在Geometry3K和PGPS9K数据集上的大量实验表明,我们的PGPSNet求解器在GPS性能上优于现有的符号求解器和神经求解器,同时保持了良好的可解释性和可靠性,且求解器的各组件(融合、推理、验证)均被证明有效。
英文摘要:
Geometry problem solving (GPS) requires capacities of multi-modal understanding, multi-hop reasoning and theorem knowledge application. In this paper, we propose a neural-symbolic model for plane geometry problem solving (PGPS), named PGPSNet-v2, with three key steps: modal fusion, reasoning process and knowledge verification. In modal fusion, we leverage textual clauses to express fine-grained structural and semantic content of geometry diagram, and fuse diagram with textual problem efficiently through structural-semantic pre-training. For reasoning, we design an explicable solution program to describe the geometric reasoning process, and employ a self-limited decoder to generate solution program autoregressively. To reduce solution errors, a multi-level theorem verifier is proposed to eliminate solutions that do not match geometric principles, alleviating the hallucination of the neural model. We also construct a large-scale geometry problem dataset called PGPS9K, containing fine-grained annotations of textual clauses, solution program and involved knowledge tuples. Extensive experiments on datasets Geometry3K and PGPS9K show that our PGPSNet solver outperforms existing symbolic and neural solvers in GPS performance, while maintaining good explainability and reliability, and the solver components (fusion, reasoning, verification) are all justified effective.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。