arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.08232cs.AIcs.CL
收藏

LogicSolver:通过逻辑推理增强学习实现可解释的数学应用题解决

LogicSolver: Towards Interpretable Math Word Problem Solving with Logical Prompt-enhanced Learning

Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Sun Yat-sen University(中山大学);Guangdong University of Technology(广东工业大学);Dark Matter AI Inc.(暗物质人工智能公司)

Zhicheng Yang, Jinghui Qin, Jiaqi Chen, Liang Lin, Xiaodan Liang

摘要:

最近,深度学习模型在MWP求解中在答案准确性上取得了很大进展。然而,它们是不可解释的,因为它们主要依赖于浅层数学来实现高性能,而不理解和推理基础的数学逻辑。为了解决这个问题并向可解释的MWP求解迈出一步,我们首先构建了一个名为InterMWP的高质量MWP数据集,该数据集由11,495个MWP组成,并基于代数知识注释了可解释的逻辑公式,作为每个解方程的基础语言逻辑。与现有的MWP数据集不同,我们的InterMWP基准要求求解器不仅要输出解表达式,还要预测相应的逻辑公式。我们进一步提出了一种新的方法与逻辑提示和解释生成,称为LogicSolver。对于每个MWP,我们的LogicSolver首先检索一些高度相关的代数知识,然后将它们传递给主干模型作为提示,以改进MWP的语义表示。有了这些改进的语义表示,我们的LogicSolver生成相应的解决方案表达式和可解释的知识公式,根据所生成的解决方案表达式,同时。实验结果表明,我们的LogicSolver具有更强的基于逻辑公式的可解释性比基线,同时实现更高的答案准确性与逻辑提示的帮助下,同时。源代码和数据集可在https://github.com/yangzhch6/InterMWP上获得。

英文摘要:

Recently, deep learning models have made great progress in MWP solving on answer accuracy. However, they are uninterpretable since they mainly rely on shallow heuristics to achieve high performance without understanding and reasoning the grounded math logic. To address this issue and make a step towards interpretable MWP solving, we first construct a high-quality MWP dataset named InterMWP which consists of 11,495 MWPs and annotates interpretable logical formulas based on algebraic knowledge as the grounded linguistic logic of each solution equation. Different from existing MWP datasets, our InterMWP benchmark asks for a solver to not only output the solution expressions but also predict the corresponding logical formulas. We further propose a novel approach with logical prompt and interpretation generation, called LogicSolver. For each MWP, our LogicSolver first retrieves some highly-correlated algebraic knowledge and then passes them to the backbone model as prompts to improve the semantic representations of MWPs. With these improved semantic representations, our LogicSolver generates corresponding solution expressions and interpretable knowledge formulas in accord with the generated solution expressions, simultaneously. Experimental results show that our LogicSolver has stronger logical formula-based interpretability than baselines while achieving higher answer accuracy with the help of logical prompts, simultaneously. The source code and dataset is available at https://github.com/yangzhch6/InterMWP.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑