教神经模块网络做算术
Teaching Neural Module Networks to Do Arithmetic
摘要:
在原始文本上处理需要多步多类型推理的复杂问题是具有挑战性的,特别是在进行数值推理时。神经模块网络(NMN)遵循程序员-解释器框架,设计可训练的模块来学习不同的推理技能。然而,NMNs只有有限的推理能力,并缺乏数值推理能力。我们通过以下方式对NMN进行升级:(a)在其解释者和复杂问题之间架起桥梁;(b)引入加法和减法模块,对数字进行数值推理。在DROP的一个子集上,实验结果表明,我们提出的方法提高了NMN的数值推理能力,F1分数提高了17.7%,并且显着优于以前的最先进的模型。
英文摘要:
Answering complex questions that require multi-step multi-type reasoning over raw text is challenging, especially when conducting numerical reasoning. Neural Module Networks(NMNs), follow the programmer-interpreter framework and design trainable modules to learn different reasoning skills. However, NMNs only have limited reasoning abilities, and lack numerical reasoning capability. We up-grade NMNs by: (a) bridging the gap between its interpreter and the complex questions; (b) introducing addition and subtraction modules that perform numerical reasoning over numbers. On a subset of DROP, experimental results show that our proposed methods enhance NMNs' numerical reasoning skills by 17.7% improvement of F1 score and significantly outperform previous state-of-the-art models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。