arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2011.04044cs.CLcs.AI

Exploring End-to-End Differentiable Natural Logic Modeling

Queen’s University(女王大学);Ingenuity Labs Research Institute(Ingenuity Labs研究院);iFLYTEK Research(科大讯飞研究院);State Key Laboratory of Cognitive Intelligence(认知智能全国重点实验室)

Yufei Feng, Zi'ou Zheng, Quan Liu, Michael Greenspan, Xiaodan Zhu

英文摘要:

We explore end-to-end trained differentiable models that integrate natural logic with neural networks, aiming to keep the backbone of natural language reasoning based on the natural logic formalism while introducing subsymbolic vector representations and neural components. The proposed model adapts module networks to model natural logic operations, which is enhanced with a memory component to model contextual information. Experiments show that the proposed framework can effectively model monotonicity-based reasoning, compared to the baseline neural network models without built-in inductive bias for monotonicity-based reasoning. Our proposed model shows to be robust when transferred from upward to downward inference. We perform further analyses on the performance of the proposed model on aggregation, showing the effectiveness of the proposed subcomponents on helping achieve better intermediate aggregation performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑