神经NLI模型中上下文单调性抽象的支持
Supporting Context Monotonicity Abstractions in Neural NLI Models
摘要:
自然语言语境显示了关于相关概念替换的逻辑冲突:这些被捕获在称为单调性的函数序理论属性中。对于某一类NLI问题,其中所产生的蕴涵标签仅取决于上下文单调性和替代概念之间的关系,我们建立在以前的技术,旨在提高这些问题的NLI模型的性能,因为即使对于最先进的模型,在向上和向下单调的上下文中的一致性能似乎仍然很难达到。为此,我们重新定义了上下文单调性分类的问题,使其与基于transformer的预训练NLI模型兼容,并将此任务添加到训练管道中。此外,我们介绍了一个健全的和完整的简化单调性逻辑形式主义,它描述了我们的处理上下文作为抽象单位。使用我们的形式主义中的概念,我们适应有针对性的挑战集,以调查是否中间上下文单调性分类任务可以帮助NLI模型的表现表现单调性推理的例子。
英文摘要:
Natural language contexts display logical regularities with respect to substitutions of related concepts: these are captured in a functional order-theoretic property called monotonicity. For a certain class of NLI problems where the resulting entailment label depends only on the context monotonicity and the relation between the substituted concepts, we build on previous techniques that aim to improve the performance of NLI models for these problems, as consistent performance across both upward and downward monotone contexts still seems difficult to attain even for state-of-the-art models. To this end, we reframe the problem of context monotonicity classification to make it compatible with transformer-based pre-trained NLI models and add this task to the training pipeline. Furthermore, we introduce a sound and complete simplified monotonicity logic formalism which describes our treatment of contexts as abstract units. Using the notions in our formalism, we adapt targeted challenge sets to investigate whether an intermediate context monotonicity classification task can aid NLI models' performance on examples exhibiting monotonicity reasoning.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。