神经网络能理解逻辑蕴涵吗?
Can Neural Networks Understand Logical Entailment?
摘要:
我们引入了一个新的逻辑蕴涵数据集,用于测量模型捕获和利用逻辑表达式结构的能力。我们使用这个任务来比较一系列的架构,这是无处不在的序列处理文献中,除了一个新的模型类-PossibleWorldNets-计算蕴涵作为一个“卷积可能的世界”。结果表明,相对于LSTM RNN,卷积网络在这类问题上存在错误的归纳偏差,树结构神经网络由于其利用逻辑语法的增强能力而优于LSTM RNN,而PossibleWorldNets优于所有基准。
英文摘要:
We introduce a new dataset of logical entailments for the purpose of measuring models' ability to capture and exploit the structure of logical expressions against an entailment prediction task. We use this task to compare a series of architectures which are ubiquitous in the sequence-processing literature, in addition to a new model class---PossibleWorldNets---which computes entailment as a "convolution over possible worlds". Results show that convolutional networks present the wrong inductive bias for this class of problems relative to LSTM RNNs, tree-structured neural networks outperform LSTM RNNs due to their enhanced ability to exploit the syntax of logic, and PossibleWorldNets outperform all benchmarks.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。