带复制和缓存的序列到逻辑
Sequence to Logic with Copy and Cache
摘要:
生成人类语言的逻辑形式等价物是采用神经架构的一种新方法,其中长短期记忆有效地捕获编码器和解码器单元中的依赖性。序列的逻辑形式通常以相似标记的形式保存来自自然语言侧的信息,并且最近已经提出了一种复制机制,其增加了通过解码从源输入输出标记的概率。在本文中,我们提出了一个缓存机制作为一个更一般的形式的复制机制,也从源词汇的重量,根据它们的关系,以当前的解码上下文的所有单词。我们的研究结果证实,所提出的方法实现了序列/令牌级的准确性序列逻辑形式的任务的改进。跨域对抗攻击的进一步实验表明,当使用其他领域最有影响力的例子进行训练时,性能有了实质性的改善。
英文摘要:
Generating logical form equivalents of human language is a fresh way to employ neural architectures where long short-term memory effectively captures dependencies in both encoder and decoder units. The logical form of the sequence usually preserves information from the natural language side in the form of similar tokens, and recently a copying mechanism has been proposed which increases the probability of outputting tokens from the source input through decoding. In this paper we propose a caching mechanism as a more general form of the copying mechanism which also weighs all the words from the source vocabulary according to their relation to the current decoding context. Our results confirm that the proposed method achieves improvements in sequence/token-level accuracy on sequence to logical form tasks. Further experiments on cross-domain adversarial attacks show substantial improvements when using the most influential examples of other domains for training.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。