它在乎你问什么吗?理解动词在深度学习QA系统中的重要性
Does it care what you asked? Understanding Importance of Verbs in Deep Learning QA System
摘要:
在本文中,我们介绍了在SQuAD数据集上训练的深度学习QA系统中动词重要性的调查结果。我们发现,问题中的主要动词对系统所做的决定影响不大-在超过90%的研究案例中,将动词交换为反义词并没有改变系统的决定。我们追踪这种现象到网络内部,分析RNN隐藏层中包含的自我注意和值的机制。最后,我们认识到SQuAD数据集的特征是问题的根源。我们的工作参考了NLP中最近流行的对抗性示例主题,并结合了对深度网络结构的研究。
英文摘要:
In this paper we present the results of an investigation of the importance of verbs in a deep learning QA system trained on SQuAD dataset. We show that main verbs in questions carry little influence on the decisions made by the system - in over 90% of researched cases swapping verbs for their antonyms did not change system decision. We track this phenomenon down to the insides of the net, analyzing the mechanism of self-attention and values contained in hidden layers of RNN. Finally, we recognize the characteristics of the SQuAD dataset as the source of the problem. Our work refers to the recently popular topic of adversarial examples in NLP, combined with investigating deep net structure.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。