arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1912.09084cs.CL
收藏

基于循环多任务学习和局部注意的神经相似词识别

Neural Simile Recognition with Cyclic Multitask Learning and Local Attention

Xiamen University(厦门大学);Tencent Technology Co., Ltd(腾讯科技有限公司);Capital Normal University(首都师范大学);University of Rochester(罗切斯特大学)

Jiali Zeng, Linfeng Song, Jinsong Su, Jun Xie, Wei Song, Jiebo Luo

摘要:

明喻识别是检测歧义句并提取歧义成分,即,tenors男高音and vehicles车辆.它包括两个子任务:{ \it句子分类}和{ \it句子成分提取}。最近的工作表明,标准的多任务学习是有效的汉语拼音识别,但它仍然是不确定的子任务之间的相互影响是否已经很好地捕捉到简单的参数共享。提出了一种新的循环多任务学习框架,用于神经元识别,它将子任务堆叠起来,并通过连接最后一个到第一个使它们成为一个循环。它迭代地执行每个子任务,将前一个子任务的输出作为当前子任务的额外输入,以便更好地探索子任务之间的相互依赖性。大量的实验表明,我们的框架显着优于当前最先进的模型和我们精心设计的基线,使用BERT的收益仍然显着。

英文摘要:

Simile recognition is to detect simile sentences and to extract simile components, i.e., tenors and vehicles. It involves two subtasks: {\it simile sentence classification} and {\it simile component extraction}. Recent work has shown that standard multitask learning is effective for Chinese simile recognition, but it is still uncertain whether the mutual effects between the subtasks have been well captured by simple parameter sharing. We propose a novel cyclic multitask learning framework for neural simile recognition, which stacks the subtasks and makes them into a loop by connecting the last to the first. It iteratively performs each subtask, taking the outputs of the previous subtask as additional inputs to the current one, so that the interdependence between the subtasks can be better explored. Extensive experiments show that our framework significantly outperforms the current state-of-the-art model and our carefully designed baselines, and the gains are still remarkable using BERT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑