arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1506.04891cs.CLcs.LGcs.NE
收藏

基于多头循环神经网络的作者身份识别

Author Identification using Multi-headed Recurrent Neural Networks

Douglas Bagnall

摘要:

循环神经网络(RNN)非常擅长对文本流进行建模,但通常需要在比PAN 2015作者识别任务大得多的语料库上进行训练。本文描述了一种新的方法,其中字符级RNN语言模型的输出层被分成几个独立的预测子模型,每个子模型代表一个作者,而递归层由所有人共享。这允许循环层将语言作为一个整体进行建模,而不会过度拟合,而输出则选择底层模型中反映作者风格的方面。该方法具有竞争力,在四种语言中的两种中排名第一。

英文摘要:

Recurrent neural networks (RNNs) are very good at modelling the flow of text, but typically need to be trained on a far larger corpus than is available for the PAN 2015 Author Identification task. This paper describes a novel approach where the output layer of a character-level RNN language model is split into several independent predictive sub-models, each representing an author, while the recurrent layer is shared by all. This allows the recurrent layer to model the language as a whole without over-fitting, while the outputs select aspects of the underlying model that reflect their author's style. The method proves competitive, ranking first in two of the four languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑