arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1602.07393cs.CLcs.LGcs.NE
收藏

基于前向神经网络语言模型的领域作者归属

Domain Specific Author Attribution Based on Feedforward Neural Network Language Models

Purdue University(普渡大学)

Zhenhao Ge, Yufang Sun

摘要:

作者归属是指根据给定的文本样本自动确定作者的任务。它是一个历史悠久、应用广泛的问题。使用语言模型构建作者配置文件是自动化此任务的最成功的方法之一。基于神经网络的新语言建模方法缓解了维数灾难,并且通常优于传统的N-gram方法。然而,还没有太多的研究将它们应用于作者归属。在本文中,我们提出了一种新的神经网络语言模型(NNLM)的设置,并将其应用到一个数据库的文本样本来自不同的作者。我们研究了NNLM如何在中等作者集大小和相对有限的训练和测试数据的任务上执行,以及文本样本的主题如何影响准确性。NNLM实现了近2.5%的困惑减少,这是一个训练的语言模型对测试数据的适应度的度量。在5个随机测试句子的情况下,与使用SRILM工具的N-gram方法相比,作者分类准确率平均提高了3.43%。我们的方法的开源实现可以在https://github.com/zge/authorship-attribution/上免费获得。

英文摘要:

Authorship attribution refers to the task of automatically determining the author based on a given sample of text. It is a problem with a long history and has a wide range of application. Building author profiles using language models is one of the most successful methods to automate this task. New language modeling methods based on neural networks alleviate the curse of dimensionality and usually outperform conventional N-gram methods. However, there have not been much research applying them to authorship attribution. In this paper, we present a novel setup of a Neural Network Language Model (NNLM) and apply it to a database of text samples from different authors. We investigate how the NNLM performs on a task with moderate author set size and relatively limited training and test data, and how the topics of the text samples affect the accuracy. NNLM achieves nearly 2.5% reduction in perplexity, a measurement of fitness of a trained language model to the test data. Given 5 random test sentences, it also increases the author classification accuracy by 3.43% on average, compared with the N-gram methods using SRILM tools. An open source implementation of our methodology is freely available at https://github.com/zge/authorship-attribution/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑