arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.13253cs.CLeess.AS
收藏

使用解析语言结构的文档作者分类

Document Author Classification Using Parsed Language Structure

Utah State University(犹他州立大学)

Todd K Moon, Jacob H. Gunther

AI总结:

本文提出利用统计自然语言解析器提取的语法结构信息进行文档作者分类,在《联邦党人文集》等文本上的实验证明该特征降维后能有效区分作者。

摘要:

多年来,基于文本的统计属性(例如使用非上下文词汇的出现率)来检测文本的作者身份一直备受关注。在以前的工作中,这些技术已被用于确定《联邦党人文集》全部文章的作者身份。在现代社会,此类方法可能有助于检测虚假或AI作者身份。统计自然语言解析器的进展引入了使用语法结构来检测作者身份的可能性。在本文中,我们探索了一种新的可能性,即使用由统计自然语言解析器提取的语法结构信息来检测作者身份。本文提供了一个概念验证,在一组“验证文本”上测试基于语法结构的作者分类,这些文本是《联邦党人文集》和Sanditon,它们在以前的作者身份检测研究中被用作测试用例。我们探索了从统计自然语言解析器中提取的几个特征:来自任意层级且具有一定深度的所有子树;具有一定深度的有根子树;词性;以及解析树中按层级划分的词性。研究发现,将特征投影到低维空间是有帮助的。对这些文档的统计实验表明,来自统计解析器的信息确实有助于区分作者。

英文摘要:

Over the years there has been ongoing interest in detecting authorship of a text based on statistical properties of the text, such as by using occurrence rates of noncontextual words. In previous work, these techniques have been used, for example, to determine authorship of all of \emph{The Federalist Papers}. Such methods may be useful in more modern times to detect fake or AI authorship. Progress in statistical natural language parsers introduces the possibility of using grammatical structure to detect authorship. In this paper we explore a new possibility for detecting authorship using grammatical structural information extracted using a statistical natural language parser. This paper provides a proof of concept, testing author classification based on grammatical structure on a set of "proof texts," The Federalist Papers and Sanditon which have been as test cases in previous authorship detection studies. Several features extracted from the statistical natural language parser were explored: all subtrees of some depth from any level; rooted subtrees of some depth, part of speech, and part of speech by level in the parse tree. It was found to be helpful to project the features into a lower dimensional space. Statistical experiments on these documents demonstrate that information from a statistical parser can, in fact, assist in distinguishing authors.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑