arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2301.09862cs.LGcs.AI
收藏

相同还是不同?用于作者身份分析的差分向量

Same or Different? Diff-Vectors for Authorship Analysis

Scuola Normale Superiore(比萨高等师范学校);Istituto di Scienza e Tecnologie dell’Informazione, Consiglio Nazionale delle Ricerche(意大利国家研究委员会信息科学与技术研究所)

Silvia Corbara, Alejandro Moreo, Fabrizio Sebastiani

摘要:

我们研究了作者身份识别任务的影响,在如何构思的矢量表示的文件,作为输入到一个监督学习的根本转变。在“经典”作者身份分析中,特征向量表示文档,特征的值表示文档中特征的相对频率(的递增函数),类标签表示文档的作者。相反,我们研究的情况下,一个特征向量表示一个无序的文件对,一个功能的值表示的绝对差异的相对频率(或其递增函数)的功能在两个文件中,和类标签表明是否这两个文件是来自同一作者或没有。后一种(独立于学习者的)表征类型以前偶尔使用过,但从未被系统地研究过。我们认为这是有利的,在某些情况下(例如,作者身份验证),它向训练过程提供比标准表示大得多的信息量。我们在几个公开可用的数据集上进行的实验(其中一个是我们在这里首次提供的)表明,表示成对文档的特征向量(我们在这里称之为Diff-Vectors)可以系统地提高作者身份识别任务的有效性,特别是当训练数据稀缺时(因为在现实生活中的作者身份识别场景中经常出现这种情况)。我们的实验解决了同一作者验证,作者身份验证和闭集作者身份归属;虽然DV自然适合解决第一个问题,但我们还提供了两种解决第二个和第三个问题的新方法,这些方法使用第一个问题的求解器作为构建块。

英文摘要:

We investigate the effects on authorship identification tasks of a fundamental shift in how to conceive the vectorial representations of documents that are given as input to a supervised learner. In ``classic'' authorship analysis a feature vector represents a document, the value of a feature represents (an increasing function of) the relative frequency of the feature in the document, and the class label represents the author of the document. We instead investigate the situation in which a feature vector represents an unordered pair of documents, the value of a feature represents the absolute difference in the relative frequencies (or increasing functions thereof) of the feature in the two documents, and the class label indicates whether the two documents are from the same author or not. This latter (learner-independent) type of representation has been occasionally used before, but has never been studied systematically. We argue that it is advantageous, and that in some cases (e.g., authorship verification) it provides a much larger quantity of information to the training process than the standard representation. The experiments that we carry out on several publicly available datasets (among which one that we here make available for the first time) show that feature vectors representing pairs of documents (that we here call Diff-Vectors) bring about systematic improvements in the effectiveness of authorship identification tasks, and especially so when training data are scarce (as it is often the case in real-life authorship identification scenarios). Our experiments tackle same-author verification, authorship verification, and closed-set authorship attribution; while DVs are naturally geared for solving the 1st, we also provide two novel methods for solving the 2nd and 3rd that use a solver for the 1st as a building block.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑