arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2309.14974cs.CLcs.AI
收藏

在公元一千年拉丁语文本中的句子级性内容检测

Detecting Sexual Content at the Sentence Level in First Millennium Latin Texts

Inria(法国国家信息与自动化研究所)

Thibault Clérice

AI总结:

本研究提出使用深度学习方法对公元一千年拉丁语文本进行句子级性内容语义分类,构建了新语料库并验证了HAN模型的高精确率与TPR,同时发现元数据嵌入会导致过拟合。

摘要:

在本研究中,我们提出评估使用深度学习方法进行句子级语义分类,以加快人文和语言学领域中语料库构建的过程,这是一项传统且耗时的任务。我们引入了一个新语料库,包含约2500个句子,时间跨度从公元前300年到公元900年,涵盖性语义(医学、色情等)。我们评估了各种句子分类方法和不同的输入嵌入层,并表明所有方法均始终优于基于简单词元(token)的搜索。我们探索了个人和社会方言元数据嵌入(世纪、作者、写作类型)的整合,但发现这会导致过拟合。我们的结果证明了该方法的有效性,使用HAN分别实现了70.60%的高精确率和86.33%的真正例率(TPR)。我们评估了数据集大小对模型性能的影响(用420代替2013),并表明,尽管我们的模型性能下降,但即使没有MLM,它们仍然提供足够高的精确率和TPR,分别为69%和51%。鉴于这一结果,我们分析了注意力机制作为对人文主义者产生更多数据的支持附加价值。

英文摘要:

In this study, we propose to evaluate the use of deep learning methods for semantic classification at the sentence level to accelerate the process of corpus building in the field of humanities and linguistics, a traditional and time-consuming task. We introduce a novel corpus comprising around 2500 sentences spanning from 300 BCE to 900 CE including sexual semantics (medical, erotica, etc.). We evaluate various sentence classification approaches and different input embedding layers, and show that all consistently outperform simple token-based searches. We explore the integration of idiolectal and sociolectal metadata embeddings (centuries, author, type of writing), but find that it leads to overfitting. Our results demonstrate the effectiveness of this approach, achieving high precision and true positive rates (TPR) of respectively 70.60% and 86.33% using HAN. We evaluate the impact of the dataset size on the model performances (420 instead of 2013), and show that, while our models perform worse, they still offer a high enough precision and TPR, even without MLM, respectively 69% and 51%. Given the result, we provide an analysis of the attention mechanism as a supporting added value for humanists in order to produce more data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑