Taggus:从葡萄牙语小说文学中提取人物社交网络的自动化流水线
Taggus: An Automated Pipeline for the Extraction of Characters' Social Networks from Portuguese Fiction Literature
AI总结:
提出Taggus流水线,利用词性标注和启发式规则从葡萄牙语小说中提取人物社交网络,在角色识别和互动检测上分别达到94.1%和75.9%的F1分数,显著优于现有工具。
摘要:
从小说书籍中自动识别人物及其互动,可以说是一项复杂的任务,需要利用多种自然语言处理(NLP)方法的流水线,例如命名实体识别(NER)和词性(POS)标注。然而,这些方法并未针对构建人物社交网络的任务进行优化。实际上,现有方法往往表现不佳,尤其是在代表性不足的语言中,原因是缺乏用于训练的人工标注数据。在此,我们提出一个名为Taggus的流水线,用于从葡萄牙语文学小说作品中提取社交网络。我们的结果表明,与现成的最先进工具(即开箱即用的NER工具和大语言模型ChatGPT)相比,所提出的流水线采用词性标注和启发式规则的组合,在识别角色和解决共指任务中取得了令人满意的结果,平均F1分数为94.1%,在互动检测中为75.9%。这分别比现成的最先进工具所取得的结果提高了50.7%和22.3%。我们概述了进一步改进结果的步骤,例如用于检测角色之间关系的解决方案。我们承认测试样本在规模和范围上的局限性。Taggus流水线已公开可用,以鼓励葡萄牙语在该领域的发展。
英文摘要:
Automatically identifying characters and their interactions from fiction books is, arguably, a complex task that requires pipelines that leverage multiple Natural Language Processing (NLP) methods, such as Named Entity Recognition (NER) and Part-of-speech (POS) tagging. However, these methods are not optimized for the task that leads to the construction of Social Networks of Characters. Indeed, the currently available methods tend to underperform, especially in less-represented languages, due to a lack of manually annotated data for training. Here, we propose a pipeline, which we call Taggus, to extract social networks from literary fiction works in Portuguese. Our results show that compared to readily available State-of-the-Art tools -- off-the-shelf NER tools and Large Language Models (ChatGPT) -- the resulting pipeline, which uses POS tagging and a combination of heuristics, achieves satisfying results with an average F1-Score of $94.1\%$ in the task of identifying characters and solving for co-reference and $75.9\%$ in interaction detection. These represent, respectively, an increase of $50.7\%$ and $22.3\%$ on results achieved by the readily available State-of-the-Art tools. Further steps to improve results are outlined, such as solutions for detecting relationships between characters. Limitations on the size and scope of our testing samples are acknowledged. The Taggus pipeline is publicly available to encourage development in this field for the Portuguese language.2
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。