arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2209.14008cs.CL
收藏

基于文本到文本转换Transformer的短文本关键词提取

Keyword Extraction from Short Texts with a Text-To-Text Transfer Transformer

University of Łódź(罗兹大学);VoiceLab;Polish Academy of Sciences(波兰科学院)

Piotr Pęzik, Agnieszka Mikołajczyk-Bareła, Adam Wawrzyński, Bartłomiej Nitoń, Maciej Ogrodniczuk

摘要:

本文探讨了文本到文本传输Transformer语言模型(T5)波兰语(plT5)的任务的相关性的内在和外在的关键字提取短文本段落。评估是在新的波兰开放科学元数据语料库(POSMAC)上进行的,该语料库与本文一起发布:收集了CURLICAT项目中编译的216,214篇科学出版物摘要。我们比较了四种不同的方法,即plT5kw,extremeText,TermoPL,KeyBERT得到的结果,并得出结论,plT5kw模型产生特别有前途的结果,为频繁和稀疏表示的关键字。此外,在POSMAC上训练的plT5kw关键字生成模型似乎也在跨域文本标签场景中产生了非常有用的结果。我们讨论了新闻故事和基于电话的对话成绩单,代表文本类型和域外部的科学摘要数据集的模型的性能。最后,我们还试图描述评估文本到文本模型的内在和外在关键字提取的挑战。

英文摘要:

The paper explores the relevance of the Text-To-Text Transfer Transformer language model (T5) for Polish (plT5) to the task of intrinsic and extrinsic keyword extraction from short text passages. The evaluation is carried out on the new Polish Open Science Metadata Corpus (POSMAC), which is released with this paper: a collection of 216,214 abstracts of scientific publications compiled in the CURLICAT project. We compare the results obtained by four different methods, i.e. plT5kw, extremeText, TermoPL, KeyBERT and conclude that the plT5kw model yields particularly promising results for both frequent and sparsely represented keywords. Furthermore, a plT5kw keyword generation model trained on the POSMAC also seems to produce highly useful results in cross-domain text labelling scenarios. We discuss the performance of the model on news stories and phone-based dialog transcripts which represent text genres and domains extrinsic to the dataset of scientific abstracts. Finally, we also attempt to characterize the challenges of evaluating a text-to-text model on both intrinsic and extrinsic keyword extraction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑