arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.06629cs.CL
收藏

Capturing Evolution in Word Usage: Just Add More Clusters?

Jozef Stefan Institute(约瑟夫·斯特凡研究所);LIMSI - CNRS(法国国家科学研究中心机械与工程科学计算机实验室);Univ. Paris-Sud(巴黎第十一大学);Univ. Paris-Saclay(巴黎萨克雷大学);Societé Générale(法国兴业银行);University of Helsinki(赫尔辛基大学)

Matej Martinc, Syrielle Montariol, Elaine Zosa, Lidia Pivovarova

英文摘要:

The way the words are used evolves through time, mirroring cultural or technological evolution of society. Semantic change detection is the task of detecting and analysing word evolution in textual data, even in short periods of time. In this paper we focus on a new set of methods relying on contextualised embeddings, a type of semantic modelling that revolutionised the NLP field recently. We leverage the ability of the transformer-based BERT model to generate contextualised embeddings capable of detecting semantic change of words across time. Several approaches are compared in a common setting in order to establish strengths and weaknesses for each of them. We also propose several ideas for improvements, managing to drastically improve the performance of existing approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑