arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.01666cs.CL
收藏

语境化语义漂移检测综述

A Survey on Contextualised Semantic Shift Detection

Università degli Studi di Milano(米兰大学);Department of Computer Science(计算机科学系)

Stefano Montanelli, Francesco Periti

AI总结:

本文综述了基于语境化嵌入的语义漂移检测方法,提出以含义表示、时间感知和学习模态为维度的分类框架,并系统比较评估度量、性能及可扩展性、可解释性与鲁棒性问题,指出未来研究方向。

摘要:

语义漂移检测(SSD)是一项识别、解释和评估目标词含义随时间可能发生变化的任务。传统上,SSD 由语言学家和社会科学家通过耗时的人工活动来处理。近年来,基于自然语言处理和词嵌入的计算方法受到越来越多的关注,以尽可能实现 SSD 的自动化。特别是过去三年中,几乎完全基于词语境化嵌入模型取得了重大进展,这些模型能够处理词语的多种用法/含义,并更好地捕捉相关的语义漂移。本文综述了基于语境化嵌入的 SSD 方法(即 CSSDetection),并提出一个以含义表示、时间感知和学习模态为维度的分类框架。该框架被用于:i)回顾漂移评估的度量方法,ii)比较各方法的性能,iii)讨论当前在可扩展性、可解释性和鲁棒性方面的问题。最后概述了 CSSDetection 的开放性挑战和未来研究方向。

英文摘要:

Semantic Shift Detection (SSD) is the task of identifying, interpreting, and assessing the possible change over time in the meanings of a target word. Traditionally, SSD has been addressed by linguists and social scientists through manual and time-consuming activities. In the recent years, computational approaches based on Natural Language Processing and word embeddings gained increasing attention to automate SSD as much as possible. In particular, over the past three years, significant advancements have been made almost exclusively based on word contextualised embedding models, which can handle the multiple usages/meanings of the words and better capture the related semantic shifts. In this paper, we survey the approaches based on contextualised embeddings for SSD (i.e., CSSDetection) and we propose a classification framework characterised by meaning representation, time-awareness, and learning modality dimensions. The framework is exploited i) to review the measures for shift assessment, ii) to compare the approaches on performance, and iii) to discuss the current issues in terms of scalability, interpretability, and robustness. Open challenges and future research directions about CSSDetection are finally outlined.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑