arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.14972cs.CLcs.AI
收藏

MultiLS:一个多任务词汇简化框架

MultiLS: A Multi-task Lexical Simplification Framework

George Mason University(乔治梅森大学);Aston University(阿斯顿大学);Manchester Metropolitan University(曼彻斯特城市大学)

Kai North, Tharindu Ranasinghe, Matthew Shardlow, Marcos Zampieri

AI总结:

本文提出首个多任务词汇简化框架MultiLS及其葡萄牙语数据集MultiLS-PT,覆盖词汇复杂度预测、替代词生成与排序,并评估了从Transformer到大语言模型的性能。

摘要:

词汇简化(Lexical Simplification, LS)自动将难读的词替换为更易理解的替代词,同时保留句子的原意。LS是文本简化的前置任务,旨在提高文本对各种目标人群的可及性,包括儿童、第二语言学习者、有阅读障碍或识字水平较低的人群。目前已有若干LS数据集。这些LS数据集通常只专注于LS流程中的一个或两个子任务。然而,截至目前,尚未开发出一个覆盖所有LS子任务的单一LS数据集。我们提出了MultiLS,这是第一个允许创建多任务LS数据集的LS框架。我们还提出了MultiLS-PT,这是使用MultiLS框架创建的第一个数据集。我们通过为葡萄牙语执行所有LS子任务来展示MultiLS-PT的潜力,这些子任务包括:(1)词汇复杂度预测(lexical complexity prediction, LCP),(2)替代词生成,以及(3)替代词排序。我们报告了模型性能,涵盖从基于Transformer的模型到更近期的大语言模型(large language models, LLMs)。

英文摘要:

Lexical Simplification (LS) automatically replaces difficult to read words for easier alternatives while preserving a sentence's original meaning. LS is a precursor to Text Simplification with the aim of improving text accessibility to various target demographics, including children, second language learners, individuals with reading disabilities or low literacy. Several datasets exist for LS. These LS datasets specialize on one or two sub-tasks within the LS pipeline. However, as of this moment, no single LS dataset has been developed that covers all LS sub-tasks. We present MultiLS, the first LS framework that allows for the creation of a multi-task LS dataset. We also present MultiLS-PT, the first dataset to be created using the MultiLS framework. We demonstrate the potential of MultiLS-PT by carrying out all LS sub-tasks of (1). lexical complexity prediction (LCP), (2). substitute generation, and (3). substitute ranking for Portuguese. Model performances are reported, ranging from transformer-based models to more recent large language models (LLMs).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑