arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.18018cs.CLcs.LG
收藏

DORE:一个用于葡萄牙语定义生成的数据集

DORE: A Dataset For Portuguese Definition Generation

University of Galway(戈尔韦大学);Aston University(阿斯顿大学);Tilburg University(蒂尔堡大学);Lancaster University(兰卡斯特大学)

Anna Beatriz Dimas Furtado, Tharindu Ranasinghe, Frédéric Blain, Ruslan Mitkov

AI总结:

本文提出首个葡萄牙语定义建模数据集DORE,包含超过10万条定义,并在该数据集上评估多种深度学习DM模型,填补了葡萄牙语DM数据资源空白。

摘要:

定义建模(DM)是为特定单词自动生成词典定义的任务。能够进行DM的计算系统可以拥有众多应用,惠及广泛的受众。由于DM被视为一个有监督的自然语言生成问题,这些系统需要大规模标注数据集来训练机器学习(ML)模型。目前已为英语和其他高资源语言发布了若干DM数据集。尽管葡萄牙语在大多数自然语言处理任务中被认为是中/高资源语言,且拥有超过2亿母语使用者,但目前尚无适用于葡萄牙语的DM数据集。在本研究中,我们通过引入DORE来填补这一空白;DORE是首个面向葡萄牙语定义建模的数据集,包含超过100,000条定义。我们还在DORE上评估了多个基于深度学习的DM模型,并报告了结果。该数据集和本文的研究发现将有助于在更广泛的背景下促进葡萄牙语的研究与学习。

英文摘要:

Definition modelling (DM) is the task of automatically generating a dictionary definition for a specific word. Computational systems that are capable of DM can have numerous applications benefiting a wide range of audiences. As DM is considered a supervised natural language generation problem, these systems require large annotated datasets to train the machine learning (ML) models. Several DM datasets have been released for English and other high-resource languages. While Portuguese is considered a mid/high-resource language in most natural language processing tasks and is spoken by more than 200 million native speakers, there is no DM dataset available for Portuguese. In this research, we fill this gap by introducing DORE; the first dataset for Definition MOdelling for PoRtuguEse containing more than 100,000 definitions. We also evaluate several deep learning based DM models on DORE and report the results. The dataset and the findings of this paper will facilitate research and study of Portuguese in wider contexts.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑