arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2305.14717cs.CLcs.AI
收藏

利用上下文与定义之间的相关性进行多定义建模

Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling

The University of New South Wales(新南威尔士大学);Alibaba Group(阿里巴巴集团);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))

Linhan Zhang, Qian Chen, Wen Wang, Yuxin Jiang, Bing Li, Wei Wang, Xin Cao

AI总结:

本文提出多定义建模(MDM)任务,通过汇集目标词的所有上下文和定义来建模其相关性,并支持自动生成训练集,实验表明MDM作为预训练任务能提升单一定义建模(SDM)性能且在零样本设置下表现相当。

摘要:

定义建模是理解和对话等高级自然语言应用中的重要任务。自引入以来,它专注于为给定上下文中的目标词或短语生成一个定义,我们将其称为单一定义建模(SDM)。然而,这种方法没有充分建模不同上下文与词语定义之间的相关性和模式。此外,为SDM创建训练数据集需要大量的人类专业知识和精力。在本文中,我们精心设计了一项名为多定义建模(MDM)的新任务,将目标词的所有上下文和定义汇集在一起。我们展示了轻松创建模型以及自动生成多个训练集的方法。在实验中,我们展示并分析了MDM的优势,包括通过将MDM作为预训练任务来提升SDM的性能,以及其在零样本设置下的可比性能。

英文摘要:

Definition modeling is an important task in advanced natural language applications such as understanding and conversation. Since its introduction, it focus on generating one definition for a target word or phrase in a given context, which we refer to as Single Definition Modeling (SDM). However, this approach does not adequately model the correlations and patterns among different contexts and definitions of words. In addition, the creation of a training dataset for SDM requires significant human expertise and effort. In this paper, we carefully design a new task called Multiple Definition Modeling (MDM) that pool together all contexts and definition of target words. We demonstrate the ease of creating a model as well as multiple training sets automatically. % In the experiments, we demonstrate and analyze the benefits of MDM, including improving SDM's performance by using MDM as the pretraining task and its comparable performance in the zero-shot setting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑