arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.16919cs.CL

基于结构化提示模板的依存句法分析

Dependency Parsing with the Structuralized Prompt Template

SungKyunKwan University(成均馆大学)

Keunha Kim, Youngjoong Ko

AI总结:

提出一种仅依赖编码器模型和文本到文本训练方式的依存句法分析方法,通过结构化提示模板捕获依存树结构信息,在实验中优于传统模型且适应多种预训练模型。

摘要:

依存句法分析是自然语言处理(NLP)中的一项基础任务,旨在识别句法依存关系并为给定句子构建句法树。传统的依存句法分析模型通常构建嵌入表示,并利用额外的层进行预测。我们提出了一种新颖的依存句法分析方法,该方法仅依赖编码器模型并采用文本到文本的训练方式。为此,我们引入了一种结构化提示模板,该模板能够有效捕获依存树的结构信息。我们的实验结果表明,尽管仅依赖预训练模型,所提出的方法相比传统模型取得了出色的性能。此外,该方法高度适应于不同目标语言和训练环境下的各种预训练模型,能够轻松集成任务特定的特征。

英文摘要:

Dependency parsing is a fundamental task in natural language processing (NLP), aiming to identify syntactic dependencies and construct a syntactic tree for a given sentence. Traditional dependency parsing models typically construct embeddings and utilize additional layers for prediction. We propose a novel dependency parsing method that relies solely on an encoder model with a text-to-text training approach. To facilitate this, we introduce a structured prompt template that effectively captures the structural information of dependency trees. Our experimental results demonstrate that the proposed method achieves outstanding performance compared to traditional models, despite relying solely on a pre-trained model. Furthermore, this method is highly adaptable to various pre-trained models across different target languages and training environments, allowing easy integration of task-specific features.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑