提示与语境:面向低资源语言词间注释的逐词大语言模型提示方法
Prompt and circumstance: A word-by-word LLM prompting approach to interlinear glossing for low-resource languages
AI总结:
本研究提出基于检索的LLM逐词提示方法用于低资源语言词间注释,在SIGMORPHON 2023共享任务7种语言的语素级指标上优于BERT基线,部分词级指标超过挑战赛冠军,验证了LLM在交互式注释系统中的应用潜力。
摘要:
部分自动化生成词间注释文本(IGT)有望为语言文献记录工作提供助力。我们认为,大语言模型(LLM)因具备遵循自然语言指令的能力,可让语言学家更易开展这一工作。我们研究了基于检索的LLM提示方法在注释任务中的效果,将其应用于SIGMORPHON 2023共享任务涉及的7种语言。我们的系统在所有语言的语素级得分指标上均优于基于BERT的共享任务基线;我们还证实,简单的3-best oracle(最优三候选选择器)在5种语言的词级得分上高于挑战赛冠军(经调优的序列模型)。在针对Tsez语的案例研究中,我们让LLM自动生成并遵循语言规则指令,降低了某一易混淆语法特征上的错误。综上,我们的结果表明LLM可为交互式注释系统提供潜在助力,既可为人类标注者提供建议,也能遵循指令执行操作。
英文摘要:
Partly automated creation of interlinear glossed text (IGT) has the potential to assist in linguistic documentation. We argue that LLMs can make this process more accessible to linguists because of their capacity to follow natural-language instructions. We investigate the effectiveness of a retrieval-based LLM prompting approach to glossing, applied to the seven languages from the SIGMORPHON 2023 shared task. Our system beats the BERT-based shared task baseline for every language in the morpheme-level score category, and we show that a simple 3-best oracle has higher word-level scores than the challenge winner (a tuned sequence model) in five languages. In a case study on Tsez, we ask the LLM to automatically create and follow linguistic instructions, reducing errors on a confusing grammatical feature. Our results thus demonstrate the potential contributions which LLMs can make in interactive systems for glossing, both in making suggestions to human annotators and following directions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。