MenakBERT——希伯来语变音符号标注器
MenakBERT -- Hebrew Diacriticizer
AI总结:
本文提出字符级Transformer模型MenakBERT,通过在希伯来语文本上预训练并微调来生成变音符号,缩小与人工系统的性能差距,并验证其可迁移至词性标注任务。
摘要:
希伯来语中的变音符号赋予单词其元音化形式。为纯希伯来语文本添加变音符号的任务目前仍由一个严重依赖人工整理资源的系统主导。近期在带变音符号的希伯来语文本上训练的模型在性能上仍存在差距。我们使用最近开发的基于字符的预训练语言模型(PLM)来缩小这一差距。我们提出MenakBERT,这是一个字符级Transformer模型,在希伯来语文本上进行预训练,并经过微调以为希伯来语句子生成变音符号。我们进一步展示了针对变音符号标注任务进行微调的模型如何迁移到词性标注等任务。
英文摘要:
Diacritical marks in the Hebrew language give words their vocalized form. The task of adding diacritical marks to plain Hebrew text is still dominated by a system that relies heavily on human-curated resources. Recent models trained on diacritized Hebrew texts still present a gap in performance. We use a recently developed char-based PLM to narrowly bridge this gap. Presenting MenakBERT, a character level transformer pretrained on Hebrew text and fine-tuned to produce diacritical marks for Hebrew sentences. We continue to show how finetuning a model for diacritizing transfers to a task such as part of speech tagging.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。