arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.16209cs.CLcs.AI
收藏

MultiMUC:基于MUC-4的多语言模板填充

MultiMUC: Multilingual Template Filling on MUC-4

University of Rochester(罗切斯特大学);Georgetown University(乔治城大学);Johns Hopkins University(约翰霍普金斯大学)

William Gantt, Shabnam Behzad, Hannah YoungEun An, Yunmo Chen, Aaron Steven White, Benjamin Van Durme, Mahsa Yarmohammadi

AI总结:

本研究推出首个多语言模板填充平行语料库MultiMUC,含MUC-4基准的5种语言译文、手动投射标注及部分人工译文,并给出前沿模型与ChatGPT的基准结果。

摘要:

我们推出MultiMUC,这是首个用于模板填充的多语言平行语料库,由经典MUC-4模板填充基准的译文构成,覆盖阿拉伯语、中文、波斯语、韩语和俄语五种语言。我们借助性能优异的多语言机器翻译系统生成自动译文,并将原始英文标注手动投射到各目标语言中。针对所有语言,我们还为开发集和测试集中含标注模板论元的句子提供人工译文。最后,我们使用前沿模板填充模型及ChatGPT,在MultiMUC上给出基准结果。

英文摘要:

We introduce MultiMUC, the first multilingual parallel corpus for template filling, comprising translations of the classic MUC-4 template filling benchmark into five languages: Arabic, Chinese, Farsi, Korean, and Russian. We obtain automatic translations from a strong multilingual machine translation system and manually project the original English annotations into each target language. For all languages, we also provide human translations for sentences in the dev and test splits that contain annotated template arguments. Finally, we present baselines on MultiMUC both with state-of-the-art template filling models and with ChatGPT.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑