arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1808.02563cs.CL
收藏

命名实体音译的设计挑战

Design Challenges in Named Entity Transliteration

Amazon Alexa AI(亚马逊Alexa人工智能);Amazon AWS AI(亚马逊AWS人工智能)

Yuval Merhav, Stephen Ash

摘要:

我们分析了一些影响多语言最先进的命名实体音译系统开发的基本设计挑战,包括管理双语命名实体数据集和评估多种音译方法。我们经验评估的音译任务,使用传统的加权有限状态转换器(WFST)的方法对两种神经方法:编码器-解码器的递归神经网络方法和最近的,非顺序的Transformer方法。为了提高双语命名实体音译数据集的可用性,我们发布了从Wikidata到俄语,希伯来语,阿拉伯语和日语片假名的个人姓名双语词典。我们的代码和字典是公开的。

英文摘要:

We analyze some of the fundamental design challenges that impact the development of a multilingual state-of-the-art named entity transliteration system, including curating bilingual named entity datasets and evaluation of multiple transliteration methods. We empirically evaluate the transliteration task using traditional weighted finite state transducer (WFST) approach against two neural approaches: the encoder-decoder recurrent neural network method and the recent, non-sequential Transformer method. In order to improve availability of bilingual named entity transliteration datasets, we release personal name bilingual dictionaries minded from Wikidata for English to Russian, Hebrew, Arabic and Japanese Katakana. Our code and dictionaries are publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑