强屈折语言中的扩展缩略语:形态句法标签足够吗?
Expanding Abbreviations in a Strongly Inflected Language: Are Morphosyntactic Tags Sufficient?
摘要:
在本文中,形态信息丢失的缩写形式的恢复问题的重点是解决高度曲折的语言。证据是正确的屈折形式的扩展缩写,在许多情况下可以推断出完全从上下文的形态句法标签。预测模型是一个带有标签嵌入的深度双向LSTM网络。训练和评估数据的收集是通过寻找可能已经被缩写的单词,并使用其相应的morphosyntax标签作为标签,而上下文单词的标签被用作分类的输入特征。该网络使用来自波兰瑟姆语料库的超过1000万个单词进行训练,在较小但更通用的波兰国家语料库上实现了74.2%的预测准确率。错误的分析表明,在这个任务中的性能可能会提高,如果一些先验知识的缩写词被纳入模型。
英文摘要:
In this paper, the problem of recovery of morphological information lost in abbreviated forms is addressed with a focus on highly inflected languages. Evidence is presented that the correct inflected form of an expanded abbreviation can in many cases be deduced solely from the morphosyntactic tags of the context. The prediction model is a deep bidirectional LSTM network with tag embedding. The training and evaluation data are gathered by finding the words which could have been abbreviated and using their corresponding morphosyntactic tags as the labels, while the tags of the context words are used as the input features for classification. The network is trained on over 10 million words from the Polish Sejm Corpus and achieves 74.2% prediction accuracy on a smaller, but more general National Corpus of Polish. The analysis of errors suggests that performance in this task may improve if some prior knowledge about the abbreviated word is incorporated into the model.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。