arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2103.16590cs.CL
收藏

生成文本的形态句法良构性评价

Evaluating the Morphosyntactic Well-formedness of Generated Texts

Carnegie Mellon University(卡内基梅隆大学);University of Washington(华盛顿大学);George Mason University(乔治梅森大学)

Adithya Pratapa, Antonios Anastasopoulos, Shruti Rijhwani, Aditi Chaudhary, David R. Mortensen, Graham Neubig, Yulia Tsvetkov

摘要:

文本生成系统在自然语言处理应用中无处不在。然而,对这些系统的评估仍然是一个挑战,特别是在多语种环境中。在本文中,我们提出了L 'AMBRE-一个度量标准来评估其依赖分析和语言的形态句法规则的文本的形态句法良好的形式。我们提出了一种方法来自动提取各种规则直接从依赖树库的morphosyntax。为了解决文本生成系统的噪声输出,我们提出了一个简单的方法来训练强大的解析器。我们的有效性,我们的度量机器翻译的任务,通过历时研究系统翻译成形态丰富的语言。

英文摘要:

Text generation systems are ubiquitous in natural language processing applications. However, evaluation of these systems remains a challenge, especially in multilingual settings. In this paper, we propose L'AMBRE -- a metric to evaluate the morphosyntactic well-formedness of text using its dependency parse and morphosyntactic rules of the language. We present a way to automatically extract various rules governing morphosyntax directly from dependency treebanks. To tackle the noisy outputs from text generation systems, we propose a simple methodology to train robust parsers. We show the effectiveness of our metric on the task of machine translation through a diachronic study of systems translating into morphologically-rich languages.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑