arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.14947cs.CL
收藏

通过质量估计进行语法错误纠正的系统组合

System Combination via Quality Estimation for Grammatical Error Correction

National University of Singapore(新加坡国立大学)

Muhammad Reza Qorib, Hwee Tou Ng

AI总结:

提出GRECO质量估计模型及三种系统组合方法,通过选择最佳纠正子集提升GEC性能,在CoNLL-2014和BEA-2019测试集上达到最高F0.5分数。

摘要:

质量估计模型已被开发用于在没有参考或黄金标准纠正的情况下,评估语法错误纠正(GEC)模型所做的纠正。理想的质量估计器可用于组合多个GEC系统的输出,方法是从GEC基础系统提出的所有纠正的并集中选择最佳的纠正子集。然而,我们发现现有的GEC质量估计模型在区分好纠正和坏纠正方面不够好,导致用于系统组合时F0.5分数较低。在本文中,我们提出了GRECO,一种新的最先进的质量估计模型,它对纠正句子的质量给出更好的估计,这体现在与纠正句子的F0.5分数具有更高的相关性。它产生了一个具有更高F0.5分数的组合GEC系统。我们还提出了三种利用GEC质量估计模型进行系统组合的方法,具有不同的通用性:模型无关、带投票偏差的模型无关和模型相关方法。组合的GEC系统在CoNLL-2014测试集和BEA-2019测试集上优于现有技术,实现了迄今为止发表的最高F0.5分数。

英文摘要:

Quality estimation models have been developed to assess the corrections made by grammatical error correction (GEC) models when the reference or gold-standard corrections are not available. An ideal quality estimator can be utilized to combine the outputs of multiple GEC systems by choosing the best subset of edits from the union of all edits proposed by the GEC base systems. However, we found that existing GEC quality estimation models are not good enough in differentiating good corrections from bad ones, resulting in a low F0.5 score when used for system combination. In this paper, we propose GRECO, a new state-of-the-art quality estimation model that gives a better estimate of the quality of a corrected sentence, as indicated by having a higher correlation to the F0.5 score of a corrected sentence. It results in a combined GEC system with a higher F0.5 score. We also propose three methods for utilizing GEC quality estimation models for system combination with varying generality: model-agnostic, model-agnostic with voting bias, and model-dependent method. The combined GEC system outperforms the state of the art on the CoNLL-2014 test set and the BEA-2019 test set, achieving the highest F0.5 scores published to date.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑