arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.04150cs.CL
收藏

硬币有两面:一种用于中文拼写纠错的新型检测器-纠错器框架

A Coin Has Two Sides: A Novel Detector-Corrector Framework for Chinese Spelling Correction

School of Computer Science, Wuhan University(武汉大学计算机学院);School of Information Management, Wuhan University(武汉大学信息管理学院);Department of Computer Science and Engineering, Shanghai Jiao Tong University(上海交通大学计算机科学与工程系)

Xiangke Zeng, Zuchao Li, Lefei Zhang, Ping Wang, Hongqiu Wu, Hai Zhao

AI总结:

针对中文拼写纠错中检测器精确率与召回率难以兼顾的问题,本文提出双输出检测器-纠错器框架,并通过特征融合与选择性掩码利用检测结果,在主流数据集上验证了有效性。

摘要:

中文拼写纠错(Chinese Spelling Correction,CSC)是一项基础的自然语言处理(Natural Language Processing,NLP)任务,主要关注中文文本中错误字符的纠正。某些现有方法选择将纠错过程解耦,使用额外的错误检测器来定位错误位置。然而,由于错误检测器固有的性能限制,精确率和召回率就像硬币的两面,无法同时朝上。此外,如何审慎地利用错误位置信息来辅助纠错,同样值得研究。本文提出一种基于错误检测器-纠错器框架的新方法。我们的检测器被设计为产生两种错误检测结果,分别具有高精确率和高召回率。鉴于错误的发生依赖于上下文,且检测结果可能不够精确,我们采用创新的特征融合策略和选择性掩码策略,将错误检测结果融入CSC任务。在主流CSC数据集上进行的实验证实了所提方法的有效性。

英文摘要:

Chinese Spelling Correction (CSC) stands as a foundational Natural Language Processing (NLP) task, which primarily focuses on the correction of erroneous characters in Chinese texts. Certain existing methodologies opt to disentangle the error correction process, employing an additional error detector to pinpoint error positions. However, owing to the inherent performance limitations of error detector, precision and recall are like two sides of the coin which can not be both facing up simultaneously. Furthermore, it is also worth investigating how the error position information can be judiciously applied to assist the error correction. In this paper, we introduce a novel approach based on error detector-corrector framework. Our detector is designed to yield two error detection results, each characterized by high precision and recall. Given that the occurrence of errors is context-dependent and detection outcomes may be less precise, we incorporate the error detection results into the CSC task using an innovative feature fusion strategy and a selective masking strategy. Empirical experiments conducted on mainstream CSC datasets substantiate the efficacy of our proposed method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑