一个极其简单的即插即用检测与推理模块用于中文拼写检查
A Frustratingly Easy Plug-and-Play Detection-and-Reasoning Module for Chinese Spelling Check
AI总结:
本文提出一个即插即用的检测与推理模块,将中文拼写检查分解为检测、推理和搜索子任务,兼容现有SOTA非自回归模型,提升性能并增强可解释性。
摘要:
近年来,中文拼写检查(CSC)通过设计任务特定的预训练方法或引入辅助任务得到了极大改进,这些方法大多以端到端的方式解决该任务。在本文中,我们提出将CSC工作流程分解为检测、推理和搜索子任务,以便更直接、更高效地利用关于中文语言的丰富外部知识。具体来说,我们设计了一个即插即用的检测与推理模块,该模块与现有的SOTA非自回归CSC模型兼容,以进一步提升其性能。我们发现,为一个模型训练的检测与推理模块也能使其他模型受益。我们还研究了任务分解提供的主要可解释性。大量实验和详细分析证明了所提出模块的有效性和竞争力。
英文摘要:
In recent years, Chinese Spelling Check (CSC) has been greatly improved by designing task-specific pre-training methods or introducing auxiliary tasks, which mostly solve this task in an end-to-end fashion. In this paper, we propose to decompose the CSC workflow into detection, reasoning, and searching subtasks so that the rich external knowledge about the Chinese language can be leveraged more directly and efficiently. Specifically, we design a plug-and-play detection-and-reasoning module that is compatible with existing SOTA non-autoregressive CSC models to further boost their performance. We find that the detection-and-reasoning module trained for one model can also benefit other models. We also study the primary interpretability provided by the task decomposition. Extensive experiments and detailed analyses demonstrate the effectiveness and competitiveness of the proposed module.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。