arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2512.23971cs.CL
收藏

CEC-Zero: 无监督字符错误纠正与自生成奖励

CEC-Zero: Zero-Supervision Character Error Correction with Self-Generated Rewards

Zhiming Lin, Kai Zhao, Sophie Zhang, Peilai Yu, Canran Xiao

AI总结:

CEC-Zero通过无监督强化学习框架,利用自动生成的奖励在无需标注的情况下提升大语言模型的字符错误纠正能力,实现了在多个基准测试中的性能提升。

摘要:

大规模中文拼写纠正(CSC)仍然是现实文本处理中的关键任务,但现有大语言模型(LLMs)和监督方法在面对新错误时缺乏鲁棒性,并且依赖昂贵的标注。我们引入CEC-Zero,一种无监督强化学习框架,通过使LLMs自行纠正错误来解决这一问题。CEC-Zero从干净文本中合成错误输入,通过语义相似性和候选一致性计算聚类共识奖励,并使用PPO优化策略。在9个基准测试中,CEC-Zero在F1分数上比监督基线高出10-13分,比强大的LLM微调方法高出5-8分。CEC-Zero提供了无偏奖励和收敛的理论保证。CEC-Zero建立了一个无标签的、稳健且可扩展的CSC范式,解锁了LLM在嘈杂文本管道中的潜力。

英文摘要:

Large-scale Chinese spelling correction (CSC) remains critical for real-world text processing, yet existing LLMs and supervised methods lack robustness to novel errors and rely on costly annotations. We introduce CEC-Zero, a zero-supervision reinforcement learning framework that addresses this by enabling LLMs to correct their own mistakes. CEC-Zero synthesizes errorful inputs from clean text, computes cluster-consensus rewards via semantic similarity and candidate agreement, and optimizes the policy with PPO. It outperforms supervised baselines by 10--13 F$_1$ points and strong LLM fine-tunes by 5--8 points across 9 benchmarks, with theoretical guarantees of unbiased rewards and convergence. CEC-Zero establishes a label-free paradigm for robust, scalable CSC, unlocking LLM potential in noisy text pipelines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑