arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2212.04068cs.CLcs.AI
收藏

探究中文拼写检查中的字形语音信息:有效方法与未来方向

Investigating Glyph Phonetic Information for Chinese Spell Checking: What Works and What's Next

Fudan University(复旦大学)

Xiaotian Zhang, Yanjun Zheng, Hang Yan, Xipeng Qiu

AI总结:

本文探讨了字形语音信息在中文拼写检查任务中的作用与利用情况,并提出了一种更具挑战性和实用性的模型泛化能力测试设置。

摘要:

尽管预训练中文语言模型在广泛的NLP任务中表现出色,但中文拼写检查(CSC)任务仍具挑战。先前研究探索利用字形和语音等信息提升区分错字的能力,取得了良好效果。然而,这些模型的泛化能力尚未被充分理解:尚不清楚它们是否融合了字形语音信息,若融合,该信息是否被充分利用。本文旨在更好地理解字形语音信息在CSC任务中的作用并提出改进方向。此外,我们提出了一种全新、更具挑战性且实用的设置,用于测试CSC模型的泛化能力。所有代码已公开。

英文摘要:

While pre-trained Chinese language models have demonstrated impressive performance on a wide range of NLP tasks, the Chinese Spell Checking (CSC) task remains a challenge. Previous research has explored using information such as glyphs and phonetics to improve the ability to distinguish misspelled characters, with good results. However, the generalization ability of these models is not well understood: it is unclear whether they incorporate glyph-phonetic information and, if so, whether this information is fully utilized. In this paper, we aim to better understand the role of glyph-phonetic information in the CSC task and suggest directions for improvement. Additionally, we propose a new, more challenging, and practical setting for testing the generalizability of CSC models. All code is made publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑