While GPT has become the de-facto method for text generation tasks, its application to pinyin input method remains unexplored. In this work, we make the first exploration to leverage Chinese GPT for pinyin input method. We find that a frozen GPT achieves state-of-the-art performance on perfect pinyin. However, the performance drops dramatically when the input includes abbreviated pinyin. A reason is that an abbreviated pinyin can be mapped to many perfect pinyin, which links to even larger number of Chinese characters. We mitigate this issue with two strategies, including enriching the context with pinyin and optimizing the training process to help distinguish homophones. To further facilitate the evaluation of pinyin input method, we create a dataset consisting of 270K instances from 15 domains. Results show that our approach improves performance on abbreviated pinyin across all domains. Model analysis demonstrates that both strategies contribute to the performance boost.
KNPTC: Knowledge and Neural Machine Translation Powered Chinese Pinyin Typo Correction
Institute of Computing Technology, Chinese Academy of Sciences(中国科学院计算技术研究所);Beijing University of Posts and Telecommunications(北京邮电大学);Sogou, Inc.(搜狗公司)
Chinese Spelling Error Detection Using a Fusion Lattice LSTM
North China University of Technology(北方工业大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学)
Classic4Children: Adapting Chinese Literary Classics for Children with Large Language Model
Key Laboratory of Big Data and Intelligent Robot (South China University of Technology) Ministry of Education(大数据与智能机器人重点实验室(华南理工大学)教育部);School of Software Engineering, South China University of Technology(软件学院(华南理工大学));The Hong Kong Polytechnic University(香港理工大学)
Generative Input: Towards Next-Generation Input Methods Paradigm
University of Science and Technology of China(中国科学技术大学);State Key Laboratory of Cognitive Intelligence, iFLYTEK Research(认知智能国家重点实验室,科大讯飞研究院);iFLYTEK AI Research(科大讯飞人工智能研究院)
RAIR: Retrieval-Augmented Iterative Refinement for Chinese Spelling Correction
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongke Fanyu Technology Co., Ltd(中科泛语科技有限公司)
Mitigating Catastrophic Forgetting in Multi-domain Chinese Spelling Correction by Multi-stage Knowledge Transfer Framework
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);State Key Lab of Software Development Environment, Beihang University(北京航空航天大学软件开发环境国家重点实验室);School of Intelligent Systems Engineering, Sun-Yat Sen University(中山大学智能工程学院);Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳))