Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community. Benefiting from their emergent abilities, LLMs have attracted more and more researchers to study their capabilities and performance on various downstream Natural Language Processing (NLP) tasks. While marveling at LLMs' incredible performance on all kinds of tasks, we notice that they also have excellent multilingual processing capabilities, such as Chinese. To explore the Chinese processing ability of LLMs, we focus on Chinese Text Correction, a fundamental and challenging Chinese NLP task. Specifically, we evaluate various representative LLMs on the Chinese Grammatical Error Correction (CGEC) and Chinese Spelling Check (CSC) tasks, which are two main Chinese Text Correction scenarios. Additionally, we also fine-tune LLMs for Chinese Text Correction to better observe the potential capabilities of LLMs. From extensive analyses and comparisons with previous state-of-the-art small models, we empirically find that the LLMs currently have both amazing performance and unsatisfactory behavior for Chinese Text Correction. We believe our findings will promote the landing and application of LLMs in the Chinese NLP community.
RAIR: Retrieval-Augmented Iterative Refinement for Chinese Spelling Correction
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);University of Chinese Academy of Sciences(中国科学院大学);Zhongke Fanyu Technology Co., Ltd(中科泛语科技有限公司)
Correct Like Humans: Progressive Learning Framework for Chinese Text Error Correction
Tsinghua Shenzhen International Graduate School(清华大学深圳国际研究生院);Tsinghua University(清华大学);South China Agricultural University(华南农业大学);Sun-Yat Sen University(中山大学)
GrammarGPT: Exploring Open-Source LLMs for Native Chinese Grammatical Error Correction with Supervised Fine-Tuning
The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳));Soochow University(苏州大学);Shenzhen Research Institute of Big Data(深圳大数据研究院);University of Science and Technology of China(中国科学技术大学)
Rethinking the Roles of Large Language Models in Chinese Grammatical Error Correction
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Computer Science and Engineering, Central South University(中南大学计算机科学与工程学院);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ)(广东省人工智能与数字经济实验室(深圳));University of Illinois Chicago(芝加哥大学伊利诺伊分校)
uChecker: Masked Pretrained Language Models as Unsupervised Chinese Spelling Checkers
College of Computer Science and Technology(计算机科学与技术学院);Nanjing University of Aeronautics and Astronautics(南京航空航天大学);MIIT Key Laboratory of Pattern Analysis and Machine Intelligence(工业和信息化部模式分析与机器智能重点实验室)
CSRP: Chain-of-Thought Reasoning for Chinese Text Correction via Reinforcement Learning with Efficiency-Aware Rewards
School of Computer Science and Technology, East China Normal University(东华大学计算机科学与技术学院);Shanghai Institute of Artificial Intelligence for Education, East China Normal University(东华大学教育人工智能研究所)
Do Large Language Models Perform Well on Comprehending Poetic Logic in Modern Chinese Poetry?
Graduate School of Informatics, Kyoto University(京都大学信息学研究科);University of Macau(澳门大学);College of Computer Science, Inner Mongolia University(内蒙古大学计算机学院)
CNSocialDepress: A Chinese Social Media Dataset for Depression Risk Detection and Structured Analysis
Ertim Inalco;Milkuya Studio;Sorbonne Université(索邦大学);IRD Lab(IRD实验室);Faculty of Psychology, Peking University(北京大学心理学系);Faculty of Psychology and Cognitive Science, Beijing Normal University(北京师范大学心理学与认知科学系);Beijing Institute of Technology(北京理工大学)
EnsemJudge: Enhancing Reliability in Chinese LLM-Generated Text Detection through Diverse Model Ensembles
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院)
Towards Comprehensive Detection of Chinese Harmful Memes
School of Computer Science and Technology(计算机科学与技术学院);School of Foreign Languages(外国语学院);Key Laboratory of Social Computing and Cognitive Intelligence(社会计算与认知智能重点实验室);Dalian University of Technology(大连理工大学)
Benchmarking the Detection of LLMs-Generated Modern Chinese Poetry
NLP 2 CT Lab, Department of Computer and Information Science, University of Macau(计算机与信息科学系,澳门大学);Department of Portuguese, Faculty of Arts and Humanities, University of Macau(文学与人文学院,澳门大学)
Beijing Language and Culture University(北京语言大学);Tsinghua University(清华大学);Harbin Institute of Technology (Shenzhen)(哈尔滨工业大学(深圳));Beijing Jiaotong University(北京交通大学)
Bi-DCSpell: A Bi-directional Detector-Corrector Interactive Framework for Chinese Spelling Check
School of Computer Science & Technology, Beijing Institute of Technology(北京理工大学计算机科学与技术学院);Beijing Academy of Artificial Intelligence (BAAI)(北京人工智能研究院)