Shanghai Institute of AI for Education and School of Computer Science and Technology, East China Normal University(华东师范大学上海智能教育研究院与计算机科学与技术学院);School of Data Science, Fudan University(复旦大学数据科学学院);Shanghai Key Laboratory of Data Science, School of Computer Science, Fudan University(复旦大学计算机科学学院上海市数据科学重点实验室)
Haixia Han, Jiaqing Liang, Jie Shi, Qianyu He, Yanghua Xiao
Generative Language Models (LMs) such as ChatGPT have exhibited remarkable performance across various downstream tasks. Nevertheless, one of their most prominent drawbacks is generating inaccurate or false information with a confident tone. Previous studies have devised sophisticated pipelines and prompts to induce large LMs to exhibit the capability for self-correction. However, large LMs are explicitly prompted to verify and modify its answers separately rather than completing all steps spontaneously like humans. Moreover, these complex prompts are extremely challenging for small LMs to follow. In this paper, we introduce the \underline{I}ntrinsic \underline{S}elf-\underline{C}orrection (ISC) in generative language models, aiming to correct the initial output of LMs in a self-triggered manner, even for those small LMs with 6 billion parameters. Specifically, we devise a pipeline for constructing self-correction data and propose Partial Answer Masking (PAM), aiming to endow the model with the capability for intrinsic self-correction through fine-tuning. We conduct experiments using LMs with parameters sizes ranging from 6 billion to 13 billion in two tasks, including commonsense reasoning and factual knowledge reasoning. Our experiments demonstrate that the outputs generated using ISC outperform those generated without self-correction. We believe that the output quality of even small LMs can be further improved by empowering them with the ability to intrinsic self-correct.
Can LLMs Correct Themselves? A Benchmark of Self-Correction in LLMs
Huazhong University of Science and Technology(华中科技大学);Griffith University(格里菲斯大学);Squirrel Ai Learning(squirrel ai 学习);Shanghai Jiaotong University(上海交通大学);Lehigh University(莱斯大学)
Reinforcing Step-level Reasoning for Effective Self-Correction in LLMs
Nanyang Technological University(南洋理工大学);National University of Singapore(新加坡国立大学);VinUniversity;Institute for Infocomm Research (IR), A*STAR(新加坡科技研究局信息通信研究院)
Learning to Check: Unleashing Potentials for Self-Correction in Large Language Models
School of Software & Microelectronics, Peking University(北京大学软件与微电子学院);School of Data Science and Engineering, East China Normal University(华东师范大学数据科学与工程学院)
Self-Correction is More than Refinement: A Learning Framework for Visual and Language Reasoning Tasks
University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);Georgia Institute of Technology(佐治亚理工学院);The Hong Kong University of Science and Technology(香港科技大学)
Explaining Intrinsic Moral Self-Correction with Mechanistic Interpretability
Graduate Institute of Communication Engineering, National Taiwan University, Taipei, Taiwan(通讯工程研究院,国立台湾大学);MediaTek Research, Taipei, Taiwan(联发科研究,台北,台湾);Department of Electrical Engineering, National Taiwan University, Taipei, Taiwan(电气工程系,国立台湾大学);Department of Electrical Engineering, National Tsing Hua University, Hsinchu, Taiwan(电气工程系,国立清华大学);AI Research Center (AINTU), National Taiwan University, Taipei, Taiwan(人工智能研究中心(AINTU),国立台湾大学)
LMSpell: Spell Correction with Pre-Trained Language Models
Department of Computer Science and Engineering, University of Moratuwa(穆塔瓦大学计算机科学与工程系);School of Mathematical and Computational Sciences, Massey University(马希大学数学与计算科学学院)
Allen Institute for Artificial Intelligence(艾伦人工智能研究所);Paul G. Allen School of Computer Science & Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院);Center for Language and Speech Processing, Johns Hopkins University(约翰斯·霍普金斯大学语言与语音处理中心)
A Theoretical Understanding of Self-Correction through In-context Alignment
School of EECS, Peking University(北京大学电子工程与计算机科学学院);School of Mathematical Sciences, Peking University(北京大学数学科学学院);MIT CSAIL(麻省理工学院计算机科学与人工智能实验室);TU Munich(慕尼黑工业大学);Institute for Artificial Intelligence, Peking University(北京大学人工智能研究院)
S$^2$R: Teaching LLMs to Self-verify and Self-correct via Reinforcement Learning
Tencent(腾讯);Tsinghua University(清华大学);The University of Hong Kong(香港大学);Fudan University(复旦大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州))