This paper takes a first step towards a critical thinking curriculum for neural auto-regressive language models. We introduce a synthetic corpus of deductively valid arguments, and generate artificial argumentative texts to train and evaluate GPT-2. Significant transfer learning effects can be observed: Training a model on three simple core schemes allows it to accurately complete conclusions of different, and more complex types of arguments, too. The language models generalize the core argument schemes in a correct way. Moreover, we obtain consistent and promising results for NLU benchmarks. In particular, pre-training on the argument schemes raises zero-shot accuracy on the GLUE diagnostics by up to 15 percentage points. The findings suggest that intermediary pre-training on texts that exemplify basic reasoning abilities (such as typically covered in critical thinking textbooks) might help language models to acquire a broad range of reasoning skills. The synthetic argumentative texts presented in this paper are a promising starting point for building such a "critical thinking curriculum for language models."
School of Informatics, Xiamen University, China(厦门大学信息学院);Department of Digital Media Technology, Xiamen University, China(厦门大学数字媒体技术系);Baidu Inc., Beijing, China(百度公司)
Faculty of Electrical Engineering, Czech Technical University in Prague(布拉格捷克技术大学电气工程学院);Czech Institute of Informatics, Robotics and Cybernetics, Czech Technical University in Prague(布拉格捷克技术大学捷克信息学、机器人学与控制论研究所)
Ontology-Guided Reverse Thinking Makes Large Language Models Stronger on Knowledge Graph Question Answering
Harbin Institute of Technology(哈尔滨工业大学);Beijing University of Posts and Telecommunications(北京邮电大学);Joint Laboratory of HIT and iFLYTEK(哈工大与科大讯飞联合实验室);University of Science and Technology of China(中国科学技术大学);Pengcheng Laboratory(鹏城实验室)
Multi-Persona Thinking for Bias Mitigation in Large Language Models
Dept. Computing Science, Alberta Machine Intelligence Institute (Amii) University of Alberta, Canada(计算科学系,阿尔伯塔机器智能研究所(Amii),阿尔伯塔大学,加拿大);Canada CIFAR AI Chair, Amii(加拿大 CIFAR 人工智能主席,Amii)
ExpLang: Improved Exploration and Exploitation in LLM Reasoning with On-Policy Thinking Language Selection
National Key Laboratory for Novel Software Technology, Nanjing University, Jiangsu, China(新型软件技术国家重点实验室,南京大学,江苏,中国);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室,上海,中国);Department of Linguistics and Translation, City University of Hong Kong, Hong Kong, China(语言学与翻译系,香港城市大学,香港,中国);School of Mathematical Sciences, Dalian University of Technology, Liaoning, China(数学科学学院,大连理工大学,辽宁,中国)
Language Models as Critical Thinking Tools: A Case Study of Philosophers
Stanford University(斯坦福大学);University of Washington(华盛顿大学);Paul G. Allen School of Computer Science and Engineering, University of Washington(华盛顿大学保罗·G·艾伦计算机科学与工程学院)
Latent Thinking Optimization: Your Latent Reasoning Language Model Secretly Encodes Reward Signals in Its Latent Thoughts
Department of Computer Science and Engineering, The Ohio State University, USA(计算机科学与工程系,俄亥俄州立大学);Department of Biomedical Informatics, The Ohio State University, USA(生物医学信息学系,俄亥俄州立大学);Translational Data Analytics Institute, The Ohio State University, USA(转化数据分析研究所,俄亥俄州立大学)
BRAINTEASER: Lateral Thinking Puzzles for Large Language Models
Information Sciences Institute, Viterbi School of Engineering, University of Southern California(南加州大学维特比工程学院信息科学研究所);Department of Computer Science, Faculty of Science, Vrije Universiteit Amsterdam(阿姆斯特丹自由大学理学院计算机科学系);Tencent AI Lab(腾讯AI实验室)
Incentivizing Dual Process Thinking for Efficient Large Language Model Reasoning
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学人工智能学院);Department of Computer Science, National University of Singapore(新加坡国立大学计算机科学系);Ant Group(蚂蚁集团)
Perspectra: Choosing Your Experts Enhances Critical Thinking in Multi-Agent Research Ideation
Informatics, University of Illinois Urbana-Champaign(信息学,伊利诺伊大学厄巴纳-香槟分校);Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign(Siebel 计算与数据科学学院,伊利诺伊大学厄巴纳-香槟分校);Department of Computer Science, University of Toronto(计算机科学系,多伦多大学);Allen Institute for AI(人工智能研究院);School of Information Sciences, University of Illinois at Urbana-Champaign(信息科学学院,伊利诺伊大学厄巴纳-香槟分校)
Toward LLM-Supported Automated Assessment of Critical Thinking Subskills
University of Minnesota(明尼苏达大学);University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校);Adelaide University(阿德莱德大学);Brighter Research(Brighter研究公司);Educational Testing Service (ETS)(教育考试服务中心(ETS))
Distilling Reasoning Ability from Large Language Models with Adaptive Thinking
College of Computer Science and Technology, National University of Defense Technology(计算机科学与技术学院,国防科技大学);College of Intelligence Science and Technology, National University of Defense Technology(智能科学与技术学院,国防科技大学)
Benchmarking the Thinking Mode of Multimodal Large Language Models in Clinical Tasks
Bytedance(字节跳动);Peking University(北京大学);The Chinese University of Hong Kong(香港中文大学);The University of Hong Kong(香港大学);Mohamed bin Zayed University of Artificial Intelligence(马尔代夫人工智能大学);Stanford University(斯坦福大学);University of Michigan(密歇根大学)
When Models Reason in Your Language: Controlling Thinking Language Comes at the Cost of Accuracy
University of Groningen(格罗宁根大学);Harvard University(哈佛大学);Mass General Brigham(麻省总医院);Boston Children’s Hospital(波士顿儿童医院);University of Amsterdam(阿姆斯特丹大学)
Large Language Models Align with the Human Brain during Creative Thinking
EPFL(瑞士联邦理工学院洛桑);Università della Svizzera italiana (USI)(意大利语区大学(瑞士));Wesleyan University(卫斯理大学);Paris Brain Institute (ICM)(巴黎大脑研究所);Pennsylvania State University(宾夕法尼亚州立大学)
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security, University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Baidu Inc.(百度公司);School of Artificial Intelligence, Beijing Normal University(北京师范大学人工智能学院)
DeepRAG: Thinking to Retrieve Step by Step for Large Language Models
Chinese Information Processing Laboratory, Institute of Software, Chinese Academy of Sciences(中国科学院软件研究所信息处理实验室);University of Chinese Academy of Sciences(中国科学院大学);Pattern Recognition Center, WeChat AI, Tencent Inc, China(腾讯人工智能部模式识别中心)