Kwai-STaR: Transform LLMs into State-Transition Reasoners
Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);Kuaishou Technology(快手科技);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Pengcheng Laboratory(鹏城实验室)
Xingyu Lu, Yuhang Hu, Changyi Liu, Tianke Zhang, Zhenyu Yang, Zhixiang Ding, Shengsheng Qian, Meng Du, Ruiwen Kang, Kaiyu Tang, Fan Yang, Tingting Gao, Di Zhang… 展开作者
Xingyu Lu, Yuhang Hu, Changyi Liu, Tianke Zhang, Zhenyu Yang, Zhixiang Ding, Shengsheng Qian, Meng Du, Ruiwen Kang, Kaiyu Tang, Fan Yang, Tingting Gao, Di Zhang, Hai-Tao Zheng, Bin Wen
Mathematical reasoning presents a significant challenge to the cognitive capabilities of LLMs. Various methods have been proposed to enhance the mathematical ability of LLMs. However, few recognize the value of state transition for LLM reasoning. In this work, we define mathematical problem-solving as a process of transiting from an initial unsolved state to the final resolved state, and propose Kwai-STaR framework, which transforms LLMs into State-Transition Reasoners to improve their intuitive reasoning capabilities. Our approach comprises three main steps: (1) Define the state space tailored to the mathematical reasoning. (2) Generate state-transition data based on the state space. (3) Convert original LLMs into State-Transition Reasoners via a curricular training strategy. Our experiments validate the effectiveness of Kwai-STaR in enhancing mathematical reasoning: After training on the small-scale Kwai-STaR dataset, general LLMs, including Mistral-7B and LLaMA-3, achieve considerable performance gain on the GSM8K and GSM-Hard dataset. Additionally, the state transition-based design endows Kwai-STaR with remarkable training and inference efficiency. Further experiments are underway to establish the generality of Kwai-STaR.
Coevolutionary Continuous Discrete Diffusion: Make Your Diffusion Language Model a Latent Reasoner
Massachusetts Institute of Technology(麻省理工学院);Microsoft Research(微软研究院);Toyota Technological Institute at Chicago(丰田技术研究所(芝加哥));Peking University(北京大学);Tsinghua University(清华大学)
Step Back to Leap Forward: Self-Backtracking for Boosting Reasoning of Language Models
Nanjing University(南京大学);National Key Laboratory for Novel Software Technology(现代软件工程国家重点实验室);School of Artificial Intelligence, Nanjing University(南京大学人工智能学院);School of Intelligence Science and Technology, Nanjing University(南京大学智能科学与技术学院)
Unveiling Causal Reasoning in Large Language Models: Reality or Mirage?
Intelligent Game and Decision Lab(智能游戏与决策实验室);National University of Defense Technology(国防科技大学);University of Melbourne(墨尔本大学);University of Sydney(悉尼大学);Hong Kong Baptist University(香港 Baptist 大学)
DECIDER: A Dual-System Rule-Controllable Decoding Framework for Language Generation
Key Laboratory of Brain Health Intelligent Evaluation and Intervention, Ministry of Education, School of Medical Technology, Bejing Institute of Technology (BIT), China(脑健康智能评估与干预关键实验室,教育部,医学技术学院,北京理工大学(BIT),中国);School of Computer Science and Technology, BIT, China(计算机科学与技术学院,北京理工大学(BIT),中国);Nanjing University of Aeronautics and Astronautics, Nanjing, China(南京航空航天大学,南京,中国)
Learning Efficient and Generalizable Graph Retriever for Knowledge-Graph Question Answering
Mohamed bin Zayed University of Artificial Intelligence(莫扎德·本·扎耶德人工智能大学);Peking university(北京大学);Georgia Institute of Technology(佐治亚理工学院);The University of Sydney(悉尼大学);Carnegie Mellon University(卡内基梅隆大学)