大模型推理能力

Large Language Models and Mathematical Reasoning Failures

Johan Boye, Birger Moell

专题命中 数学推理 ：reasoning(title,abstract)；planning(abstract)；分类 cs.AI

PersonaMath: Boosting Mathematical Reasoning via Persona-Driven Data Augmentation

Jing Luo, Longze Chen, Run Luo, Liang Zhu, Chang Ao, Jiaming Li, Yukun Chen, Xin Cheng, Wen Yang, Jiayuan Su, Ahmadreza Argha, Hamid Alinejad-Rokny, Chengming Li, Shiwen Ni, Min Yang

机构 * Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences（中国科学院深圳先进技术研究院） ； University of Chinese Academy of Sciences（中国科学院大学） ； Shenzhen University of Advanced Technology（深圳理工大学） ； South China University of Technology（华南理工大学） ； Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所） ； Zhejiang University（浙江大学） ； Shenzhen MSU-BIT University（深圳北理莫斯科大学） ； UNSW Sydney（新南威尔士大学悉尼分校） 纠错

专题命中 数学推理 ：reasoning(title)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL

Reasoning with Reinforced Functional Token Tuning

Kongcheng Zhang, Qi Yao, Baisheng Lai, Jiaxing Huang, Wenkai Fang, Dacheng Tao, Mingli Song, Shunyu Liu

机构 * Zhejiang University（浙江大学） ； Alibaba Cloud Computing（阿里巴巴云计算） ； Nanyang Technological University（南洋理工大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.AI

BOLT: Bootstrap Long Chain-of-Thought in Language Models without Distillation

Bo Pang, Hanze Dong, Jiacheng Xu, Silvio Savarese, Yingbo Zhou, Caiming Xiong

机构 * Salesforce AI Research（Salesforce人工智能研究院） 纠错

专题命中 数学推理 ：chain-of-thought(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments 36 pages

Self-Refine Instruction-Tuning for Aligning Reasoning in Language Models

Leonardo Ranaldi, Andrè Freitas

机构 * Idiap Research Institute（伊迪亚普研究所） ； University of Manchester（曼彻斯特大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

Journal ref Proceedings of the 2024 Conference on Empirical Methods in Natural Language Processing

OpenAI-o1 AB Testing: Does the o1 model really do good reasoning in math problem solving?

Leo Li, Ye Luo, Tingyou Pan

专题命中 数学推理 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.AI

CMM-Math: A Chinese Multimodal Math Dataset To Evaluate and Enhance the Mathematics Reasoning of Large Multimodal Models

Wentao Liu, Qianjun Pan, Yi Zhang, Zhuo Liu, Ji Wu, Jie Zhou, Aimin Zhou, Qin Chen, Bo Jiang, Liang He

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

ReasonAgain: Using Extractable Symbolic Programs to Evaluate Mathematical Reasoning

Xiaodong Yu, Ben Zhou, Hao Cheng, Dan Roth

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.AI

Improving Small-Scale Large Language Models Function Calling for Reasoning Tasks

Graziano A. Manduzio, Federico A. Galatolo, Mario G. C. A. Cimino, Enzo Pasquale Scilingo, Lorenzo Cominelli

专题命中 数学推理 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.AI

LLM Critics Help Catch Bugs in Mathematics: Towards a Better Mathematical Verifier with Natural Language Feedback

Bofei Gao, Zefan Cai, Runxin Xu, Peiyi Wang, Ce Zheng, Runji Lin, Keming Lu, Dayiheng Liu, Chang Zhou, Wen Xiao, Junjie Hu, Tianyu Liu, Baobao Chang

专题命中 数学推理 ：verifier(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments 15 pages

Enhancing Mathematical Reasoning in LLMs by Stepwise Correction

Zhenyu Wu, Qingkai Zeng, Zhihan Zhang, Zhaoxuan Tan, Chao Shen, Meng Jiang

专题命中 数学推理 ：reasoning(title,abstract)；verifier(abstract)；分类 cs.CL

Comments under review

Self-Explore: Enhancing Mathematical Reasoning in Language Models with Fine-grained Rewards

Hyeonbin Hwang, Doyoung Kim, Seungone Kim, Seonghyeon Ye, Minjoon Seo

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Comments EMNLP Findings 2024 Camera Ready

Analysis on Riemann Hypothesis with Cross Entropy Optimization and Reasoning

Kevin Li, Fulu Li

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.AI

Comments 13 pages, 3 figures

NumeroLogic: Number Encoding for Enhanced LLMs' Numerical Reasoning

Eli Schwartz, Leshem Choshen, Joseph Shtok, Sivan Doveh, Leonid Karlinsky, Assaf Arbelle

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Step-Controlled DPO: Leveraging Stepwise Error for Enhanced Mathematical Reasoning

Zimu Lu, Aojun Zhou, Ke Wang, Houxing Ren, Weikang Shi, Junting Pan, Mingjie Zhan, Hongsheng Li

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Question Translation Training for Better Multilingual Reasoning

Wenhao Zhu, Shujian Huang, Fei Yuan, Shuaijie She, Jiajun Chen, Alexandra Birch

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments Accepted to Findings of ACL 2024

Living in the Moment: Can Large Language Models Grasp Co-Temporal Reasoning?

Zhaochen Su, Juntao Li, Jun Zhang, Tong Zhu, Xiaoye Qu, Pan Zhou, Yan Bowen, Yu Cheng, Min zhang

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Comments This paper has been accepted to the ACL 2024 main conference

MAGDi: Structured Distillation of Multi-Agent Interaction Graphs Improves Reasoning in Smaller Language Models

Justin Chih-Yao Chen, Swarnadeep Saha, Elias Stengel-Eskin, Mohit Bansal

专题命中 数学推理 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

Comments ICML 2024 (Camera-ready); First two authors contributed equally; GitHub: https://github.com/dinobby/MAGDi

LangBridge: Multilingual Reasoning Without Multilingual Supervision

Dongkeun Yoon, Joel Jang, Sungdong Kim, Seungone Kim, Sheikh Shafayat, Minjoon Seo

专题命中 数学推理 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.CL

Comments ACL 2024 Main

A Chain-of-Thought Prompting Approach with LLMs for Evaluating Students' Formative Assessment Responses in Science

Clayton Cohn, Nicole Hutchins, Tuan Le, Gautam Biswas

专题命中 数学推理 ：chain-of-thought(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments In press at EAAI-24: The 14th Symposium on Educational Advances in Artificial Intelligence

MATHSENSEI: A Tool-Augmented Large Language Model for Mathematical Reasoning

Debrup Das, Debopriyo Banerjee, Somak Aditya, Ashish Kulkarni

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Prompt Space Optimizing Few-shot Reasoning Success with Large Language Models

Fobo Shi, Peijun Qing, Dong Yang, Nan Wang, Youbo Lei, Haonan Lu, Xiaodong Lin, Duantengchuan Li

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Comments Natural language processing (NLP)

Reasoning in Conversation: Solving Subjective Tasks through Dialogue Simulation for Large Language Models

Xiaolong Wang, Yile Wang, Yuanchi Zhang, Fuwen Luo, Peng Li, Maosong Sun, Yang Liu

专题命中 数学推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Solving Math Word Problems via Cooperative Reasoning induced Language Models

Xinyu Zhu, Junjie Wang, Lin Zhang, Yuxiang Zhang, Ruyi Gan, Jiaxing Zhang, Yujiu Yang

专题命中 数学推理 ：reasoning(title,abstract)；verifier(abstract)；分类 cs.CL

Comments Accepted to ACL 2023 Main Conference; Camera Ready

MCC-KD: Multi-CoT Consistent Knowledge Distillation

Hongzhan Chen, Siyue Wu, Xiaojun Quan, Rui Wang, Ming Yan, Ji Zhang

专题命中 数学推理 ：CoT(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments Accepted to ENMLP 2023

Explanation Selection Using Unlabeled Data for Chain-of-Thought Prompting

Xi Ye, Greg Durrett

专题命中 数学推理 ：chain-of-thought(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments EMNLP 2023

Let's reward step by step: Step-Level reward model as the Navigators for Reasoning

Qianli Ma, Haotian Zhou, Tingkai Liu, Jianbo Yuan, Pengfei Liu, Yang You, Hongxia Yang

专题命中 数学推理 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

REASONING GYM: Reasoning Environments for Reinforcement Learning with Verifiable Rewards

Zafir Stojanovski, Oliver Stanley, Joe Sharratt, Richard Jones, Abdulhakeem Adefioye, Jean Kaddour, Andreas Köpf

机构 * Open-Thought ； Scale AI ； University College London（伦敦大学学院） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2025 Spotlight. For code, see https://github.com/open-thought/reasoning-gym

MathCoder: Seamless Code Integration in LLMs for Enhanced Mathematical Reasoning

Ke Wang, Houxing Ren, Aojun Zhou, Zimu Lu, Sichun Luo, Weikang Shi, Renrui Zhang, Linqi Song, Mingjie Zhan, Hongsheng Li

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The state-of-the-art open-source language models for mathematical reasoning

Ladder Up, Memory Down: Low-Cost Fine-Tuning With Side Nets

向上爬，记忆下降：低成本微调与侧边网络

Estelle Zheng, Nathan Cerisara, Sébastien Warichet, Emmanuel Helbert, Christophe Cerisara

专题命中 数学推理 ：CoT(abstract,abstract_cn)；reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL、cs.LG

AI总结 LST通过轻量级侧边网络实现高效微调，比QLoRA更节省内存，同时在多个任务中保持竞争力。

Comments 24 pages, 20 figures