大模型推理能力

Advancing Mathematical Reasoning in Language Models: The Impact of Problem-Solving Data, Data Synthesis Methods, and Training Stages

Zui Chen, Tianqiao Liu, Mi Tian, Qing Tong, Weiqi Luo, Zitao Liu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ICLR 2025

Concise and Organized Perception Facilitates Reasoning in Large Language Models

Junjie Liu, Shaotian Yan, Chen Shen, Zhengdong Xiao, Liang Xie, Wenxiao Wang, Jieping Ye

机构 * Alibaba Cloud Computing（阿里云） ； Zhejiang University of Technology（浙江工业大学） ； Zhejiang University（浙江大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by NAACL2025 Findings

Procedural Knowledge in Pretraining Drives Reasoning in Large Language Models

Laura Ruis, Maximilian Mozes, Juhan Bae, Siddhartha Rao Kamalakara, Dwarak Talupuru, Acyr Locatelli, Robert Kirk, Tim Rocktäschel, Edward Grefenstette, Max Bartolo

机构 * AI Centre, UCL（伦敦大学学院AI中心） ； Cohere（Cohere公司） ； University of Toronto（多伦多大学） ； Vector Institute（矢量研究所） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments Published at ICLR 2025

Med-RLVR: Emerging Medical Reasoning from a 3B base model via reinforcement Learning

Sheng Zhang, Qianchu Liu, Guanghui Qin, Tristan Naumann, Hoifung Poon

机构 * Microsoft Research（微软研究院） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

DynaMath: A Dynamic Visual Benchmark for Evaluating Mathematical Reasoning Robustness of Vision Language Models

Chengke Zou, Xingang Guo, Rui Yang, Junyu Zhang, Bin Hu, Huan Zhang

机构 * University of Illinois at Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； University of California, Berkeley（加州大学伯克利分校） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by ICLR 2025

SIFT: Grounding LLM Reasoning in Contexts via Stickers

Zihao Zeng, Xuyao Huang, Boxiu Li, Zhijie Deng

机构 * Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Navigating Semantic Relations: Challenges for Language Models in Abstract Common-Sense Reasoning

Cole Gawin, Yidan Sun, Mayank Kejriwal

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 5 pages, 3 figures, ACM Web Conference 2025

GSM-Infinite: How Do Your LLMs Behave over Infinitely Increasing Context Length and Reasoning Complexity?

Yang Zhou, Hongyi Liu, Zhuoming Chen, Yuandong Tian, Beidi Chen

机构 * Carnegie Mellon University（卡内基梅隆大学） ； Meta AI 纠错

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

CARL-GT: Evaluating Causal Reasoning Capabilities of Large Language Models

Ruibo Tu, Hedvig Kjellström, Gustav Eje Henter, Cheng Zhang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

What Makes In-context Learning Effective for Mathematical Reasoning: A Theoretical Analysis

Jiayu Liu, Zhenya Huang, Chaokun Wang, Xunpeng Huang, Chengxiang Zhai, Enhong Chen

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

SmolTulu: Higher Learning Rate to Batch Size Ratios Can Lead to Better Reasoning in SLMs

Sultan Alrashed

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 10 pages, 4 figures, and 13 tables. For the SmolTulu-1.7b-instruct model, see: https://huggingface.co/SultanR/SmolTulu-1.7b-Instruct

Towards Learning to Reason: Comparing LLMs with Neuro-Symbolic on Arithmetic Relations in Abstract Reasoning

Michael Hersche, Giacomo Camposampiero, Roger Wattenhofer, Abu Sebastian, Abbas Rahimi

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Improving Mathematical Reasoning Capabilities of Small Language Models via Feedback-Driven Distillation

Xunyu Zhu, Jian Li, Can Ma, Weiping Wang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

LLaMA-Berry: Pairwise Optimization for O1-like Olympiad-Level Mathematical Reasoning

Di Zhang, Jianbo Wu, Jingdi Lei, Tong Che, Jiatong Li, Tong Xie, Xiaoshui Huang, Shufei Zhang, Marco Pavone, Yuqiang Li, Wanli Ouyang, Dongzhan Zhou

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Flow-DPO: Improving LLM Mathematical Reasoning through Online Multi-Agent Learning

Yihe Deng, Paul Mineiro

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.LG

Comments 5 pages, 4 figures, 1 table

Self-training Language Models for Arithmetic Reasoning

Marek Kadlčík, Michal Štefánik

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments To appear in Findings of EMNLP 2024. Reproducible implementations and references to resulting models can be found on https://github.com/prompteus/calc-x

Expanding Search Space with Diverse Prompting Agents: An Efficient Sampling Approach for LLM Mathematical Reasoning

Gisang Lee, Sangwoo Park, Junyoung Park, Andrew Chung, Sieun Park, Yoonah Park, Byungju Kim, Min-gyu Cho

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 4 figures

Teaching-Inspired Integrated Prompting Framework: A Novel Approach for Enhancing Reasoning in Large Language Models

Wenting Tan, Dongxiao Chen, Jieting Xue, Zihao Wang, Taijie Chen

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Exploring the Compositional Deficiency of Large Language Models in Mathematical Reasoning

Jun Zhao, Jingqi Tong, Yurong Mou, Ming Zhang, Qi Zhang, Xuanjing Huang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2024

Beyond Captioning: Task-Specific Prompting for Improved VLM Performance in Mathematical Reasoning

Ayush Singh, Mansi Gupta, Shivank Garg, Abhinav Kumar, Vansh Agrawal

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Weak-to-Strong Reasoning

Yuqing Yang, Yan Ma, Pengfei Liu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments EMNLP Findings 2024

Step-level Value Preference Optimization for Mathematical Reasoning

Guoxin Chen, Minpeng Liao, Chengxi Li, Kai Fan

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Camera ready version for EMNLP2024-Findings

MathGenie: Generating Synthetic Data with Question Back-translation for Enhancing Mathematical Reasoning of LLMs

Zimu Lu, Aojun Zhou, Houxing Ren, Ke Wang, Weikang Shi, Junting Pan, Mingjie Zhan, Hongsheng Li

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments ACL 2024 camera ready

MultiMath: Bridging Visual and Mathematical Reasoning for Large Language Models

Shuai Peng, Di Fu, Liangcai Gao, Xiuqin Zhong, Hongguang Fu, Zhi Tang

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Logic Contrastive Reasoning with Lightweight Large Language Model for Math Word Problems

Ding Kai, Ma Zhenguo, Yan Xiaoran

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

CodeGraph: Enhancing Graph Reasoning of LLMs with Code

Qiaolong Cai, Zhaowei Wang, Shizhe Diao, James Kwok, Yangqiu Song

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments In Progress

Timo: Towards Better Temporal Reasoning for Language Models

Zhaochen Su, Jun Zhang, Tong Zhu, Xiaoye Qu, Juntao Li, Min Zhang, Yu Cheng

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments This paper has been accepted to the COLM 2024 conference

On the consistent reasoning paradox of intelligence and optimal trust in AI: The power of 'I don't know'

Alexander Bastounis, Paolo Campodonico, Mihaela van der Schaar, Ben Adcock, Anders C. Hansen

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.AI、cs.LG

Comments 12 pages and 50 pages of supplementary material, 7 figures

FRoG: Evaluating Fuzzy Reasoning of Generalized Quantifiers in Large Language Models

Yiyuan Li, Shichao Sun, Pengfei Liu

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Under review

Improving Arithmetic Reasoning Ability of Large Language Models through Relation Tuples, Verification and Dynamic Feedback

Zhongtao Miao, Kaiyan Zhao, Yoshimasa Tsuruoka

专题命中 数学推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Under review, 25 figures, 8 tables, 29 pages