大模型推理能力 - arXivDaily 专题

2511.10850 2025-11-17 cs.CL cs.AI cs.LG 82%

Leveraging Parameter Space Symmetries for Reasoning Skill Transfer in LLMs

Stefan Horoi, Sangwoo Cho, Supriyo Chakraborty, Shi-Xiong Zhang, Sambit Sahu, Guy Wolf, Genta Indra Winata

机构 * Université de Montréal（蒙特利尔大学）； Mila – Quebec AI Institute（魁北克人工智能研究所）； Capital One（Capital One公司）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2505.15311 2025-11-13 cs.LG cs.AI cs.CL 82%

Trajectory Bellman Residual Minimization: A Simple Value-Based Method for LLM Reasoning

Yurun Yuan, Fan Chen, Zeyu Jia, Alexander Rakhlin, Tengyang Xie

机构 * UW-Madison（威斯康星大学麦迪逊分校）； MIT（麻省理工学院）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments NeurIPS 2025

2505.21600 2025-11-06 cs.CL cs.AI cs.LG cs.PF 82%

R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Token Routing

Tianyu Fu, Yi Ge, Yichen You, Enshu Liu, Zhihang Yuan, Guohao Dai, Shengen Yan, Huazhong Yang, Yu Wang

机构 * Tsinghua University（清华大学）； Infinigence AI ； Shanghai Jiao Tong University（上海交通大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2509.15207 2025-11-05 cs.LG cs.AI cs.CL 82%

FlowRL: Matching Reward Distributions for LLM Reasoning

Xuekai Zhu, Daixuan Cheng, Dinghuai Zhang, Hengli Li, Kaiyan Zhang, Che Jiang, Youbang Sun, Ermo Hua, Yuxin Zuo, Xingtai Lv, Qizheng Zhang, Lin Chen, Fanghao Shao, Bo Xue, Yunchong Song, Zhenjie Yang, Ganqu Cui, Ning Ding, Jianfeng Gao, Xiaodong Liu, Bowen Zhou, Hongyuan Mei, Zhouhan Lin

机构 * Shanghai Jiao Tong University（上海交通大学）； Shanghai AI Laboratory（上海人工智能实验室）； Microsoft Research（微软研究院）； Tsinghua University（清华大学）； Peking University（北京大学）； Renmin University of China（中国人民大学）； Stanford University（斯坦福大学）； Toyota Technological Institute at Chicago（芝加哥丰田技术研究所）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2504.00509 2025-11-04 cs.AI cs.CL cs.LG 82%

Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems?

Kai Yan, Yufei Xu, Zhengyin Du, Xuesong Yao, Zheyu Wang, Xiaowen Guo, Jiecao Chen

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 24 pages, 3 figures, 13 tables. The paper is accepted at AACL-IJCNLP 2025 (main track), and the latest version adds modifications in camera-ready

2510.03865 2025-11-03 cs.LG cs.AI cs.CL 82%

Unlocking Reasoning Capabilities in LLMs via Reinforcement Learning Exploration

Wenhao Deng, Long Wei, Chenglei Yu, Tailin Wu

机构 * Westlake University（西湖大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2510.25206 2025-10-30 cs.AI cs.CL cs.LG 82%

RAVR: Reference-Answer-guided Variational Reasoning for Large Language Models

Tianqianjin Lin, Xi Zhao, Xingyao Zhang, Rujiao Long, Yi Xu, Zhuoren Jiang, Wenbo Su, Bo Zheng

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 17 pages, 11 figures

2505.22453 2025-10-28 cs.CL cs.AI cs.CV cs.LG 82%

First SFT, Second RL, Third UPT: Continual Improving Multi-Modal LLM Reasoning via Unsupervised Post-Training

Lai Wei, Yuting Li, Chen Wang, Yue Wang, Linghe Kong, Weiran Huang, Lichao Sun

机构 * School of Computer Science, Shanghai Jiao Tong University（上海交通大学计算机科学学院）； Zhongguancun Academy（中关村学院）； Shanghai Innovation Institute（上海创新研究院）； Lehigh University（莱特大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted by NeurIPS 2025

2412.15238 2025-10-28 cs.CL cs.AI cs.LG cs.MA 82%

Dipper: Diversity in Prompts for Producing Large Language Model Ensembles in Reasoning tasks

Gregory Kang Ruey Lau, Wenyang Hu, Diwen Liu, Jizhuo Chen, See-Kiong Ng, Bryan Kian Hsiang Low

机构 * National University of Singapore（新加坡国立大学）； SAP（SAP公司）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Accepted to EMNLP 2025 Main Conference

2510.08325 2025-10-22 cs.AI cs.CL cs.LG 82%

Beyond Pass@k: Breadth-Depth Metrics for Reasoning Boundaries

Marius Dragoi, Ioana Pintilie, Florin Gogianu, Florin Brad

机构 * Bitdefender（Bitdefender公司）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 3 figures. v2 adds discussion of related work (G-Pass@k)

2505.03335 2025-10-17 cs.LG cs.AI cs.CL 82%

Absolute Zero: Reinforced Self-play Reasoning with Zero Data

Andrew Zhao, Yiran Wu, Yang Yue, Tong Wu, Quentin Xu, Yang Yue, Matthieu Lin, Shenzhi Wang, Qingyun Wu, Zilong Zheng, Gao Huang

机构 * Tsinghua University（清华大学）； Beijing Institute for General Artificial Intelligence（北京通用人工智能研究院）； Penn State University（宾夕法尼亚州立大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2510.10104 2025-10-14 cs.CV 82%

Answer-Consistent Chain-of-thought Reinforcement Learning For Multi-modal Large Langauge Models

Minbin Huang, Runhui Huang, Chuanyang Zheng, Jingyao Li, Guoxuan Chen, Han Shi, Hong Cheng

机构 * The Chinese University of Hong Kong（香港中文大学）； The University of Hong Kong（香港大学）； Huawei Noah’s Ark Lab（华为诺亚实验室）

专题命中数学推理：chain-of-thought(title)；reasoning(abstract)；math reasoning(abstract)

2510.07358 2025-10-10 cs.LG cs.AI cs.CL 82%

Encode, Think, Decode: Scaling test-time reasoning with recursive latent thoughts

Yeskendir Koishekenov, Aldo Lipani, Nicola Cancedda

机构 * FAIR at Meta（Meta的FAIR）； University College London（伦敦大学学院）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2510.01165 2025-10-02 cs.CL cs.AI cs.LG 82%

GRAD: Generative Retrieval-Aligned Demonstration Sampler for Efficient Few-Shot Reasoning

Oussama Gabouj, Kamel Charaf, Ivan Zakazov, Nicolas Baldwin, Robert West

机构 * EPFL（苏黎世联邦理工学院）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments EMNLP 2025 (findings)

2509.25133 2025-09-30 cs.LG cs.AI cs.CL 82%

Rethinking Entropy Regularization in Large Reasoning Models

Yuxian Jiang, Yafu Li, Guanxu Chen, Dongrui Liu, Yu Cheng, Jing Shao

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； Fudan University（复旦大学）； Shanghai Jiao Tong University（上海交通大学）； Chinese University of Hong Kong（香港中文大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2509.24147 2025-09-30 cs.CL cs.AI cs.LG 82%

Your thoughts tell who you are: Characterize the reasoning patterns of LRMs

Yida Chen, Yuning Mao, Xianjun Yang, Suyu Ge, Shengjie Bi, Lijuan Liu, Saghar Hosseini, Liang Tan, Yixin Nie, Shaoliang Nie

机构 * Harvard University（哈佛大学）； Meta Superintelligence Labs（Meta超智能实验室）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 32 pages, 28 figures

2503.18866 2025-09-30 cs.LG cs.AI cs.CL 82%

Reasoning to Learn from Latent Thoughts

Yangjun Ruan, Neil Band, Chris J. Maddison, Tatsunori Hashimoto

机构 * Stanford University（斯坦福大学）； University of Toronto（多伦多大学）； Vector Institute（向量研究所）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2509.21070 2025-09-26 cs.LG cs.AI cs.CL 82%

ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning

Qizhi Pei, Zhuoshi Pan, Honglin Lin, Xin Gao, Yu Li, Zinan Tang, Conghui He, Rui Yan, Lijun Wu

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学耿丽学校）； OpenDataLab, Shanghai Artificial Intelligence Laboratory（上海人工智能实验室）； Tsinghua University（清华大学）； School of Artificial Intelligence, Wuhan University（武汉大学人工智能学院）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 15 pages

2509.17318 2025-09-25 cs.AI cs.CL cs.LG 82%

CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models

Zhuofan Chen, Jiyuan He, Yichi Zhang, Xing Hu, Haoxing Wen, Jun Bai, Wenge Rong

机构 * School of Computer Science and Engineering, Beihang University, China（北京航空航天大学计算机科学与工程学院）； Meituan Inc.（美团公司）； Beijing Institute for General Artificial Intelligence, China（北京通用人工智能研究院）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2502.10454 2025-08-25 cs.LG cs.AI cs.CL 82%

One Example Shown, Many Concepts Known! Counterexample-Driven Conceptual Reasoning in Mathematical LLMs

Yinghui Li, Jiayi Kuang, Haojing Huang, Zhikun Xu, Xinnian Liang, Yi Yu, Wenlian Lu, Yangning Li, Xiaoyu Tan, Chao Qu, Ying Shen, Hai-Tao Zheng, Philip S. Yu

机构 * Tsinghua University（清华大学）； Sun-Yat Sen University（孙中山大学）； School of Mathematical Science, Fudan University（复旦大学数学学院）； Bytedance Inc.（字节跳动公司）； INFLY TECH (Shanghai) Co., Ltd.（INFLY TECH（上海）有限公司）； ARC Lab, Arizona State University（ARC实验室，亚利桑那州立大学）； University of Illinois Chicago（伊利诺伊大学芝加哥分校）； Peng Cheng Laboratory（鹏城实验室）； Guangdong Provincial Key Laboratory of Fire Science（广东省消防科学与智能应急技术重点实验室）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments ICML 2025

2504.19483 2025-07-28 cs.LG cs.AI cs.CL 82%

Improving Reasoning Performance in Large Language Models via Representation Engineering

Bertram Højer, Oliver Jarvis, Stefan Heinrich

机构 * Department of Computer Science, IT University of Copenhagen（计算机科学系，丹麦技术大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments Has been accepted at "The Thirteenth International Conference on Learning Representations (ICLR 2025)" Link to publication: https://openreview.net/forum?id=IssPhpUsKt

Journal ref 13th International Conference on Learning Representations (ICLR 2025)

2507.08806 2025-07-15 cs.AI cs.CL cs.LG 82%

Think Clearly: Improving Reasoning via Redundant Token Pruning

Daewon Choi, Jimin Lee, Jihoon Tack, Woomin Song, Saket Dingliwal, Sai Muralidhar Jayanthi, Bhavana Ganesh, Jinwoo Shin, Aram Galstyan, Sravan Babu Bodapati

机构 * KAIST（韩国科学技术院）； Korea University（韩国大学）； Amazon AGI（亚马逊人工智能实验室）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2506.18330 2025-06-26 cs.LG cs.AI cs.CL 82%

Confucius3-Math: A Lightweight High-Performance Reasoning LLM for Chinese K-12 Mathematics Learning

Lixin Wu, Na Cai, Qiao Cheng, Jiachen Wang, Yitao Duan

机构 * NetEase Youdao（网易有道）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2506.19767 2025-06-25 cs.CL cs.AI cs.LG 82%

SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning

Yuqian Fu, Tinghong Chen, Jiajun Chai, Xihuai Wang, Songjun Tu, Guojun Yin, Wei Lin, Qichao Zhang, Yuanheng Zhu, Dongbin Zhao

机构 * Institute of Automation, Chinese Academy of Sciences（中国科学院自动化研究所）； School of Artificial Intelligence, University of Chinese Academy of Sciences（中国科学院大学人工智能学院）； Meituan（美团）； Shanghai Jiao Tong University（上海交通大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2410.13857 2025-06-24 cs.LG cs.AI cs.CL stat.ML 82%

How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMs

Guhao Feng, Kai Yang, Yuntian Gu, Xinyue Ai, Shengjie Luo, Jiacheng Sun, Di He, Zhenguo Li, Liwei Wang

机构 * State Key Laboratory of General Artificial Intelligence, School of Intelligence Science and Technology, Peking University（通用人工智能国家重点实验室，智能科学与技术学院，北京大学）； School of EECS, Peking University（电子工程系，北京大学）； Huawei Noah’s Ark Lab（华为诺亚实验室）； Center for Machine Learning Research, Peking University（机器学习研究中心，北京大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 40 pages, 4 figures, ACL 2025 Findings

2506.13923 2025-06-23 cs.LG cs.AI cs.CL 82%

Adaptive Guidance Accelerates Reinforcement Learning of Reasoning Models

Vaskar Nath, Elaine Lau, Anisha Gunjal, Manasi Sharma, Nikhil Baharte, Sean Hendryx

机构 * Scale AI

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2506.14965 2025-06-19 cs.LG cs.AI cs.CL 82%

Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective

Zhoujun Cheng, Shibo Hao, Tianyang Liu, Fan Zhou, Yutao Xie, Feng Yao, Yuexin Bian, Yonghao Zhuang, Nilabjo Dey, Yuheng Zha, Yi Gu, Kun Zhou, Yuqi Wang, Yuan Li, Richard Fan, Jianshu She, Chengqian Gao, Abulhair Saparov, Haonan Li, Taylor W. Killian, Mikhail Yurochkin, Zhengzhong Liu, Eric P. Xing, Zhiting Hu

机构 * Carnegie Mellon University（卡内基梅隆大学）； Purdue University（普渡大学）

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 38 pages, 9 figures. Under review

2506.13284 2025-06-17 cs.CL cs.AI cs.LG 82%

AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy

Zihan Liu, Zhuolin Yang, Yang Chen, Chankyu Lee, Mohammad Shoeybi, Bryan Catanzaro, Wei Ping

机构 * NVIDIA

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments The AceReason-Nemotron collection: https://huggingface.co/collections/nvidia/acereason-682f4e1261dc22f697fd1485

2506.09967 2025-06-17 cs.CL cs.AI cs.LG 82%

Resa: Transparent Reasoning Models via SAEs

Shangshang Wang, Julian Asilis, Ömer Faruk Akgül, Enes Burak Bilgin, Ollie Liu, Deqing Fu, Willie Neiswanger

专题命中数学推理：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

2506.10987 2025-06-16 cs.SE 82%

Chain of Draft for Software Engineering: Challenges in Applying Concise Reasoning to Code Tasks

Shaoyi Yang

专题命中数学推理：reasoning(title,abstract)；CoT(abstract)

1. 数学推理 3258 篇

Leveraging Parameter Space Symmetries for Reasoning Skill Transfer in LLMs

Trajectory Bellman Residual Minimization: A Simple Value-Based Method for LLM Reasoning

R2R: Efficiently Navigating Divergent Reasoning Paths with Small-Large Model Token Routing

FlowRL: Matching Reward Distributions for LLM Reasoning

Recitation over Reasoning: How Cutting-Edge Language Models Can Fail on Elementary School-Level Reasoning Problems?

Unlocking Reasoning Capabilities in LLMs via Reinforcement Learning Exploration

RAVR: Reference-Answer-guided Variational Reasoning for Large Language Models

First SFT, Second RL, Third UPT: Continual Improving Multi-Modal LLM Reasoning via Unsupervised Post-Training

Dipper: Diversity in Prompts for Producing Large Language Model Ensembles in Reasoning tasks

Beyond Pass@k: Breadth-Depth Metrics for Reasoning Boundaries

Absolute Zero: Reinforced Self-play Reasoning with Zero Data

Answer-Consistent Chain-of-thought Reinforcement Learning For Multi-modal Large Langauge Models

Encode, Think, Decode: Scaling test-time reasoning with recursive latent thoughts

GRAD: Generative Retrieval-Aligned Demonstration Sampler for Efficient Few-Shot Reasoning

Rethinking Entropy Regularization in Large Reasoning Models

Your thoughts tell who you are: Characterize the reasoning patterns of LRMs

Reasoning to Learn from Latent Thoughts

ScaleDiff: Scaling Difficult Problems for Advanced Mathematical Reasoning

CogAtom: From Cognitive Atoms to Olympiad-level Mathematical Reasoning in Large Language Models

One Example Shown, Many Concepts Known! Counterexample-Driven Conceptual Reasoning in Mathematical LLMs

Improving Reasoning Performance in Large Language Models via Representation Engineering

Think Clearly: Improving Reasoning via Redundant Token Pruning

Confucius3-Math: A Lightweight High-Performance Reasoning LLM for Chinese K-12 Mathematics Learning

SRFT: A Single-Stage Method with Supervised and Reinforcement Fine-Tuning for Reasoning

How Numerical Precision Affects Arithmetical Reasoning Capabilities of LLMs

Adaptive Guidance Accelerates Reinforcement Learning of Reasoning Models

Revisiting Reinforcement Learning for LLM Reasoning from A Cross-Domain Perspective

AceReason-Nemotron 1.1: Advancing Math and Code Reasoning through SFT and RL Synergy

Resa: Transparent Reasoning Models via SAEs

Chain of Draft for Software Engineering: Challenges in Applying Concise Reasoning to Code Tasks