大模型推理能力

Know When to Explore: Difficulty-Aware Certainty as a Guide for LLM Reinforcement Learning

Ang Li, Zhihang Yuan, Yang Zhang, Shouda Liu, Yisen Wang

机构 * PKU（北京大学） ； ByteDance Seed（字节跳动种子） 纠错

专题命中 数学推理 ：reasoning(abstract)；test-time compute(abstract)；分类 cs.AI

Structural Reformation of Large Language Model Neuron Encapsulation for Divergent Information Aggregation

Denis Bakushev, Gideon Boultinghouse, Harriet Oppenheimer, Sebastian Gillingwater, Valentina Ashington, Wilfred Stanborough

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Comments arXiv admin note: This paper has been withdrawn by arXiv due to disputed and unverifiable authorship

BloomWise: Enhancing Problem-Solving capabilities of Large Language Models using Bloom's-Taxonomy-Inspired Prompts

Maria-Eleni Zoumpoulidi, Georgios Paraskevopoulos, Alexandros Potamianos

机构 * Speech and Language Processing Group, National Technical University of Athens（国家技术大学雅典语音与语言处理组） ； Institute for Language and Speech Processing, Athena Research Center（雅典研究中心语言与语音处理研究所） ； National Technical University of Athens（国家技术大学雅典） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments 16 pages, 2 figures

Error Detection and Correction for Interpretable Mathematics in Large Language Models

Yijin Yang, Cristina Cornelio, Mario Leiva, Paulo Shakarian

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Everyone Contributes! Incentivizing Strategic Cooperation in Multi-LLM Systems via Sequential Public Goods Games

Yunhao Liang, Yuan Qu, Jingyuan Yang, Shaochong Lin, Zuo-Jun Max Shen

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Findings of MEGA: Maths Explanation with LLMs using the Socratic Method for Active Learning

Tosin Adewumi, Foteini Simistira Liwicki, Marcus Liwicki, Viktor Gardelli, Lama Alkhaled, Hamam Mokayed

机构 * Department of Electrical and Computer Engineering, Michigan State University（密歇根州立大学电气与计算机工程系） 纠错

专题命中 数学推理 ：reasoning(abstract)；CoT(abstract)；分类 cs.CL

Comments This paper was accepted for the special issue AI for Education by the IEEE Signal Processing Magazine journal

Data Diversification Methods In Alignment Enhance Math Performance In LLMs

Berkan Dokmeci, Qingyang Wu, Ben Athiwaratkun, Ce Zhang, Shuaiwen Leon Song, James Zou

机构 * Washington University in St. Louis（华盛顿大学圣路易斯分校） ； Together AI ； University of Chicago（芝加哥大学） ； Stanford University（斯坦福大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Program of Equations Thoughts to Solve Algebra Word Problems

Yunze Lin

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Comments Withdrawn pending institutional authorization and core revisions to address methodological inconsistencies in Sections 3-4

Evaluation of LLMs for mathematical problem solving

Ruonan Wang, Runxi Wang, Yunwen Shen, Chengfeng Wu, Qinglin Zhou, Rohitash Chandra

机构 * Transitional Artificial Intelligence Research Group, School of Mathematics and Statistics, UNSW Sydney, Sydney, Australia（过渡人工智能研究组，数学与统计学学院） 纠错

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Distilling Tool Knowledge into Language Models via Back-Translated Traces

Xingyue Huang, Xianglong Hu, Zifeng Ding, Yuan He, Rishabh, Waleed Alzarooni, Ziyu Ye, Wendong Fan, Bailan He, Haige Bo, Changran Hu, Guohao Li

机构 * University of Oxford（牛津大学） ； Amazon（亚马逊公司） ； University of Cambridge（剑桥大学） ； University of Los Angeles（洛杉矶大学） ； University of Chicago（芝加哥大学） ； Ludwig Maximilian University of Munich（慕尼黑莱布尼茨大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；planning(abstract)；分类 cs.LG

Comments Accepted in Workshop in Multi-Agent Systems in the Era of Foundation Models: Opportunities, Challenges and Futures, ICML 2025

Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps

Jiashun Cheng, Aochuan Chen, Nuo Chen, Ziqi Gao, Yuhan Li, Jia Li, Fugee Tsung

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.LG

Comments 18 pages; Accepted to ACL 2025 Findings

Rectified Sparse Attention

Yutao Sun, Tianzhu Ye, Li Dong, Yuqing Xia, Jian Chen, Yizhao Gao, Shijie Cao, Jianyong Wang, Furu Wei

机构 * Microsoft Research（微软研究院） ； Tsinghua University（清华大学） ； The University of Hong Kong（香港大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Large Language Models Struggle with Unreasonability in Math Problems

Jingyuan Ma, Damai Dai, Zihang Yuan, Rui li, Weilin Luo, Bin Wang, Qun Liu, Lei Sha, Zhifang Sui

机构 * National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University（国家多媒体信息处理重点实验室，计算机学院，北京大学） ； Institute of Artificial Intelligence, Beihang University（人工智能学院，北航） ； Huawei Noah’s Ark Lab, China（华为诺亚实验室，中国） 纠错

专题命中 数学推理 ：reasoning(abstract)；self-correction(abstract)；分类 cs.CL

Comments 32 pages, 8 figures

Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research

Qianqian Zhang, Jiajia Liao, Heting Ying, Yibo Ma, Haozhan Shen, Jingcheng Li, Peng Liu, Lu Zhang, Chunxin Fang, Kyusong Lee, Ruochen Xu, Tiancheng Zhao

机构 * Om AI Research（Om AI研究机构） ； Binjiang Institute of Zhejiang University（浙江大学滨江学院） ； College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院） 纠错

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments Accepted by ACL 2025 Demo

A Structured Unplugged Approach for Foundational AI Literacy in Primary Education

Maria Cristina Carrisi, Mirko Marras, Sara Vergallo

机构 * University of Cagliari（卡利亚里大学） ； University of Macerata（马切拉塔大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.AI

Comments Under review

Step-Wise Formal Verification for LLM-Based Mathematical Problem Solving

Kuo Zhou, Lu Zhang

机构 * Peking University（北京大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.AI

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting

Rui Pan, Dylan Zhang, Hanning Zhang, Xingyuan Pan, Minrui Xu, Jipeng Zhang, Renjie Pi, Xiaoyu Wang, Tong Zhang

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； The Hong Kong University of Science and Technology（香港科学与技术大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.LG

Comments ACL 2025

MDIT: A Model-free Data Interpolation Method for Diverse Instruction Tuning

Yangning Li, Zihua Lan, Lv Qingsong, Yinghui Li, Hai-Tao Zheng

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization

Shujin Wu, Cheng Qian, Yi R. Fung, Paul Pu Liang, Heng Ji

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Large (Vision) Language Models are Unsupervised In-Context Learners

Artyom Gadetsky, Andrei Atanov, Yulun Jiang, Zhitong Gao, Ghazal Hosseini Mighan, Amir Zamir, Maria Brbic

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.LG

Comments ICLR 2025 camera-ready

MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

Hanqing Wang, Yixia Li, Shuo Wang, Guanhua Chen, Yun Chen

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments This paper has been accepted at NAACL 2025. Code is available at: https://github.com/sufenlp/MiLoRA

SPPD: Self-training with Process Preference Learning Using Dynamic Value Margin

Hao Yi, Qingyang Li, Yulan Hu, Fuzheng Zhang, Di Zhang, Yong Liu

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.AI

Deception in LLMs: Self-Preservation and Autonomous Goals in Large Language Models

Sudarshan Kamath Barkur, Sigurd Schacht, Johannes Scholl

专题命中 数学推理 ：reasoning(abstract)；planning(abstract)；分类 cs.CL

Comments Corrected Version - Solved Some Issues with reference compilation by latex

Control LLM: Controlled Evolution for Intelligence Retention in LLM

Haichao Wei, Yunxiang Ren, Zhoutong Fu, Aman Lunia, Yi-Lin Chen, Alice Leung, Ya Xu

专题命中 数学推理 ：reasoning(abstract)；CoT(abstract)；分类 cs.LG

Comments 8 pages

Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks

Qintong Li, Leyang Cui, Lingpeng Kong, Wei Bi

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments We release our resources at \url{https://github.com/qtli/CoEval}

Dynamic Skill Adaptation for Large Language Models

Jiaao Chen, Diyi Yang

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions

Hang Li, Tianlong Xu, Kaiqi Yang, Yucheng Chu, Yanling Chen, Yichi Song, Qingsong Wen, Hui Liu

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments 12 pages, 4 figures

Algorithmic Phase Transitions in Language Models: A Mechanistic Case Study of Arithmetic

Alan Sun, Ethan Sun, Warren Shepard

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Comments 10 pages, 5 figures

Can Language Models Enable In-Context Database?

Yu Pan, Hongfeng Yu, Tianjiao Zhao, Jianxin Sun

专题命中 数学推理 ：reasoning(abstract)；planning(abstract)；分类 cs.AI

Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions

Pengfei Hong, Navonil Majumder, Deepanway Ghosal, Somak Aditya, Rada Mihalcea, Soujanya Poria

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Comments With o1 and GPT-4o results. Reformatted the data and presented more analysis