大模型推理能力

Program of Equations Thoughts to Solve Algebra Word Problems

Yunze Lin

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Comments Withdrawn pending institutional authorization and core revisions to address methodological inconsistencies in Sections 3-4

Evaluation of LLMs for mathematical problem solving

Ruonan Wang, Runxi Wang, Yunwen Shen, Chengfeng Wu, Qinglin Zhou, Rohitash Chandra

机构 * Transitional Artificial Intelligence Research Group, School of Mathematics and Statistics, UNSW Sydney, Sydney, Australia（过渡人工智能研究组，数学与统计学学院） 纠错

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI

Distilling Tool Knowledge into Language Models via Back-Translated Traces

Xingyue Huang, Xianglong Hu, Zifeng Ding, Yuan He, Rishabh, Waleed Alzarooni, Ziyu Ye, Wendong Fan, Bailan He, Haige Bo, Changran Hu, Guohao Li

机构 * University of Oxford（牛津大学） ； Amazon（亚马逊公司） ； University of Cambridge（剑桥大学） ； University of Los Angeles（洛杉矶大学） ； University of Chicago（芝加哥大学） ； Ludwig Maximilian University of Munich（慕尼黑莱布尼茨大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；planning(abstract)；分类 cs.LG

Comments Accepted in Workshop in Multi-Agent Systems in the Era of Foundation Models: Opportunities, Challenges and Futures, ICML 2025

Revisiting LoRA through the Lens of Parameter Redundancy: Spectral Encoding Helps

Jiashun Cheng, Aochuan Chen, Nuo Chen, Ziqi Gao, Yuhan Li, Jia Li, Fugee Tsung

机构 * The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.LG

Comments 18 pages; Accepted to ACL 2025 Findings

Rectified Sparse Attention

Yutao Sun, Tianzhu Ye, Li Dong, Yuqing Xia, Jian Chen, Yizhao Gao, Shijie Cao, Jianyong Wang, Furu Wei

机构 * Microsoft Research（微软研究院） ； Tsinghua University（清华大学） ； The University of Hong Kong（香港大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Large Language Models Struggle with Unreasonability in Math Problems

Jingyuan Ma, Damai Dai, Zihang Yuan, Rui li, Weilin Luo, Bin Wang, Qun Liu, Lei Sha, Zhifang Sui

机构 * National Key Laboratory for Multimedia Information Processing, School of Computer Science, Peking University（国家多媒体信息处理重点实验室，计算机学院，北京大学） ； Institute of Artificial Intelligence, Beihang University（人工智能学院，北航） ； Huawei Noah’s Ark Lab, China（华为诺亚实验室，中国） 纠错

专题命中 数学推理 ：reasoning(abstract)；self-correction(abstract)；分类 cs.CL

Comments 32 pages, 8 figures

Unifying Language Agent Algorithms with Graph-based Orchestration Engine for Reproducible Agent Research

Qianqian Zhang, Jiajia Liao, Heting Ying, Yibo Ma, Haozhan Shen, Jingcheng Li, Peng Liu, Lu Zhang, Chunxin Fang, Kyusong Lee, Ruochen Xu, Tiancheng Zhao

机构 * Om AI Research（Om AI研究机构） ； Binjiang Institute of Zhejiang University（浙江大学滨江学院） ； College of Computer Science and Technology, Zhejiang University（浙江大学计算机科学与技术学院） 纠错

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments Accepted by ACL 2025 Demo

A Structured Unplugged Approach for Foundational AI Literacy in Primary Education

Maria Cristina Carrisi, Mirko Marras, Sara Vergallo

机构 * University of Cagliari（卡利亚里大学） ； University of Macerata（马切拉塔大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.AI

Comments Under review

Step-Wise Formal Verification for LLM-Based Mathematical Problem Solving

Kuo Zhou, Lu Zhang

机构 * Peking University（北京大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.AI

ScaleBiO: Scalable Bilevel Optimization for LLM Data Reweighting

Rui Pan, Dylan Zhang, Hanning Zhang, Xingyuan Pan, Minrui Xu, Jipeng Zhang, Renjie Pi, Xiaoyu Wang, Tong Zhang

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） ； The Hong Kong University of Science and Technology（香港科学与技术大学） 纠错

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.LG

Comments ACL 2025

MDIT: A Model-free Data Interpolation Method for Diverse Instruction Tuning

Yangning Li, Zihua Lan, Lv Qingsong, Yinghui Li, Hai-Tao Zheng

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Alice: Proactive Learning with Teacher's Demonstrations for Weak-to-Strong Generalization

Shujin Wu, Cheng Qian, Yi R. Fung, Paul Pu Liang, Heng Ji

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Large (Vision) Language Models are Unsupervised In-Context Learners

Artyom Gadetsky, Andrei Atanov, Yulun Jiang, Zhitong Gao, Ghazal Hosseini Mighan, Amir Zamir, Maria Brbic

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.LG

Comments ICLR 2025 camera-ready

MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

Hanqing Wang, Yixia Li, Shuo Wang, Guanhua Chen, Yun Chen

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments This paper has been accepted at NAACL 2025. Code is available at: https://github.com/sufenlp/MiLoRA

SPPD: Self-training with Process Preference Learning Using Dynamic Value Margin

Hao Yi, Qingyang Li, Yulan Hu, Fuzheng Zhang, Di Zhang, Yong Liu

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.AI

Deception in LLMs: Self-Preservation and Autonomous Goals in Large Language Models

Sudarshan Kamath Barkur, Sigurd Schacht, Johannes Scholl

专题命中 数学推理 ：reasoning(abstract)；planning(abstract)；分类 cs.CL

Comments Corrected Version - Solved Some Issues with reference compilation by latex

Control LLM: Controlled Evolution for Intelligence Retention in LLM

Haichao Wei, Yunxiang Ren, Zhoutong Fu, Aman Lunia, Yi-Lin Chen, Alice Leung, Ya Xu

专题命中 数学推理 ：reasoning(abstract)；CoT(abstract)；分类 cs.LG

Comments 8 pages

Exploring the Reliability of Large Language Models as Customized Evaluators for Diverse NLP Tasks

Qintong Li, Leyang Cui, Lingpeng Kong, Wei Bi

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments We release our resources at \url{https://github.com/qtli/CoEval}

Dynamic Skill Adaptation for Large Language Models

Jiaao Chen, Diyi Yang

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Ask-Before-Detection: Identifying and Mitigating Conformity Bias in LLM-Powered Error Detector for Math Word Problem Solutions

Hang Li, Tianlong Xu, Kaiqi Yang, Yucheng Chu, Yanling Chen, Yichi Song, Qingsong Wen, Hui Liu

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments 12 pages, 4 figures

Algorithmic Phase Transitions in Language Models: A Mechanistic Case Study of Arithmetic

Alan Sun, Ethan Sun, Warren Shepard

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Comments 10 pages, 5 figures

Can Language Models Enable In-Context Database?

Yu Pan, Hongfeng Yu, Tianjiao Zhao, Jianxin Sun

专题命中 数学推理 ：reasoning(abstract)；planning(abstract)；分类 cs.AI

Evaluating LLMs' Mathematical and Coding Competency through Ontology-guided Interventions

Pengfei Hong, Navonil Majumder, Deepanway Ghosal, Somak Aditya, Rada Mihalcea, Soujanya Poria

专题命中 数学推理 ：reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL

Comments With o1 and GPT-4o results. Reformatted the data and presented more analysis

MiLoRA: Efficient Mixture of Low-Rank Adaptation for Large Language Models Fine-tuning

Jingfan Zhang, Yi Zhao, Dan Chen, Xing Tian, Huanran Zheng, Wei Zhu

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments Accepted by EMNLP 2024 Findings. arXiv admin note: substantial text overlap with arXiv:2405.18203

Augmenting In-Context-Learning in LLMs via Automatic Data Labeling and Refinement

Joseph Shtok, Amit Alfassy, Foad Abo Dahood, Eliyahu Schwartz, Sivan Doveh, Assaf Arbelle

专题命中 数学推理 ：reasoning(abstract)；CoT(abstract)；分类 cs.CL

Intriguing Properties of Large Language and Vision Models

Young-Jun Lee, Byungsoo Ko, Han-Gyu Kim, Yechan Hwang, Ho-Jin Choi

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments Code is available in https://github.com/passing2961/IP-LLVM

EC-Guide: A Comprehensive E-Commerce Guide for Instruction Tuning and Quantization

Zhaopeng Feng, Zijie Meng, Zuozhu Liu

专题命中 数学推理 ：chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL

MathLearner: A Large Language Model Agent Framework for Learning to Solve Mathematical Problems

Wenbei Xie, Donglin Liu, Haoran Yan, Wenjie Wu, Zongyang Liu

专题命中 数学推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL

Networks of Networks: Complexity Class Principles Applied to Compound AI Systems Design

Jared Quincy Davis, Boris Hanin, Lingjiao Chen, Peter Bailis, Ion Stoica, Matei Zaharia

专题命中 数学推理 ：reasoning(abstract)；verifier(abstract)；分类 cs.AI

GSM-Plus: A Comprehensive Benchmark for Evaluating the Robustness of LLMs as Mathematical Problem Solvers

Qintong Li, Leyang Cui, Xueliang Zhao, Lingpeng Kong, Wei Bi

专题命中 数学推理 ：reasoning(abstract)；math reasoning(abstract)；分类 cs.CL

Comments ACL 2024