大模型推理能力

ToRL: Scaling Tool-Integrated RL

Xuefeng Li, Haoyang Zou, Pengfei Liu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

RL-finetuning LLMs from on- and off-policy data with a single algorithm

Yunhao Tang, Taco Cohen, David W. Zhang, Michal Valko, Rémi Munos

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Critique Fine-Tuning: Learning to Critique is More Effective than Learning to Imitate

Yubo Wang, Xiang Yue, Wenhu Chen

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

RaSA: Rank-Sharing Low-Rank Adaptation

Zhiwei He, Zhaopeng Tu, Xing Wang, Xingyu Chen, Zhijie Wang, Jiahao Xu, Tian Liang, Wenxiang Jiao, Zhuosheng Zhang, Rui Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments ICLR 2025

Exploiting Edited Large Language Models as General Scientific Optimizers

Qitan Lv, Tianyu Liu, Hong Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Can Vision-Language Models Evaluate Handwritten Math?

Oikantik Nath, Hanani Bathina, Mohammed Safi Ur Rahman Khan, Mitesh M. Khapra

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Pretrained Embeddings as a Behavior Specification Mechanism

Parv Kapoor, Abigail Hammer, Ashish Kapoor, Karen Leung, Eunsuk Kang

专题命中 数学推理 ：planning(abstract)；分类 cs.AI

Comments 18 pages, 6 figures

It Helps to Take a Second Opinion: Teaching Smaller LLMs to Deliberate Mutually via Selective Rationale Optimisation

Sohan Patnaik, Milan Aggarwal, Sumit Bhatia, Balaji Krishnamurthy

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted at ICLR 2025

Automated Design of Agentic Systems

Shengran Hu, Cong Lu, Jeff Clune

专题命中 数学推理 ：chain-of-thought(abstract)；分类 cs.AI

Comments Website: https://shengranhu.com/ADAS

The Lookahead Limitation: Why Multi-Operand Addition is Hard for LLMs

Tanja Baeumel, Josef van Genabith, Simon Ostermann

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Pre-print

Is Mathematics Obsolete?

Jeremy Avigad

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Can LLMs Solve longer Math Word Problems Better?

Xin Xu, Tong Xiao, Zitong Chao, Zhenya Huang, Can Yang, Yang Wang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted to ICLR 2025

Journal ref International Conference on Learning Representations (ICLR 2025)

World Models for Math Story Problems

Andreas Opedal, Niklas Stoehr, Abulhair Saparov, Mrinmaya Sachan

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments ACL Findings 2023

Earlier Tokens Contribute More: Learning Direct Preference Optimization From Temporal Decay Perspective

Ruichen Shao, Bei Li, Gangao Liu, Yang Chen, Xiang Zhou, Jingang Wang, Xunliang Cai, Peng Li

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by ICLR 2025

Selective Self-to-Supervised Fine-Tuning for Generalization in Large Language Models

Sonam Gupta, Yatin Nandwani, Asaf Yehudai, Dinesh Khandelwal, Dinesh Raghu, Sachindra Joshi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 10 pages, Accepted to NAACL Findings 2025. arXiv admin note: text overlap with arXiv:2409.04787

RM-PoT: Reformulating Mathematical Problems and Solving via Program of Thoughts

Yu Zhang, Shujun Peng, Nengwu Wu, Xinhan Lin, Yang Hu, Jie Tang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

On Representational Dissociation of Language and Arithmetic in Large Language Models

Riku Kisako, Tatsuki Kuribayashi, Ryohei Sasano

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

How Well Do LLMs Handle Cantonese? Benchmarking Cantonese Capabilities of Large Language Models

Jiyue Jiang, Pengan Chen, Liheng Chen, Sheng Wang, Qinghang Bao, Lingpeng Kong, Yu Li, Chuan Wu

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Accepted by NAACL 2025

O1 Embedder: Let Retrievers Think Before Action

Ruiran Yan, Zheng Liu, Defu Lian

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Franken-Adapter: Cross-Lingual Adaptation of LLMs by Embedding Surgery

Fan Jiang, Honglin Yu, Grace Chung, Trevor Cohn

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments 33 pages

Exploring Safety-Utility Trade-Offs in Personalized Language Models

Anvesh Rao Vijjini, Somnath Basu Roy Chowdhury, Snigdha Chaturvedi

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments NAACL 2025

Can 1B LLM Surpass 405B LLM? Rethinking Compute-Optimal Test-Time Scaling

Runze Liu, Junqi Gao, Jian Zhao, Kaiyan Zhang, Xiu Li, Biqing Qi, Wanli Ouyang, Bowen Zhou

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Self-Training Large Language Models for Tool-Use Without Demonstrations

Ne Luo, Aryo Pradipta Gema, Xuanli He, Emile van Krieken, Pietro Lesci, Pasquale Minervini

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Insights into Alignment: Evaluating DPO and its Variants Across Multiple Tasks

Amir Saeidi, Shivanshu Verma, Md Nayem Uddin, Chitta Baral

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

ScoreFlow: Mastering LLM Agent Workflows via Score-based Preference Optimization

Yinjie Wang, Ling Yang, Guohao Li, Mengdi Wang, Bryon Aragam

专题命中 数学推理 ：reasoning(abstract)；分类 cs.CL

Comments Project: https://github.com/Gen-Verse/ScoreFlow

Qrazor: Reliable and Effortless 4-bit LLM Quantization by Significant Data Razoring

Dongyoung Lee, Seungkyu Choi, Ik Joon Chang

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Comments 16 pages

SoftSRV: Learn to Generate Targeted Synthetic Data

Giulia DeSalvo, Jean-Fracois Kagy, Lazaros Karydas, Afshin Rostamizadeh, Sanjiv Kumar

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Token-by-Token Regeneration and Domain Biases: A Benchmark of LLMs on Advanced Mathematical Problem-Solving

Evgenii Evstafev

专题命中 数学推理 ：reasoning(abstract)；分类 cs.LG

Comments 8 pages, 8 figures

Bridging the Training-Inference Gap in LLMs by Leveraging Self-Generated Tokens

Zhepeng Cen, Yao Liu, Siliang Zeng, Pratik Chaudhari, Huzefa Rangwala, George Karypis, Rasool Fakoor

专题命中 数学推理 ：self-correction(abstract)；分类 cs.LG

Comments Published in TMLR

Explainable AI based System for Supply Air Temperature Forecast

Marika Eik, Ahmet Kose, Hossein Nourollahi Hokmabad, Juri Belikov

专题命中 数学推理 ：reasoning(abstract)；分类 cs.AI

Comments 5 pages, 7 figures, 1 table, conference paper