语言大模型 / LLM

Does Math Reasoning Improve General LLM Capabilities? Understanding Transferability of LLM Reasoning

Maggie Huan, Yuetai Li, Tuney Zheng, Xiaoyu Xu, Seungone Kim, Minxin Du, Radha Poovendran, Graham Neubig, Xiang Yue

机构 * Carnegie Mellon University（卡内基梅隆大学） ； University of Pennsylvania（宾夕法尼亚大学） ； University of Washington（华盛顿大学） ； M-A-P ； The Hong Kong Polytechnic University（香港理工大学） 纠错

专题命中 推理与问题求解 ：LLM(title)；large language model(abstract)；language model(abstract)；post-training(abstract)

EvolveNav: Empowering LLM-Based Vision-Language Navigation via Self-Improving Embodied Reasoning

Bingqian Lin, Yunshuang Nie, Khun Loun Zai, Ziming Wei, Mingfei Han, Rongtao Xu, Minzhe Niu, Jianhua Han, Hanwang Zhang, Liang Lin, Bokui Chen, Cewu Lu, Xiaodan Liang

机构 * Shanghai Jiao Tong University（上海交通大学） ； Shenzhen Campus of Sun Yat-sen University（中山大学深圳校区） ； Peng Cheng Laboratory（鹏城实验室） ； Tsinghua Shenzhen International Graduate School（清华大学深圳国际研究生院） ； Mohamed Bin Zayed University of Artificial Intelligence（Mohamed Bin Zayed人工智能大学） ； Yinwang Intelligent Technology Co.（亿维智能技术有限公司） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Guiding Exploration in Reinforcement Learning Through LLM-Augmented Observations

Vaibhav Jain, Gerrit Grossmann

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；pretraining(abstract)

Comments Accepted to LM4Plan Workshop @ ICAPS 2025 (withdrawn before presentation due to lack of travel funding)

MALT: Improving Reasoning with Multi-Agent LLM Training

Sumeet Ramesh Motwani, Chandler Smith, Rocktim Jyoti Das, Rafael Rafailov, Ivan Laptev, Philip H. S. Torr, Fabio Pizzati, Ronald Clark, Christian Schroeder de Witt

机构 * University of Oxford（牛津大学） ； Cooperative AI Foundation（合作人工智能基金会） ； MBZUAI（穆扎夫卡尔人工智能研究所） ； Stanford University（斯坦福大学） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Comments Published at COLM 2025

World Modelling Improves Language Model Agents

Shangmin Guo, Omar Darwiche Domingues, Raphaël Avalos, Aaron Courville, Florian Strub

机构 * University of Edinburgh（爱丁堡大学） ； Cohere ； Vrije Universiteit Brussel（布鲁塞尔自由大学） ； Université de Montréal（蒙特利尔大学） 纠错

专题命中 推理与问题求解 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)；post-training(abstract)

Metacognitive Reuse: Turning Recurring LLM Reasoning Into Concise Behaviors

Aniket Didolkar, Nicolas Ballas, Sanjeev Arora, Anirudh Goyal

机构 * Meta ； Mila-Quebec AI Institute, University of Montreal（魁北克AI研究所，蒙特利尔大学） ； Princeton University（普林斯顿大学） ； Mila--Quebec AI Institute, Université de Montréal（魁北克AI研究所，蒙特利尔大学） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments 18 pages, 9 Figures, 5 Tables

CARFT: Boosting LLM Reasoning via Contrastive Learning with Annotated Chain-of-Thought-based Reinforced Fine-Tuning

Wenqiao Zhu, Ji Liu, Rongjuncheng Zhang, Haipang Wu, Yulun Zhang

机构 * HiThink Research（HiThink研究院） ； Shanghai Jiao Tong University（上海交通大学） 纠错

专题命中 推理与问题求解 ：LLM(title)；large language model(abstract)；language model(abstract)；foundation model(abstract)

Comments 14 pages, to appear in EMNLP25

IPIGuard: A Novel Tool Dependency Graph-Based Defense Against Indirect Prompt Injection in LLM Agents

Hengyu An, Jinghuai Zhang, Tianyu Du, Chunyi Zhou, Qingming Li, Tao Lin, Shouling Ji

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Comments EMNLP 2025

SSPO: Self-traced Step-wise Preference Optimization for Process Supervision and Reasoning Compression

Yuyang Xu, Yi Cheng, Haochao Ying, Zhuoyun Du, Renjun Hu, Xing Shi, Wei Lin, Jian Wu

专题命中 推理与问题求解 ：preference optimization(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Comments Work in progress

LLM driven Text-to-Table Generation through Sub-Tasks Guidance and Iterative Refinement

Rajmohan C, Sarthak Harne, Arvind Agarwal

机构 * IBM Research（IBM研究院） ； IIIT-Bangalore（班加罗尔印度理工学院） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Theorem-of-Thought: A Multi-Agent Framework for Abductive, Deductive, and Inductive Reasoning in Language Models

Samir Abdaljalil, Hasan Kurban, Khalid Qaraqe, Erchin Serpedin

机构 * Texas A&M University（德克萨斯大学） ； Hamad Bin Khalifa University（哈马德·本·卡伊夫大学） 纠错

专题命中 推理与问题求解 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)；prompting(abstract)

Comments ACL 2025 KnowFM

Evaluating the Performance of AI Text Detectors, Few-Shot and Chain-of-Thought Prompting Using DeepSeek Generated Text

Hulayyil Alshammari, Praveen Rao

专题命中 推理与问题求解 ：prompting(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

Improving LLM Reasoning for Vulnerability Detection via Group Relative Policy Optimization

Marco Simoni, Aleksandar Fontana, Giulio Rossolini, Andrea Saracino

机构 * Institute of Informatics and Telematics, National Research Council of Italy（意大利国家研究理事会信息与电信研究所） ； Department of Excellence in Robotics and AI, TeCIP, Scuola Superiore Sant'Anna（卓越机器人与人工智能系，TeCIP，圣安娜高等学院） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments Under Review

Satori: Reinforcement Learning with Chain-of-Action-Thought Enhances LLM Reasoning via Autoregressive Search

Maohao Shen, Guangtao Zeng, Zhenting Qi, Zhang-Wei Hong, Zhenfang Chen, Wei Lu, Gregory Wornell, Subhro Das, David Cox, Chuang Gan

机构 * MIT（麻省理工学院） ； Singapore University of Technology（新加坡科技设计大学） ； MIT-IBM Watson AI Lab, IBM Research（麻省理工-IBM沃森人工智能实验室，IBM研究院） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

NeuralNexus at BEA 2025 Shared Task: Retrieval-Augmented Prompting for Mistake Identification in AI Tutors

Numaan Naeem, Sarfraz Ahmad, Momina Ahsan, Hasan Iqbal

机构 * MBZUAI（穆萨大学人工智能研究所） 纠错

专题命中 推理与问题求解 ：prompting(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 6 pages, 2 figures, 1 table

WorkForceAgent-R1: Incentivizing Reasoning Capability in LLM-based Web Agents via Reinforcement Learning

Yuchen Zhuang, Di Jin, Jiaao Chen, Wenqi Shi, Hanrui Wang, Chao Zhang

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments Work in Progress

Simulating LLM-to-LLM Tutoring for Multilingual Math Feedback

Junior Cedric Tonga, KV Aditya Srivatsa, Kaushal Kumar Maurya, Fajri Koto, Ekaterina Kochmar

机构 * Mohamed bin Zayed University of Artificial Intelligence（莫莫德·本·泽德人工智能大学） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Comments Preprint, in submission

PGPO: Enhancing Agent Reasoning via Pseudocode-style Planning Guided Preference Optimization

Zouying Cao, Runze Wang, Yifei Yang, Xinbei Ma, Xiaoyong Zhu, Bo Zheng, Hai Zhao

专题命中 推理与问题求解 ：preference optimization(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

Comments 20 pages, 12 figures, 14 tables, ACL'25 Findings

Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL

Che Liu, Haozhe Wang, Jiazhen Pan, Zhongwei Wan, Yong Dai, Fangzhen Lin, Wenjia Bai, Daniel Rueckert, Rossella Arcucci

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；SFT(abstract)

Comments Under Review

ProMind-LLM: Proactive Mental Health Care via Causal Reasoning with Sensor Data

Xinzhe Zheng, Sijie Ji, Jiawei Sun, Renqi Chen, Wei Gao, Mani Srivastava

机构 * California Institute of Technology（加州理工学院） ； UCLA（加州大学洛杉矶分校） ； National University of Singapore（新加坡国立大学） ； Hangzhou Dianzi University（杭州电子科技大学） ； Fudan University（复旦大学） 纠错

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；pretraining(abstract)

Comparing LLM Text Annotation Skills: A Study on Human Rights Violations in Social Media Data

Poli Apollinaire Nemkova, Solomon Ubani, Mark V. Albert

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Exploring ReAct Prompting for Task-Oriented Dialogue: Insights and Shortcomings

Michelle Elizabeth, Morgan Veyret, Miguel Couceiro, Ondrej Dusek, Lina M. Rojas-Barahona

专题命中 推理与问题求解 ：prompting(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

The Benefits of a Concise Chain of Thought on Problem-Solving in Large Language Models

Matthew Renze, Erhan Guven

专题命中 推理与问题求解 ：large language model(title,journal_ref)；language model(title,journal_ref)；prompting(abstract)；分类 cs.CL、cs.AI

Journal ref 2nd International Conference on Foundation and Large Language Models (FLLM 2024), pp.476-483

MIRAGE: Evaluating and Explaining Inductive Reasoning Process in Language Models

Jiachun Li, Pengfei Cao, Zhuoran Jin, Yubo Chen, Kang Liu, Jun Zhao

专题命中 推理与问题求解 ：language model(title,abstract)；LLM(abstract)；large language model(abstract)；prompting(abstract)

Comments Accepted as ICLR 2025 conference paper (26 pages, 16 tables, 9 figures)

SIFT: Grounding LLM Reasoning in Contexts via Stickers

Zihao Zeng, Xuyao Huang, Boxiu Li, Zhijie Deng

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；post-training(abstract)

Large Language-Geometry Model: When LLM meets Equivariance

Zongzhao Li, Jiacheng Cen, Bing Su, Wenbing Huang, Tingyang Xu, Yu Rong, Deli Zhao

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Rule-Bottleneck Reinforcement Learning: Joint Explanation and Decision Optimization for Resource Allocation with Language Agents

Mauricio Tec, Guojun Xiong, Haichuan Wang, Francesca Dominici, Milind Tambe

专题命中 推理与问题求解 ：language agent(title,abstract)；LLM(abstract)；large language model(abstract)；language model(abstract)

Table as Thought: Exploring Structured Thoughts in LLM Reasoning

Zhenjie Sun, Naihao Deng, Haofei Yu, Jiaxuan You

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Script-Based Dialog Policy Planning for LLM-Powered Conversational Agents: A Basic Architecture for an "AI Therapist"

Robert Wasenmüller, Kevin Hilbert, Christoph Benzmüller

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)

Comments 9 pages, 5 figures, 1 table

Robust Planning with Compound LLM Architectures: An LLM-Modulo Approach

Atharva Gundawar, Karthik Valmeekam, Mudit Verma, Subbarao Kambhampati

专题命中 推理与问题求解 ：LLM(title,abstract)；large language model(abstract)；language model(abstract)；prompting(abstract)