Enhancing the reasoning capabilities of language models (LMs) remains a key challenge, especially for tasks that require complex, multi-step decision-making where existing Chain-of-Thought (CoT) approaches struggle with consistency and verification. In this paper, we propose a novel reasoning framework, referred to as Structure-aware Planning with an Accurate World Model (SWAP), that integrates structured knowledge representation with learned planning. Unlike prior methods that rely purely on natural language reasoning, SWAP leverages entailment graphs to encode structured dependencies and enable symbolic verification of intermediate steps. To systematically construct and update the graph, SWAP employs a policy model to propose candidate expansions and a world model to predict structural updates. To improve accuracy, the world model generates multiple alternative updates, and a discriminator re-ranks them based on plausibility. To encourage diverse exploration, we introduce Diversity-based Modelling (DM), which samples candidates from the remaining probability mass after removing previously sampled candidates from the original policy distribution. Additionally, SWAP improves the discrimination accuracy through Contrastive Ranking (CR), which directly compares candidates within prompts and incorporates meta-knowledge to improve ranking quality. We evaluate SWAP across diverse reasoning-intensive benchmarks including math reasoning, logical reasoning, and coding tasks. Extensive experiments demonstrate that SWAP significantly improves upon the base models and consistently outperforms existing reasoning methods.
Deliberate Evolution: Agentic Reasoning for Sample-Efficient Symbolic Regression with LLMs
TMLR Group, Department of Computer Science, Hong Kong Baptist University(香港 Baptist 大学计算机科学系 TMLR 组);Beijing National Research Center for Information Science(北京信息科学国家研究中心);Technology (BNRist), Department of Automation, Tsinghua University, Beijing, P.R. China(技术(BNRist),自动化系,清华大学,北京,中华人民共和国);Lenovo Research(联想研究)
Mil-SCORE: Benchmarking Long-Context Geospatial Reasoning and Planning in Large Language Models
University of Maryland, College Park MD, USA(马里兰大学);ERA Lab, University of South Florida, Tampa FL, USA(佛罗里达大学埃拉实验室);DEVCOM Army Research Laboratory, Aberdeen Proving Ground MD, USA(国防部陆军研究实验室);EEHPC Lab, Johns Hopkins University, Baltimore MD, USA(约翰霍普金斯大学EEHPC实验室)
Non-myopic Generation of Language Models for Reasoning and Planning
The University of Hong Kong(香港大学);Peking University(北京大学);Zhejiang University(浙江大学);Westlake University(西湖大学);The Hong Kong University of Science and Technology(香港科技大学)
DeepCritic: Deliberate Critique with Large Language Models
Gaoling School of Artificial Intelligence, Renmin University of China(中国人民大学首都人工智能学院);School of Computer Science and Technology, Beijing Jiaotong University(北京交通大学计算机科学与技术学院)
Why Reasoning Fails to Plan: A Planning-Centric Analysis of Long-Horizon Decision Making in LLM Agents
University of Notre Dame(诺丁汉大学);Stanford University(斯坦福大学);Purdue University(普渡大学);University of Edinburgh(爱丁堡大学);University of Oxford(牛津大学);Yale University(耶鲁大学)
IMAGINE: Integrating Multi-Agent System into One Model for Complex Reasoning and Planning
Hangzhou International Innovation Institute, Beihang University(北京航空航天大学杭州国际创新研究院);School of Artificial Intelligence, Beihang University(北京航空航天大学人工智能学院);Kuaishou Technology(快手科技)
Plan Then Action:High-Level Planning Guidance Reinforcement Learning for LLM Reasoning
Case Western Reserve University, Cleveland, OH, USA(凯斯西储大学);Kean University, Union, NJ, USA(凯恩大学);The Ohio State University, Columbus, OH, USA(俄亥俄州立大学);Fudan University, Shanghai, China(复旦大学);Shanghai Artificial Intelligence Laboratory, Shanghai, China(上海人工智能实验室);The University of Hong Kong, Hong Kong, China(香港大学);North Carolina State University, Raleigh, NC, USA(北卡罗来纳州立大学)
PRIME: Planning and Retrieval-Integrated Memory for Enhanced Reasoning
Center for Healthcare Organization and Implementation Research, VA Bedford Health Care(VA Bedford Health Care 医疗组织与实施研究中心);Manning College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校信息与计算机科学学院);Miner School of Computer and Information Sciences, University of Massachusetts Lowell(马萨诸塞大学洛厄尔分校 Miner 信息与计算机科学学院)
Fast or Slow? Integrating Fast Intuition and Deliberate Thinking for Enhancing Visual Question Answering
Zhejiang University(浙江大学);Byte Dance(字节跳动);National University of Singapore(新加坡国立大学);Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence(浙江省医学影像人工智能重点实验室)
More Than Meets the Eye? Uncovering the Reasoning-Planning Disconnect in Training Vision-Language Driving Models
S-Lab, Nanyang Technological University, Singapore(南洋理工大学S实验室);College of Computing and Data Science, Nanyang Technological University, Singapore(南洋理工大学计算与数据科学学院)