大模型推理能力

CLATTER: Comprehensive Entailment Reasoning for Hallucination Detection

Ron Eliav, Arie Cattan, Eran Hirsch, Shahaf Bassan, Elias Stengel-Eskin, Mohit Bansal, Ido Dagan

机构 * Bar-Ilan University（巴伊兰大学） ； Hebrew University of Jerusalem（耶路撒冷希伯来大学） ； UNC Chapel Hill（北卡罗来纳大学教堂山分校） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

ReasoningFlow: Semantic Structure of Complex Reasoning Traces

Jinu Lee, Sagnik Mukherjee, Dilek Hakkani-Tur, Julia Hockenmaier

机构 * University of Illinois Urbana-Champaign（伊利诺伊大学厄巴纳-香槟分校） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；planning(abstract)；分类 cs.CL

Comments 10 pages, 6 figures. ArgMining 2025 Workshop (Non-archival) @ ACL 2025

Implicit Reasoning in Transformers is Reasoning through Shortcuts

Tianhe Lin, Jian Xie, Siyu Yuan, Deqing Yang

专题命中 复杂问题求解 ：reasoning(title,abstract)；test-time compute(abstract)；分类 cs.CL

Comments ACL 2025 Findings

FINEREASON: Evaluating and Improving LLMs' Deliberate Reasoning through Reflective Puzzle Solving

Guizhen Chen, Weiwen Xu, Hao Zhang, Hou Pong Chan, Chaoqun Liu, Lidong Bing, Deli Zhao, Anh Tuan Luu, Yu Rong

机构 * Nanyang Technological University（南洋理工大学） ； DAMO Academy, Alibaba Group（阿里达摩院） ； Hupan Lab（虎扑实验室） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.CL

Comments Accepted to ACL2025 Main

BAR: A Backward Reasoning based Agent for Complex Minecraft Tasks

Weihong Du, Wenrui Liao, Binyu Yan, Hongru Liang, Anthony G. Cohn, Wenqiang Lei

专题命中 复杂问题求解 ：reasoning(title,abstract)；planning(abstract)；分类 cs.CL

Journal ref ACL 2025

Efficient Reasoning via Chain of Unconscious Thought

Ruihan Gong, Yue Liu, Wenjie Qu, Mingzhe Du, Yufei He, Yingwei Ma, Yulin Chen, Xiang Liu, Yi Wen, Xinfeng Li, Ruidong Wang, Xinzhong Zhu, Bryan Hooi, Jiaheng Zhang

专题命中 复杂问题求解 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

SHARP: Synthesizing High-quality Aligned Reasoning Problems for Large Reasoning Models Reinforcement Learning

Xiong Jun Wu, Zhenduo Zhang, ZuJie Wen, Zhiqiang Zhang, Wang Ren, Lei Shi, Cai Chen, Deng Zhao, Qing Wang, Xudong Han, Chengfu Tang, Dingnan Jin, Qing Cui, Jun Zhou

机构 * AI Alignment at Ant Group（蚂蚁集团人工智能对齐部） ； NextEvo ； Platform at Ant Group（蚂蚁集团平台部） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.AI

Learning from Peers in Reasoning Models

Tongxu Luo, Wenyu Du, Jiaxi Bi, Stephen Chung, Zhengyang Tang, Hao Yang, Min Zhang, Benyou Wang

机构 * The Chinese University of Hong Kong, Shenzhen（香港中文大学（深圳）） ； DualityRL ； USTB（中国矿业大学） ； Huawei（华为） 纠错

专题命中 复杂问题求解 ：reasoning(title,abstract)；self-correction(abstract)；分类 cs.CL

Comments 29 pages, 32 figures

Smaller Large Language Models Can Do Moral Self-Correction

Guangliang Liu, Zhiyu Xue, Xitong Zhang, Rongrong Wang, Kristen Marie Johnson

专题命中 复杂问题求解 ：self-correction(title,abstract)；CoT(abstract)；分类 cs.CL

Efficient Multi-Agent Collaboration with Tool Use for Online Planning in Complex Table Question Answering

Wei Zhou, Mohsen Mesgar, Annemarie Friedrich, Heike Adel

专题命中 复杂问题求解 ：planning(title,abstract)；reasoning(abstract)；分类 cs.CL

Comments Accepted at NAACL 2025 Findings

SiriuS: Self-improving Multi-agent Systems via Bootstrapped Reasoning

Wanjia Zhao, Mert Yuksekgonul, Shirley Wu, James Zou

专题命中 复杂问题求解 ：reasoning(title,abstract)；self-correction(abstract)；分类 cs.AI

Can ChatGPT Overcome Behavioral Biases in the Financial Sector? Classify-and-Rethink: Multi-Step Zero-Shot Reasoning in the Gold Investment

Shuoling Liu, Gaoguo Jia, Yuhang Jiang, Liyuan Chen, Qiang Yang

专题命中 复杂问题求解 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.AI

To Err is Machine: Vulnerability Detection Challenges LLM Reasoning

Benjamin Steenhoek, Md Mahbubur Rahman, Monoshi Kumar Roy, Mirza Sanjida Alam, Hengbo Tong, Swarna Das, Earl T. Barr, Wei Le

专题命中 复杂问题求解 ：reasoning(title,abstract)；math reasoning(abstract)；分类 cs.LG

Make LLMs better zero-shot reasoners: Structure-orientated autonomous reasoning

Pengfei He, Zitao Li, Yue Xing, Yaling Li, Jiliang Tang, Bolin Ding

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.LG

First Heuristic Then Rational: Dynamic Use of Heuristics in Language Model Reasoning

Yoichi Aoki, Keito Kudo, Tatsuki Kuribayashi, Shusaku Sone, Masaya Taniguchi, Keisuke Sakaguchi, Kentaro Inui

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments This paper is accepted at EMNLP 2024

Textualized Agent-Style Reasoning for Complex Tasks by Multiple Round LLM Generation

Chen Liang, Zhifan Feng, Zihe Liu, Wenbin Jiang, Jinan Xu, Yufeng Chen, Yong Wang

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

The Curious Case of Nonverbal Abstract Reasoning with Multi-Modal Large Language Models

Kian Ahrabian, Zhivar Sourati, Kexuan Sun, Jiarui Zhang, Yifan Jiang, Fred Morstatter, Jay Pujara

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments 21 pages

Predicting Text Preference Via Structured Comparative Reasoning

Jing Nathan Yan, Tianqi Liu, Justin T Chiu, Jiaming Shen, Zhen Qin, Yue Yu, Yao Zhao, Charu Lakshmanan, Yair Kurzion, Alexander M. Rush, Jialu Liu, Michael Bendersky

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Small Language Models Learn Enhanced Reasoning Skills from Medical Textbooks

Hyunjae Kim, Hyeon Hwang, Jiwoo Lee, Sihyeon Park, Dain Kim, Taewhoo Lee, Chanwoong Yoon, Jiwoong Sohn, Donghee Choi, Jaewoo Kang

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments Added new LLaMA-3-based models and experiments on NEJM case challenges

Distilling Algorithmic Reasoning from LLMs via Explaining Solution Programs

Jierui Li, Raymond Mooney

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

Comments pre-print

Better Zero-Shot Reasoning with Role-Play Prompting

Aobo Kong, Shiwan Zhao, Hao Chen, Qicheng Li, Yong Qin, Ruiqi Sun, Xin Zhou, Enzhi Wang, Xiaohang Dong

专题命中 复杂问题求解 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Comments NAACL 2024, Main Conference

Multi-Level Compositional Reasoning for Interactive Instruction Following

Suvaansh Bhambri, Byeonghwi Kim, Jonghyun Choi

专题命中 复杂问题求解 ：reasoning(title,abstract)；planning(abstract)；分类 cs.AI

Comments AAAI 2023 (Oral) (Project page: https://bhkim94.github.io/projects/MCR-Agent)

From Complex to Simple: Unraveling the Cognitive Tree for Reasoning with Small Language Models

Junbing Yan, Chengyu Wang, Taolin Zhang, Xiaofeng He, Jun Huang, Wei Zhang

专题命中 复杂问题求解 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.CL

Comments emnlp 2023

Unifying Structure Reasoning and Language Model Pre-training for Complex Reasoning

Siyuan Wang, Zhongyu Wei, Jiarong Xu, Taishan Li, Zhihao Fan

专题命中 复杂问题求解 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.CL

Comments 10 pages, 4 figures, 7 tables

AlphaBlock: Embodied Finetuning for Vision-Language Reasoning in Robot Manipulation

Chuhao Jin, Wenhui Tan, Jiange Yang, Bei Liu, Ruihua Song, Limin Wang, Jianlong Fu

专题命中 复杂问题求解 ：reasoning(title,abstract)；planning(abstract)；分类 cs.AI

A Neural Divide-and-Conquer Reasoning Framework for Image Retrieval from Linguistically Complex Text

Yunxin Li, Baotian Hu, Yuxin Ding, Lin Ma, Min Zhang

专题命中 复杂问题求解 ：reasoning(title,abstract)；logical reasoning(abstract)；分类 cs.CL

Comments Accepted to ACL 2023 Main Conference

ART: Automatic multi-step reasoning and tool-use for large language models

Bhargavi Paranjape, Scott Lundberg, Sameer Singh, Hannaneh Hajishirzi, Luke Zettlemoyer, Marco Tulio Ribeiro

专题命中 复杂问题求解 ：reasoning(title,abstract)；CoT(abstract)；分类 cs.CL

Reasoning Circuits: Few-shot Multihop Question Generation with Structured Rationales

Saurabh Kulshreshtha, Anna Rumshisky

专题命中 复杂问题求解 ：reasoning(title,abstract)；chain-of-thought(abstract)；分类 cs.CL

On the Design of KL-Regularized Policy Gradient Algorithms for LLM Reasoning

关于为LLM推理设计KL正则化策略梯度算法的设计

Yifan Zhang, Yifeng Liu, Huizhuo Yuan, Yang Yuan, Quanquan Gu, Andrew Chi-Chih Yao

专题命中 复杂问题求解 ：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

AI总结 RPG通过统一KL正则化方法和改进的梯度估计，提升LLM推理准确率，实现稳定且可扩展的强化学习算法。

Comments Published in ICLR 2026; Project Page: https://github.com/complex-reasoning/RPG

Multi-Step Deductive Reasoning Over Natural Language: An Empirical Study on Out-of-Distribution Generalisation

Qiming Bao, Alex Yuxuan Peng, Tim Hartill, Neset Tan, Zhenyun Deng, Michael Witbrock, Jiamou Liu

专题命中 复杂问题求解 ：reasoning(title,abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 10 pages, 3 figures, The 2nd International Joint Conference on Learning & Reasoning and 16th International Workshop on Neural-Symbolic Learning and Reasoning (IJCLR-NeSy 2022)