大模型推理能力

Improving LLM Reasoning through Interpretable Role-Playing Steering

Anyi Wang, Dong Shu, Yifan Wang, Yunpu Ma, Mengnan Du

机构 * Center for Information and Language Processing, LMU Munich（信息与语言处理中心，慕尼黑大学） ； Northwestern University（西北大学） ； Munich Center for Machine Learning (MCML)（慕尼黑机器学习中心（MCML）） ； New Jersey Institute of Technology（新泽西理工学院） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted at EMNLP 2025 Findings

Does Reasoning Introduce Bias? A Study of Social Bias Evaluation and Mitigation in LLM Reasoning

Xuyang Wu, Jinming Nian, Ting-Ruen Wei, Zhiqiang Tao, Hsin-Tai Wu, Yi Fang

机构 * Santa Clara University（圣克拉拉大学） ； Rochester Institute of Technology（罗切斯特理工学院） ； Docomo Innovations（Docomo创新） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments EMNLP Findings

How Far Are We from Optimal Reasoning Efficiency?

Jiaxuan Gao, Shu Yan, Qixin Tan, Lu Yang, Shusheng Xu, Wei Fu, Zhiyu Mei, Kaifeng Lyu, Yi Wu

机构 * IIIS, Tsinghua University（清华大学信息学院） ； Ant Research, RL Lab（蚂蚁研究院强化学习实验室） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Dissecting Tool-Integrated Reasoning: An Empirical Study and Analysis

Yufeng Zhao, Junnan Liu, Hongwei Liu, Dongsheng Zhu, Yuan Shen, Songyang Zhang, Kai Chen

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Preprint, working in progress

GanitBench: A bi-lingual benchmark for evaluating mathematical reasoning in Vision Language Models

Ashutosh Bandooni, Brindha Subburaj

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments 6 pages, 3 figures. Accepted, Presented and Published as part of Proceedings of the 6th International Conference on Recent Advantages in Information Technology (RAIT) 2025

Journal ref 2025 6th International Conference on Recent Advances in Information Technology (RAIT), Dhanbad, India, 2025, pp. 1-6

MultiNRC: A Challenging and Native Multilingual Reasoning Evaluation Benchmark for LLMs

Alexander R. Fabbri, Diego Mares, Jorge Flores, Meher Mankikar, Ernesto Hernandez, Dean Lee, Bing Liu, Chen Xing

机构 * Scale AI 纠错

专题命中 推理评测 ：reasoning(title,abstract)；math reasoning(abstract)；logical reasoning(abstract)；分类 cs.CL、cs.AI

METER: Multi-modal Evidence-based Thinking and Explainable Reasoning -- Algorithm and Benchmark

Xu Yang, Qi Zhang, Shuming Jiang, Yaowen Xu, Zhaofan Zou, Hao Sun, Xuelong Li

机构 * Institute of Artificial Intelligence (TeleAI), China Telecom（电信人工智能研究院） ； Institute of Artificial Intelligence and Robotics(IAIR), Xi’an Jiaotong University（人工智能与机器人研究院） ； Advanced Technique of Artificial Intelligence(ATAI), Chongqing University of Technology（人工智能先进技术研究院） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.AI、cs.LG

Comments 9 pages,3 figures ICCV format

ViTCoT: Video-Text Interleaved Chain-of-Thought for Boosting Video Understanding in Large Language Models

Yongheng Zhang, Xu Liu, Ruihan Tao, Qiguang Chen, Hao Fei, Wanxiang Che, Libo Qin

机构 * School of Computer Science and Engineering, Central South University（计算机科学与工程学院，中南大学） ； Research Center for SCIR, Harbin Institute of Technology（SCIR研究中心，哈尔滨工业大学） ； NExT Research Center, National University of Singapore（NExT研究中心，新加坡国立大学） 纠错

专题命中 推理评测 ：chain-of-thought(title,abstract)；reasoning(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted by ACM MM 2025

Reasoning or Not? A Comprehensive Evaluation of Reasoning LLMs for Dialogue Summarization

Keyan Jin, Yapeng Wang, Leonel Santos, Tao Fang, Xu Yang, Sio Kei Im, Hugo Gonçalo Oliveira

机构 * Faculty of Applied Sciences, Macao Polytechnic University（澳门理工大学应用科学学院） ； Computer Science and Communication Research Center, School of Technology and Management, Polytechnic of Leiria（莱里亚理工学院技术与管理学院计算机科学与通信研究中心） ； Institute of International Language Services Studies, Macau Millennium College（澳门 millennium 学院国际语言服务研究学院） ； CISUC, Department of Informatics Engineering, University of Coimbra（科英布拉大学信息工程系 CISUC） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

More Thinking, Less Seeing? Assessing Amplified Hallucination in Multimodal Reasoning Models

Chengzhi Liu, Zhongxing Xu, Qingyue Wei, Juncheng Wu, James Zou, Xin Eric Wang, Yuyin Zhou, Sheng Liu

机构 * UC Santa Cruz（加州大学圣克ruz分校） ； Stanford University（斯坦福大学） ； UC Santa Barbara（加州大学圣芭芭拉分校） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；math reasoning(abstract)；test-time compute(abstract)；分类 cs.CL、cs.AI

Multimodal Inconsistency Reasoning (MMIR): A New Benchmark for Multimodal Reasoning Models

Qianqi Yan, Yue Fan, Hongquan Li, Shan Jiang, Yang Zhao, Xinze Guan, Ching-Chen Kuo, Xin Eric Wang

机构 * University of California, Santa Cruz（加州大学圣克ruz分校） ； eBay（eBay公司） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

CCI4.0: A Bilingual Pretraining Dataset for Enhancing Reasoning in Large Language Models

Guang Liu, Liangdong Wang, Jijie Li, Yang Yu, Yao Xu, Jiabei Chen, Yu Bai, Feng Liao, Yonghua Lin

机构 * Data Research Team（数据研究团队） ； Beijing Academy of Artificial Intelligence（北京人工智能研究院） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Reasoning or Overthinking: Evaluating Large Language Models on Financial Sentiment Analysis

Dimitris Vamvourellis, Dhagash Mehta

机构 * BlackRock, Inc.（黑石公司） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

SynthRL: Scaling Visual Reasoning with Verifiable Data Synthesis

Zijian Wu, Jinjie Ni, Xiangyan Liu, Zichen Liu, Hang Yan, Michael Qizhe Shieh

机构 * National University of Singapore（新加坡国立大学） ； The Chinese University of Hong Kong（香港中文大学） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；math reasoning(abstract)；test-time compute(abstract)；分类 cs.CL、cs.LG

Are Reasoning Models More Prone to Hallucination?

Zijun Yao, Yantao Liu, Yanxu Chen, Jianhui Chen, Junfeng Fang, Lei Hou, Juanzi Li, Tat-Seng Chua

机构 * Department of Computer Science and Technology, Tsinghua University（清华大学计算机科学与技术系） ； School of Computing, National University of Singapore（新加坡国立大学计算机学院） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.LG

Self-Route: Automatic Mode Switching via Capability Estimation for Efficient Reasoning

Yang He, Xiao Ding, Bibo Cai, Yufei Zhang, Kai Xiong, Zhouhao Sun, Bing Qin, Ting Liu

机构 * Research Center for Social Computing and Interactive Robotics（社会计算与交互机器人研究中心） ； Harbin Institute of Technology（哈尔滨工业大学） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Beyond Distillation: Pushing the Limits of Medical LLM Reasoning with Minimalist Rule-Based RL

Che Liu, Haozhe Wang, Jiazhen Pan, Zhongwei Wan, Yong Dai, Fangzhen Lin, Wenjia Bai, Daniel Rueckert, Rossella Arcucci

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Under Review

Systematic Evaluation of Machine-Generated Reasoning and PHQ-9 Labeling for Depression Detection Using Large Language Models

Zongru Shao, Xin Wang, Zhanyang Liu, Chenhan Wang, K. P. Subbalakshmi

机构 * Silicon Austria Labs（硅 Austria 实验室） ； Jiangnan University（江南大学） ； Stevens Institute of Technology（史蒂文斯理工学院） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；logical reasoning(abstract)；分类 cs.CL、cs.LG

Comments 8 pages without references

Reasoning Robustness of LLMs to Adversarial Typographical Errors

Esther Gan, Yiran Zhao, Liying Cheng, Yancan Mao, Anirudh Goyal, Kenji Kawaguchi, Min-Yen Kan, Michael Shieh

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Can LLMs perform structured graph reasoning?

Palaash Agrawal, Shavak Vasania, Cheston Tan

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments International Conference on Pattern Recognition (ICPR), 2024

Cause-Aware Empathetic Response Generation via Chain-of-Thought Fine-Tuning

Xinhao Chen, Chong Yang, Man Lan, Li Cai, Yang Chen, Tu Hu, Xinlin Zhuang, Aimin Zhou

专题命中 推理评测 ：chain-of-thought(title,abstract)；reasoning(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Large Language Models are Clinical Reasoners: Reasoning-Aware Diagnosis Framework with Prompt-Generated Rationales

Taeyoon Kwon, Kai Tzu-iunn Ong, Dongjin Kang, Seungjun Moon, Jeong Ryong Lee, Dosik Hwang, Yongsik Sim, Beomseok Sohn, Dongha Lee, Jinyoung Yeo

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted to AAAI 2024

Self-Polish: Enhance Reasoning in Large Language Models via Problem Refinement

Zhiheng Xi, Senjie Jin, Yuhao Zhou, Rui Zheng, Songyang Gao, Tao Gui, Qi Zhang, Xuanjing Huang

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted to EMNLP 2023 Findings. Codes and prompts are available at https://github.com/WooooDyy/Self-Polish

Chain of Images for Intuitively Reasoning

Fanxu Meng, Haotong Yang, Yiding Wang, Muhan Zhang

专题命中 推理评测 ：reasoning(title,abstract)；CoT(abstract)；logical reasoning(abstract)；分类 cs.AI、cs.LG

Prompting Large Language Models with Chain-of-Thought for Few-Shot Knowledge Base Question Generation

Yuanyuan Liang, Jianing Wang, Hanlun Zhu, Lei Wang, Weining Qian, Yunshi Lan

专题命中 推理评测 ：chain-of-thought(title,abstract)；reasoning(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Accepted by EMNLP 2023 main conference

ECHo: A Visio-Linguistic Dataset for Event Causality Inference via Human-Centric Reasoning

Yuxi Xie, Guanzhen Li, Min-Yen Kan

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments Findings of EMNLP 2023. 10 pages, 6 figures, 5 tables (22 pages, 8 figures, 15 tables including references and appendices)

Challenging BIG-Bench Tasks and Whether Chain-of-Thought Can Solve Them

Mirac Suzgun, Nathan Scales, Nathanael Schärli, Sebastian Gehrmann, Yi Tay, Hyung Won Chung, Aakanksha Chowdhery, Quoc V. Le, Ed H. Chi, Denny Zhou, Jason Wei

专题命中 推理评测 ：chain-of-thought(title,abstract)；reasoning(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Comments GitHub repository: https://github.com/suzgunmirac/BIG-Bench-Hard

Enhanced Mycelium of Thought (EMoT): A Bio-Inspired Hierarchical Reasoning Architecture with Strategic Dormancy and Mnemonic Encoding

增强思维菌丝（EMoT）：一种受生物启发的分层推理架构，具有战略休眠和记忆编码

Florian Odi Stummer

机构 * Institute of General Medicine（医学系） 纠错

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.AI

AI总结 EMoT是一种受生物启发的分层推理架构，通过四层结构（微、中、宏、元）实现战略休眠与激活，结合记忆宫殿和五种记忆编码方式，提升多领域复杂问题解决能力，但存在样本量小、计算成本高等限制。

Comments 32 pages, 6 figures, 15 tables; includes ablation studies and reasoning trace visualisation

Do LLMs Share Human-Like Biases? Causal Reasoning Under Prior Knowledge, Irrelevant Context, and Varying Compute Budgets

大型语言模型是否具有人类般的偏见？在先验知识、无关上下文和不同计算预算下的因果推理

Hanna M. Dettki, Charley M. Wu, Bob Rehder

专题命中 推理评测 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.AI

AI总结 本文通过对比20余种LLM与人类基准，在11个由碰撞结构形式化的因果判断任务中发现，小型可解释模型能有效压缩LLM的因果判断，多数LLM表现出比人类更规则化的推理策略，但未表现出人类典型的碰撞偏见。

Journal ref ICLR 2026 Workshop "From Human Cognition to AI Reasoning (HCAIR)"

GeoSteer: Faithful Chain-of-Thought Steering via Latent Manifold Gradients

GeoSteer: 通过潜在流形梯度实现忠实的思维链引导

Kentaro Kazama, Daiki Shirafuji, Tatsuhiko Saito

专题命中 推理评测 ：chain-of-thought(title,abstract)；reasoning(abstract,comments)；CoT(abstract)；分类 cs.CL

AI总结 GeoSteer通过学习高质量CoT轨迹的低维流形，利用梯度引导提升LLM中间推理质量，实验显示在GSM8k数据集上准确率和推理质量均显著提升。

Comments The Third workshop of NeusymBridge @AAAI 2026 (Bridging Neurons and Symbols for NLP and Knowledge Graph Reasoning)