Unified Deployment-Aware Evaluation of Open Reasoning Language Models
Department of Computer Science, Rensselaer Polytechnic Institute(理海理工学院计算机科学系);Department of Biomedical Engineering, Rensselaer Polytechnic Institute(理海理工学院生物医学工程系)
Open reasoning language models are often compared under mixed sample sizes, partially standardized prompts, and accuracy-centered summaries, which makes practical model selection difficult to interpret. We present a unified evaluation of seven open reasoning language model configurations across four benchmarks: ARC-Challenge, GSM8K, MATH levels 1 to 3, and TruthfulQA MC1. We test zero-shot, chain-of-thought (CoT), and few-shot CoT prompting on the same 238-example subset for every model--dataset--strategy condition, yielding a complete 7 x 4 x 3 design with 84 conditions and 19,992 evaluated examples. Beyond accuracy, we report Wilson confidence intervals, latency, peak video random access memory (VRAM), weighted aggregate performance, Pareto-efficient operating points, prompt-sensitivity metrics, and compatibility diagnostics. Gemma-4-26B-A4B with zero-shot prompting achieves the highest weighted score at 0.794. Gemma-4-E4B remains close to the top across prompting settings while using substantially lower latency and memory, making it a strong practical operating point. Bootstrap and paired-permutation analyses show that the leading configurations are close enough that deployment tradeoffs remain important. We also find that prompting strategy changes model rankings rather than shifting all models uniformly. Benchmark-specific complementarity creates routing headroom, with an oracle task-aware selector reaching a weighted score of 0.825. Compatibility diagnostics show that some apparent failures, especially Phi-4-Reasoning on GSM8K, reflect robustness and interface-adherence problems under the shared evaluation pipeline. These results support a central claim: open-model evaluation should be framed as a deployment-aware, multi-objective operating-point problem rather than as a single-score leaderboard exercise.
Graph Reasoning Paradigm: Structured and Symbolic Reasoning with Topology-Aware Reinforcement Learning for Large Language Models
Harbin Institute of Technology(哈尔滨工业大学);State Key Laboratory of Cognitive Intelligence(认知智能国家重点实验室);Tianjin Normal University(天津师范大学);Pengcheng Laboratory(鹏城实验室)
Enhancing Long-Chain Reasoning Distillation through Error-Aware Self-Reflection
School of Computer Science and Engineering, Northeastern University, China(东北大学计算机科学与工程学院);Department of Computer Science and Technology, Institute for AI, Tsinghua University, China(清华大学人工智能研究院计算机科学与技术系);School of Computer Science, Beijing University of Posts and Telecommunications, China(北京邮电大学计算机科学学院)
Aware First, Think Less: Dynamic Boundary Self-Awareness Drives Extreme Reasoning Efficiency in Large Language Models
LARG, Research Center for Social Computing and Interactive Robotics, Harbin Institute of Technology(大型语言模型研究组,社会计算与交互机器人研究中心,哈尔滨工业大学);School of Computer Science and Engineering, Central South University(计算机科学与工程学院,中南大学)
FERA: Uncertainty-Aware Federated Reasoning for Large Language Models
Indiana University(印第安纳大学);The University of New South Wales(新南威尔士大学);The Chinese University of Hong Kong(香港中文大学);University of California San Diego(加州大学圣地亚哥分校);Adobe Research(Adobe研究院)
SALA: Semantic-Aware Logical Alignment for Complex Reasoning in In-Context Learning
School of Software Engineering, Sun Yat-sen University(中山大学软件工程学院);School of Artificial Intelligence, Sun Yat-sen University(中山大学人工智能学院);Merchants Union Consumer Finance Company Limited(招商局联融消费金融股份有限公司)
Context-aware Inductive Knowledge Graph Completion with Latent Type Constraints and Subgraph Reasoning
The Chinese University of Hong Kong(香港中文大学);International Digital Economy Academy(国际数字经济研究院);Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));University of Cambridge(剑桥大学)
R-KV: Redundancy-aware KV Cache Compression for Reasoning Models
University of Wisconsin - Madison(威斯康星大学麦迪逊分校);Microsoft(微软);Carnegie Mellon University(卡内基梅隆大学);California Institute of Technology(加州理工学院);University of California - San Diego(加州大学圣地亚哥分校);University of Surrey(萨里大学);University of California - Berkeley(加州大学伯克利分校)
The Reasoning Trap -- Logical Reasoning as a Mechanistic Pathway to Situational Awareness
MARS 4.0 Fellowship, Cambridge AI Safety Hub(CAISH), University of Cambridge(MARS 4.0 Fellow,剑桥人工智能安全中心(CAISH),剑桥大学);AWS Generative AI Innovation Center, Amazon Web Services, USA(亚马逊生成AI创新中心,亚马逊网络服务,美国);Google, USA(谷歌,美国);Stanford University(斯坦福大学);Northeastern University, Seattle, WA, USA(东北大学,西雅图,华盛顿州,美国)
SURE: Synergistic Uncertainty-aware Reasoning for Multimodal Emotion Recognition in Conversations
Guangdong Provincial Key Laboratory of Quantum Engineering and Quantum Materials(广东省量子工程与量子材料重点实验室);School of Electronic Science and Engineering (School of Microelectronics), South China Normal University(华南师范大学电子科学与工程学院(微电子学院));Shenzhen University(深圳大学);Columbia University(哥伦比亚大学)
DAGN: Discourse-Aware Graph Network for Logical Reasoning
Shenzhen Campus of Sun Yat-sen University(中山大学深圳校区);Tencent Robotics X(腾讯机器人实验室);School of Computer Science, The University of Sydney(悉尼大学计算机科学学院);The Chinese University of Hong Kong(香港中文大学)
Temporal-Aware Heterogeneous Graph Reasoning with Multi-View Fusion for Temporal Question Answering
1 School of Internet of Things, Nanjing University of Posts;Telecommunications 2 Faculty of Medicine \& Health, University of New South Wales, Sydney, Australia 3 Dept. of Biomedical Engineering \& Biotechnology, Khalifa University, Abu Dhabi 4 Beijing Information Science;Technology University 5 Shortest Path Technology Co., Ltd.