大模型推理能力

Automated Repair of C Programs Using Large Language Models

Mahdi Farzandway, Fatemeh Ghassemi

专题命中 推理评测 ：reasoning(abstract)；chain-of-thought(abstract)；CoT(abstract)

AHELM: A Holistic Evaluation of Audio-Language Models

Tony Lee, Haoqin Tu, Chi Heem Wong, Zijun Wang, Siwei Yang, Yifan Mai, Yuyin Zhou, Cihang Xie, Percy Liang

机构 * Stanford University（斯坦福大学） ； University of California, Santa Cruz（加州大学圣克ruz分校） ； Hitachi America, Ltd.（日立美国有限公司） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

SinhalaMMLU: A Comprehensive Benchmark for Evaluating Multitask Language Understanding in Sinhala

Ashmari Pramodya, Nirasha Nelki, Heshan Shalinda, Chamila Liyanage, Yusuke Sakai, Randil Pushpananda, Ruvan Weerasinghe, Hidetaka Kamigaito, Taro Watanabe

机构 * Nara Institute of Science and Technology (NAIST)（奈良科学技术研究所） ； University of Colombo School of Computing (UCSC)（科伦坡大学计算学院） ； Informatics Institute of Technology (IIT)（信息技术研究所） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 19 pages, 11 figures

Are We SOLID Yet? An Empirical Study on Prompting LLMs to Detect Design Principle Violations

Fatih Pehlivan, Arçin Ülkü Ergüzen, Sahand Moslemi Yengejeh, Mayasah Lami, Anil Koyuncu

机构 * Bilkent University, Turkey（巴伊肯大学） 纠错

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.AI

Comments Accepted to ASE2025

Advancing Dialectal Arabic to Modern Standard Arabic Machine Translation

Abdullah Alabdullah, Lifeng Han, Chenghua Lin

机构 * University of Manchester（曼彻斯特大学） ； School of Informatics, University of Edinburgh（爱丁堡大学信息学院） ； Leiden University（莱顿大学） ； LIACS ； LUMC 纠错

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.CL

PixFoundation 2.0: Do Video Multi-Modal LLMs Use Motion in Visual Grounding?

Mennatullah Siam

专题命中 推理评测 ：reasoning(abstract)

Comments Work under review in NeurIPS 2025 with the title "Are we using Motion in Referring Segmentation? A Motion-Centric Evaluation"

Introducing LCOAI: A Standardized Economic Metric for Evaluating AI Deployment Costs

Eliseo Curcio

专题命中 推理评测 ：planning(abstract)