大模型推理能力

From Diagnosis to Improvement: Probing Spatio-Physical Reasoning in Vision Language Models

Tiancheng Han, Yunfei Gao, Yong Li, Wuzhou Yu, Qiaosheng Zhang, Wenqi Shao

专题命中 推理评测 ：reasoning(title,abstract)

Comments 9 pages, 6 figures

Pass@k Training for Adaptively Balancing Exploration and Exploitation of Large Reasoning Models

Zhipeng Chen, Xiaobo Qin, Youbin Wu, Yue Ling, Qinghao Ye, Wayne Xin Zhao, Guang Shi

机构 * Renmin University of China（中国人民大学） 纠错

专题命中 推理评测 ：reasoning(title)；分类 cs.CL、cs.AI、cs.LG

Comments Technical Report about RLVR: 32 pages, 18 figures, 7 tables

IADGPT: Unified LVLM for Few-Shot Industrial Anomaly Detection, Localization, and Reasoning via In-Context Learning

Mengyang Zhao, Teng Fu, Haiyang Yu, Ke Niu, Bin Li

专题命中 推理评测 ：reasoning(title,abstract)

Making Qwen3 Think in Korean with Reinforcement Learning

Jungyup Lee, Jemin Kim, Sang Park, SeungJae Lee

机构 * Jungyup Lee, Jemin Kim, Sang Park, SeungJae Lee（作者） 纠错

专题命中 推理评测 ：reasoning(abstract)；chain-of-thought(abstract)；logical reasoning(abstract)；分类 cs.CL

PersonaEval: Are LLM Evaluators Human Enough to Judge Role-Play?

Lingfeng Zhou, Jialing Zhang, Jin Gao, Mohan Jiang, Dequan Wang

专题命中 推理评测 ：reasoning(abstract)；test-time compute(abstract)；分类 cs.CL

Comments Accepted by COLM 2025

Evaluating the Performance and Robustness of LLMs in Materials Science Q&A and Property Predictions

Hongchen Wang, Kangming Li, Scott Ramsay, Yao Fehlis, Edward Kim, Jason Hattrick-Simpers

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.CL、cs.AI、cs.LG

OrderChain: Towards General Instruct-Tuning for Stimulating the Ordinal Understanding Ability of MLLM

Jinhong Wang, Shuo Tong, Jian liu, Dongqi Tang, Weiqiang Wang, Wentong Li, Hongxia Xu, Danny Chen, Jintai Chen, Jian Wu

机构 * College of Computer Science & Technology, Zhejiang University（浙江大学计算机科学与技术学院） ； Transvascular Implantation Devices Research Institute and Liangzhu Laboratory（血管植入物研究机构和良渚实验室） ； Ant Group（蚂蚁集团） ； University of Notre Dame（圣母大学） ； HKUST (Guangzhou)（香港科技大学（广州）） 纠错

专题命中 推理评测 ：chain-of-thought(abstract)；CoT(abstract)

Comments Accepted by ICCV 2025

CodeJudgeBench: Benchmarking LLM-as-a-Judge for Coding Tasks

Hongchao Jiang, Yiming Chen, Yushi Cao, Hung-yi Lee, Robby T. Tan

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments Dataset is available at https://huggingface.co/datasets/mattymchen/codejudgebench

mSCoRe: a $M$ultilingual and Scalable Benchmark for $S$kill-based $Co$mmonsense $Re$asoning

Nghia Trung Ngo, Franck Dernoncourt, Thien Huu Nguyen

机构 * Department of Computer Science, University of Oregon（俄勒冈大学计算机科学系） ； Adobe Research（Adobe研究） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Amazon Nova AI Challenge -- Trusted AI: Advancing secure, AI-assisted software development

Sattvik Sahai, Prasoon Goyal, Michael Johnston, Anna Gottardi, Yao Lu, Lucy Hu, Luke Dai, Shaohua Liu, Samyuth Sagi, Hangjie Shi, Desheng Zhang, Lavina Vaz, Leslie Ball, Maureen Murray, Rahul Gupta, Shankar Ananthakrishna

机构 * Amazon（亚马逊） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.AI

Comments 18 pages, 1st Proceedings of Amazon Nova AI Challenge (Trusted AI 2025)

XFacta: Contemporary, Real-World Dataset and Evaluation for Multimodal Misinformation Detection with Multimodal LLMs

Yuzhuo Xiao, Zeyu Han, Yuhan Wang, Huaizu Jiang

机构 * Guizhou University（贵州大学） ； Northeastern University（东北大学） ； UC Santa Cruz（加州大学圣克ruz分校） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL、cs.LG

Comments For associated code and dataset, see https://github.com/neu-vi/XFacta

Medico 2025: Visual Question Answering for Gastrointestinal Imaging

Sushant Gautam, Vajira Thambawita, Michael Riegler, Pål Halvorsen, Steven Hicks

机构 * SimulaMet - Simula Metropolitan Center for Digital Engineering, Oslo, Norway（SimulaMet - Simula Metropolitan Center for Digital Engineering，挪威奥斯陆） ； Simula Research Laboratory, Oslo, Norway（Simula研究实验室，挪威奥斯陆） ； OsloMet - Oslo Metropolitan University, Oslo, Norway（OsloMet - 奥斯陆 Metropolitan 大学，挪威奥斯陆） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Benchmark-Driven Selection of AI: Evidence from DeepSeek-R1

Petr Spelda, Vit Stritecky

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments 17 pages, 5 figures, 2 tables

Performance of GPT-5 Frontier Models in Ophthalmology Question Answering

Fares Antaki, David Mikhail, Daniel Milad, Danny A Mammo, Sumit Sharma, Sunil K Srivastava, Bing Yu Chen, Samir Touma, Mertcan Sevgi, Jonathan El-Khoury, Pearse A Keane, Qingyu Chen, Yih Chung Tham, Renaud Duval

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Compass-Thinker-7B Technical Report

Anxiang Zeng, Haibo Zhang, Kaixiang Mo, Long Zhang, Shuman Liu, Yanhui Huang, Yawen Liu, Yuepeng Sheng, Yuwei Huang

机构 * Shopee LLM Team（Shopee LLM团队） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models

Junho Kim, Hyungjin Chung, Byung-Hoon Kim

机构 * EverEx ； Yonsei University（延世大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments ICCV 2025

FedCoT: Communication-Efficient Federated Reasoning Enhancement for Large Language Models

Chuan Li, Qianyi Zhao, Fengran Mo, Cen Chen

专题命中 其他推理 ：reasoning(title,abstract)；chain-of-thought(abstract)；CoT(abstract)；分类 cs.CL、cs.AI

Large Language Models Show Signs of Alignment with Human Neurocognition During Abstract Reasoning

Christopher Pinier, Sonia Acuña Vargas, Mariia Steeghs-Turchina, Dora Matzke, Claire E. Stevenson, Michael D. Nunez

专题命中 其他推理 ：reasoning(title,abstract)；分类 cs.CL、cs.AI

Comments Presented at the 8th Annual Conference on Cognitive Computational Neuroscience (August 12-15, 2025; Amsterdam, The Netherlands); 20 pages, 11 figures

Less is More: Learning Graph Tasks with Just LLMs

Sola Shirai, Kavitha Srinivas, Julian Dolby, Michael Katz, Horst Samulowitz, Shirin Sohrabi

专题命中 其他推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.AI、cs.LG

DiFaR: Enhancing Multimodal Misinformation Detection with Diverse, Factual, and Relevant Rationales

Herun Wan, Jiaying Wu, Minnan Luo, Xiangzheng Kong, Zihan Ma, Zhi Zeng

专题命中 其他推理 ：reasoning(abstract)；chain-of-thought(abstract)；分类 cs.CL

Grouped Sequency-arranged Rotation: Optimizing Rotation Transformation for Quantization for Free

Euntae Choi, Sumin Song, Woosang Lim, Sungjoo Yoo

机构 * Seoul National University（首尔国立大学） 纠错

专题命中 其他推理 ：reasoning(abstract)；分类 cs.CL、cs.AI、cs.LG

Comments 7 pages

Agentic AI Frameworks: Architectures, Protocols, and Design Challenges

Hana Derouiche, Zaki Brahmi, Haithem Mazeni

机构 * University of Kairouan（卡鲁安大学） ； SMART Lab, University of Tunis（图纳大学SMART实验室） ； University of Sousse（索斯大学） ； Riadi Lab, Compus Manouba（曼努巴大学里亚迪实验室） ； University of Jandouba（贾杜巴大学） 纠错

专题命中 其他推理 ：reasoning(abstract)；分类 cs.AI

Assessing the Capability of Large Language Models for Domain-Specific Ontology Generation

Anna Sofia Lippolis, Mohammad Javad Saeedizade, Robin Keskisarkka, Aldo Gangemi, Eva Blomqvist, Andrea Giovanni Nuzzolese

机构 * University of Bologna, Italy（博洛尼亚大学，意大利） ； ISTC-CNR, Italy（ISTC-意大利国家研究理事会） ； Linköping University, Sweden（林雪平大学，瑞典） 纠错

专题命中 其他推理 ：reasoning(abstract)；分类 cs.AI

Journal ref Joint Proc. ESWC 2025 Workshops and Tutorials, CEUR-WS, Vol. 3977, 2025

Leveraging Large Language Models for Relevance Judgments in Legal Case Retrieval

Shengjie Ma, Qi Chu, Jiaxin Mao, Xuhui Jiang, Haozhe Duan, Chong Chen

机构 * Gaoling School of Artificial Intelligence, Renmin University of China（中国人民大学耿丽人工智能学院） ； Beijing Normal University（北京师范大学） ； DataArc Tech Ltd.（数据弧科技有限公司） ； Huawei Cloud BU（华为云业务单元） 纠错

专题命中 其他推理 ：reasoning(abstract)；分类 cs.AI

Towards Agentic AI for Multimodal-Guided Video Object Segmentation

Tuyen Tran, Thao Minh Le, Truyen Tran

机构 * Applied Artificial Intelligence Institute, Deakin University, Australia（应用人工智能研究所，德金大学，澳大利亚） 纠错

专题命中 其他推理 ：reasoning(abstract)

Few-shot Vision-based Human Activity Recognition with MLLM-based Visual Reinforcement Learning

Wenqi Zheng, Yutaka Arakawa

机构 * Graduate School（研究生院） ； Faculty of Information Science（信息科学系） ； Electrical Engineering（电气工程） ； Kyushu University（九州大学） ； JAPAN（日本） 纠错

专题命中 其他推理 ：reasoning(abstract)

Teaching LLMs to Speak Spectroscopy

Nesar Ramachandra, Yuan-Sen Ting, Zechang Sun, Azton Wells, Salman Habib

专题命中 其他推理 ：reasoning(abstract)

Comments 6 pages, 1 figure, Accepted to the Machine Learning for Astrophysics (ML4Astro) Colocated Workshop at ICML 2025