大模型推理能力

Help or Hurdle? Rethinking Model Context Protocol-Augmented Large Language Models

Wei Song, Haonan Zhong, Ziqi Ding, Jingling Xue, Yuekang Li

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

GALA: Can Graph-Augmented Large Language Model Agentic Workflows Elevate Root Cause Analysis?

Yifang Tian, Yaming Liu, Zichun Chong, Zihang Huang, Hans-Arno Jacobsen

机构 * University of Toronto（多伦多大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Comments 12 pages, 5 figures

A Question Answering Dataset for Temporal-Sensitive Retrieval-Augmented Generation

Ziyang Chen, Erxue Min, Xiang Zhao, Yunxin Li, Xin Jia, Jinzhi Liao, Jichao Li, Shuaiqiang Wang, Baotian Hu, Dawei Yin

机构 * Laboratory for Big Data and Decision, National University of Defense Technology, Changsha, China（大数据与决策实验室，国防科技大学，长沙，中国） ； Baidu Inc., Beijing, China（百度公司，北京，中国） ； Department of Computer Science and Technology, Harbin Institute of Technology (Shenzhen), Shenzhen, China（计算机科学与技术系，哈尔滨工业大学（深圳），深圳，中国） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 10 pages, 5 figures

LLM-as-a-Judge for Privacy Evaluation? Exploring the Alignment of Human and LLM Perceptions of Privacy in Textual Data

Stephen Meisenbacher, Alexandra Klymenko, Florian Matthes

机构 * Technical University of Munich School of Computation, Information（慕尼黑技术大学计算、信息与技术学院） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 13 pages, 3 figures, 4 tables. Accepted to HAIPS @ CCS 2025

Contemplative Artificial Intelligence

Ruben Laukkonen, Fionn Inglis, Shamil Chandaria, Lars Sandved-Smith, Edmundo Lopez-Sola, Jakob Hohwy, Jonathan Gold, Adam Elwood

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.AI

TeleAntiFraud-28k: An Audio-Text Slow-Thinking Dataset for Telecom Fraud Detection

Zhiming Ma, Peidong Wang, Minhua Huang, Jingpeng Wang, Kai Wu, Xiangzhao Lv, Yachun Pang, Yin Yang, Wenjie Tang, Yuchen Kang

机构 * China Mobile Internet Company Ltd.（中国移动互联网有限公司） ； Northeastern University（东北大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

V-RoAst: Visual Road Assessment. Can VLM be a Road Safety Assessor Using the iRAP Standard?

Natchapon Jongwiriyanurak, Zichao Zeng, June Moh Goo, Xinglei Wang, Ilya Ilyankou, Kerkritt Sriroongvikrai, Nicola Christie, Meihui Wang, Huanfa Chen, James Haworth

机构 * University College London（伦敦大学学院） ； Chulalongkorn University（朱拉隆梭大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Chinchunmei at SemEval-2025 Task 11: Boosting the Large Language Model's Capability of Emotion Perception using Contrastive Learning

Tian Li, Yujian Sun, Huizhi Liang

机构 * School of Computing, Newcastle University（计算学院，新卡斯尔大学） ； Shumei AI Research Institute（舒美人工智能研究院） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Journal ref Association for Computational Linguistics, Proceedings of the 19th International Workshop on Semantic Evaluation (SemEval-2025), 319-330

MHPP: Exploring the Capabilities and Limitations of Language Models Beyond Basic Code Generation

Jianbo Dai, Jianqiao Lu, Yunlong Feng, Guangtao Zeng, Rongju Ruan, Ming Cheng, Dong Huang, Haochen Tan, Zhijiang Guo

机构 * University of Edinburgh（爱丁堡大学） ； The University of Hong Kong（香港大学） ； Harbin Institute of Technology（哈尔滨工业大学） ； Singapore University of Technology and Design（新加坡科技设计大学） ； South China University of Technology（华南理工大学） ； City University of Hong Kong（香港城市大学） ； University of Cambridge（剑桥大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 43 pages, dataset and code are available at https://github.com/SparksofAGI/MHPP, leaderboard can be found at https://sparksofagi.github.io/MHPP/

LLM Compression: How Far Can We Go in Balancing Size and Performance?

Sahil Sk, Debasish Dhal, Sonal Khosla, Sk Shahid, Sambit Shekhar, Akash Dhaka, Shantipriya Parida, Dilip K. Prasad, Ondřej Bojar

机构 * Odia Generative AI, India（奥迪生成人工智能，印度） ； AMD Silo AI, Finland（AMD Silo AI，芬兰） ； The Arctic University of Norway, Norway（挪威北极大学，挪威） ； Charles University, MFF, ÚFAL, Czech Republic（查尔斯大学，捷克共和国） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments This paper has been accepted for presentation at the RANLP 2025 conference

MobQA: A Benchmark Dataset for Semantic Understanding of Human Mobility Data through Question Answering

Hikaru Asano, Hiroki Ouchi, Akira Kasuga, Ryo Yonetani

机构 * The University of Tokyo \ AIP Japan Tokyo ； Nara Institute of Science ； The University of Tokyo \ AIP 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments 23 pages, 12 figures

Grounding Rule-Based Argumentation Using Datalog

Martin Diller, Sarah Alice Gaggl, Philipp Hanisch, Giuseppina Monterosso, Fritz Rauschenbach

机构 * Logic Programming and Argumentation Group, TU Dresden, Germany（图灵编程与论证组，德累斯顿理工大学，德国） ； Knowledge-Based Systems Group, TU Dresden, Germany（知识系统组，德累斯顿理工大学，德国） ； DIMES - University of Calabria, Italy（迪梅斯-卡拉布里亚大学，意大利） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Not There Yet: Evaluating Vision Language Models in Simulating the Visual Perception of People with Low Vision

Rosiana Natalie, Wenqian Xu, Ruei-Che Chang, Rada Mihalcea, Anhong Guo

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

MVISU-Bench: Benchmarking Mobile Agents for Real-World Tasks by Multi-App, Vague, Interactive, Single-App and Unethical Instructions

Zeyu Huang, Juyuan Wang, Longfeng Chen, Boyi Xiao, Leng Cai, Yawen Zeng, Jin Xu

机构 * South China University of Technology（华南理工大学） ； Pazhou Lab（Pazhou 实验室） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Comments ACM MM 2025

Technical Report: Full-Stack Fine-Tuning for the Q Programming Language

Brendan R. Hogan, Will Brown, Adel Boyarsky, Anderson Schneider, Yuriy Nevmyvaka

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments 40 pages

Medico 2025: Visual Question Answering for Gastrointestinal Imaging

Sushant Gautam, Vajira Thambawita, Michael Riegler, Pål Halvorsen, Steven Hicks

机构 * SimulaMet - Simula Metropolitan Center for Digital Engineering, Oslo, Norway（SimulaMet - Simula Metropolitan Center for Digital Engineering，挪威奥斯陆） ； Simula Research Laboratory, Oslo, Norway（Simula研究实验室，挪威奥斯陆） ； OsloMet - Oslo Metropolitan University, Oslo, Norway（OsloMet - 奥斯陆 Metropolitan 大学，挪威奥斯陆） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Benchmark-Driven Selection of AI: Evidence from DeepSeek-R1

Petr Spelda, Vit Stritecky

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments 17 pages, 5 figures, 2 tables

Performance of GPT-5 Frontier Models in Ophthalmology Question Answering

Fares Antaki, David Mikhail, Daniel Milad, Danny A Mammo, Sumit Sharma, Sunil K Srivastava, Bing Yu Chen, Samir Touma, Mertcan Sevgi, Jonathan El-Khoury, Pearse A Keane, Qingyu Chen, Yih Chung Tham, Renaud Duval

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Compass-Thinker-7B Technical Report

Anxiang Zeng, Haibo Zhang, Kaixiang Mo, Long Zhang, Shuman Liu, Yanhui Huang, Yawen Liu, Yuepeng Sheng, Yuwei Huang

机构 * Shopee LLM Team（Shopee LLM团队） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

CapeLLM: Support-Free Category-Agnostic Pose Estimation with Multimodal Large Language Models

Junho Kim, Hyungjin Chung, Byung-Hoon Kim

机构 * EverEx ； Yonsei University（延世大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments ICCV 2025

AMRG: Extend Vision Language Models for Automatic Mammography Report Generation

Nak-Jun Sung, Donghyun Lee, Bo Hwa Choi, Chae Jung Park

机构 * Research Institute, National Cancer Center Korea（韩国国家癌症中心研究所） ； Department of Radiology, National Cancer Center Korea（韩国国家癌症中心放射科） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

HiSTM: Hierarchical Spatiotemporal Mamba for Cellular Traffic Forecasting

Zineddine Bettouche, Khalid Ali, Andreas Fischer, Andreas Kassler

机构 * Deggendorf Institute of Technology（多格多夫技术学院） 纠错

专题命中 推理评测 ：planning(abstract)；分类 cs.AI

Generative Artificial Intelligence in Medical Imaging: Foundations, Progress, and Clinical Translation

Xuanru Zhou, Cheng Li, Shuqiang Wang, Ye Li, Tao Tan, Hairong Zheng, Shanshan Wang

专题命中 推理评测 ：planning(abstract)；分类 cs.AI

MemGuide: Intent-Driven Memory Selection for Goal-Oriented Multi-Session LLM Agents

Yiming Du, Bingbing Wang, Yang He, Bin Liang, Baojun Wang, Zhongyang Li, Lin Gui, Jeff Z. Pan, Ruifeng Xu, Kam-Fai Wong

专题命中 推理评测 ：chain-of-thought(abstract)；分类 cs.CL

LongIns: A Challenging Long-context Instruction-based Exam for LLMs

Shawn Gavin, Tuney Zheng, Jiaheng Liu, Quehry Que, Noah Wang, Jian Yang, Chenchen Zhang, Wenhao Huang, Ge Zhang

机构 * M-A-P ； University of Waterloo（滑铁卢大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

AgriGPT: a Large Language Model Ecosystem for Agriculture

Bo Yang, Yu Zhang, Lanfei Feng, Yunkui Chen, Jianyu Zhang, Xiao Xu, Nueraili Aierken, Yurui Li, Yuxuan Chen, Guijun Yang, Yong He, Runhe Huang, Shijian Li

机构 * College of Computer Science and Technology, Zhejiang University, China（浙江大学计算机科学与技术学院） ； College of Software Technology, Zhejiang University, China（浙江大学软件学院） ； School of Geological Engineering and Geomatics, Chang’an University, China（长安大学地质工程与测绘学院） ； College of Biosystems Engineering and Food Science, Zhejiang University, China（浙江大学生物系统工程与食品科学学院） ； Faculty of Computer and Information Sciences, Hosei University, Japan（立命馆大学计算机与信息科学系） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

First Ask Then Answer: A Framework Design for AI Dialogue Based on Supplementary Questioning with Large Language Models

Chuanruo Fu, Yuncheng Du

机构 * Beijing Information Science and Technology University（北京信息科技大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

DoorDet: Semi-Automated Multi-Class Door Detection Dataset via Object Detection and Large Language Models

Licheng Zhang, Bach Le, Naveed Akhtar, Tuan Ngo

机构 * The University of Melbourne（墨尔本大学） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.AI

Multi-Turn Jailbreaks Are Simpler Than They Seem

Xiaoxue Yang, Jaeha Lee, Anna-Katharina Dick, Jasper Timm, Fei Xie, Diogo Cruz

机构 * Imperial College London（伦敦帝国学院） ； California Institute of Technology（加州理工学院） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.LG

Comments 25 pages, 15 figures. Accepted at COLM 2025 SoLaR Workshop

Positional Biases Shift as Inputs Approach Context Window Limits

Blerta Veseli, Julian Chibane, Mariya Toneva, Alexander Koller

机构 * Saarland Informatics Campus, Saarland University, Germany（萨尔兰大学信息学校区） ； Max Planck Institute for Informatics, Saarland Informatics Campus, Germany（马克斯·普朗克信息研究所） ； Max Planck Institute for Software Systems, Saarland Informatics Campus, Germany（马克斯·普朗克软件系统研究所） 纠错

专题命中 推理评测 ：reasoning(abstract)；分类 cs.CL

Journal ref Conference on Language Modeling (COLM) 2025