大模型推理能力

EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis

Shengyuan Liu, Boyun Zheng, Wenting Chen, Zhihao Peng, Zhenfei Yin, Jing Shao, Jiancong Hu, Yixuan Yuan

机构 * Chinese University of Hong Kong（中国香港大学） ； City University of Hong Kong（香港城市大学） ； University of Oxford（牛津大学） ； Shanghai AI Laboratory（上海人工智能实验室） ； The Sixth Affiliated Hospital, Sun Yat-sen University（中山大学第六附属医院） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 40 pages, 22 figures; Accepted by NeurIPS 2025 Dataset and Benchmark Track

PersONAL: Towards a Comprehensive Benchmark for Personalized Embodied Agents

Filippo Ziliotto, Jelin Raphael Akkara, Alessandro Daniele, Lamberto Ballan, Luciano Serafini, Tommaso Campari

机构 * University of Padova（帕多瓦大学） ； Fondazione Bruno Kessler（布鲁诺·科塞拉基金会） 纠错

专题命中 推理评测 ：reasoning(abstract)

Language Model Evolutionary Algorithms for Recommender Systems: Benchmarks and Algorithm Comparisons

Jiao Liu, Zhu Sun, Shanshan Feng, Caishun Chen, Yew-Soon Ong

专题命中 推理评测 ：reasoning(abstract)

A Knowledge Graph and a Tripartite Evaluation Framework Make Retrieval-Augmented Generation Scalable and Transparent

Olalekan K. Akindele, Bhupesh Kumar Mishra, Kenneth Y. Wertheim

专题命中 推理评测 ：chain-of-thought(abstract)

Comments 25 Pages

CPT-4DMR: Continuous sPatial-Temporal Representation for 4D-MRI Reconstruction

Xinyang Wu, Muheng Li, Xia Li, Orso Pusterla, Sairos Safai, Philippe C. Cattin, Antony J. Lomax, Ye Zhang

机构 * Center for Proton Therapy, Paul Scherrer Institut（质子治疗中心，保罗·施特格勒研究所） ； Department of Physics, ETH Zurich（苏黎世联邦理工学院物理系） ； Department of Computer Science, ETH Zurich（苏黎世联邦理工学院计算机科学系） ； Department of Radiology, Division of Radiological Physics, University Hospital Basel（巴塞尔大学医院放射科，放射物理 division） ； Department of Biomedical Engineering, University of Basel（巴塞尔大学生物医学工程系） ； Institute for Biomedical Engineering, University and ETH Zurich（生物医学工程研究所，大学与苏黎世联邦理工学院） 纠错

专题命中 推理评测 ：planning(abstract)

Losing the Plot: How VLM responses degrade on imperfect charts

Philip Wootaek Shin, Jack Sampson, Vijaykrishnan Narayanan, Andres Marquez, Mahantesh Halappanavar

机构 * The Pennsylvania State University（宾夕法尼亚州立大学） ； Pacific Northwest National Laboratory（太平洋西北国家实验室） 纠错

专题命中 推理评测 ：reasoning(abstract)

SimToken: A Simple Baseline for Referring Audio-Visual Segmentation

Dian Jin, Yanghao Zhou, Jinxing Zhou, Jiaqi Ma, Ruohao Guo, Dan Guo

专题命中 推理评测 ：reasoning(abstract)

Comments Project page: https://github.com/DianJin-HFUT/SimToken

Expected Optimal Distances of Random Bipartite Matching in $D$-dimensional Spaces: Approximate Formulas and Applications to Mobility Services

Shiyu Shen, Yuhui Zhai, Yanfeng Ouyang

专题命中 推理评测 ：planning(abstract)

EMO-RL: Emotion-Rule-Based Reinforcement Learning Enhanced Audio-Language Model for Generalized Speech Emotion Recognition

Pengcheng Li, Botao Zhao, Zuheng Kang, Junqing Peng, Xiaoyang Qu, Yayun He, Jianzong Wang

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted by the Findings of 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP Findings 2025)

Seeing is Believing? Mitigating OCR Hallucinations in Multimodal Large Language Models

Zhentao He, Can Zhang, Ziheng Wu, Zhenghao Chen, Yufei Zhan, Yifan Li, Zhao Zhang, Xian Wang, Minghui Qiu

机构 * ByteDance（字节跳动） ； CASIA（中国科学院自动化研究所） ； RUC（中国人民大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted by NeurIPS 2025

Code Generation with Small Language Models: A Codeforces-Based Study

Débora Souza, Rohit Gheyi, Lucas Albuquerque, Gustavo Soares, Márcio Ribeiro

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted at International Conference on Machine Learning and Applications (ICMLA 2025)

AcT2I: Evaluating and Improving Action Depiction in Text-to-Image Models

Vatsal Malaviya, Agneet Chatterjee, Maitreya Patel, Yezhou Yang, Chitta Baral

机构 * Arizona State University（亚利桑那州立大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments Project Page : https://vatsal-malaviya.github.io/AcT2I/

Cinéaste: A Fine-grained Contextual Movie Question Answering Benchmark

Nisarg A. Shah, Amir Ziai, Chaitanya Ekanadham, Vishal M. Patel

机构 * Netflix, Inc.（Netflix公司） ； Johns Hopkins University（约翰霍普金斯大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 11 pages, 5 figures, 5 tables

SPAR: Scalable LLM-based PDDL Domain Generation for Aerial Robotics

Songhao Huang, Yuwei Wu, Guangyao Shi, Gaurav S. Sukhatme, Vijay Kumar

机构 * GRASP Lab, University of Pennsylvania（宾夕法尼亚大学GRASP实验室） ； Department of Computer Science, University of Southern California（南加州大学计算机科学系） 纠错

专题命中 推理评测 ：planning(abstract)

Using Visual Language Models to Control Bionic Hands: Assessment of Object Perception and Grasp Inference

Ozan Karaali, Hossam Farag, Strahinja Dosen, Cedomir Stefanovic

机构 * Department of Electronic Systems, Aalborg University, Denmark（电子系统系，奥胡斯大学） ； Department of Health Science and Technology, Aalborg University, Denmark（健康科学与技术系，奥胡斯大学） 纠错

专题命中 推理评测 ：planning(abstract)

Comments ICAT 2025

FinSentLLM: Multi-LLM and Structured Semantic Signals for Enhanced Financial Sentiment Forecasting

Zijian Zhang, Rong Fu, Yangfan He, Xinze Shen, Yanlong Wang, Xiaojing Du, Haochen You, Jiazhao Shi, Simon Fong

专题命中 推理评测 ：reasoning(abstract)

PromptSleuth: Detecting Prompt Injection via Semantic Intent Invariance

Mengxiao Wang, Yuxuan Zhang, Guofei Gu

专题命中 推理评测 ：reasoning(abstract)

CLAIRE: A Dual Encoder Network with RIFT Loss and Phi-3 Small Language Model Based Interpretability for Cross-Modality Synthetic Aperture Radar and Optical Land Cover Segmentation

Debopom Sutradhar, Arefin Ittesafun Abian, Mohaimenul Azam Khan Raiaan, Reem E. Mohamed, Sheikh Izzal Azid, Sami Azam

机构 * Department of Computer Science and Engineering, United International University（计算机科学与工程系，国际大学） ； Faculty of Science and Information Technology, Charles Darwin University（科学与信息技术学院，查尔斯·达尔文大学） ； School of Engineering and Energy , Murdoch University（工程与能源学院，默多尼大学） ； Faculty of Science and Technology, Charles Darwin University（科学与技术学院，查尔斯·达尔文大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 23 pages, 6 figures, 10 tables

Dr.V: A Hierarchical Perception-Temporal-Cognition Framework to Diagnose Video Hallucination by Fine-grained Spatial-Temporal Grounding

Meng Luo, Shengqiong Wu, Liqiang Jing, Tianjie Ju, Li Zheng, Jinxiang Lai, Tianlong Wu, Xinya Du, Jian Li, Siyuan Yan, Jiebo Luo, William Yang Wang, Hao Fei, Mong-Li Lee, Wynne Hsu

专题命中 推理评测 ：reasoning(abstract)

Comments 25 pages, 16 figures

Seeing the Undefined: Chain-of-Action for Generative Semantic Labels

Meng Wei, Zhongnian Li, Peng Ying, Xinzheng Xu

机构 * 1 School of Computer Science ； Technology / School of Artificial Intelligence, China University of Mining ； Technology Xuzhou China 2 Mine Digitization Engineering Research Center of the Ministry of Education Xuzhou China ； Technology Xuzhou China 2 The State Key Laboratory of CAD\&CG, Zhejiang University Hangzhou China 3 Mine Digitization Engineering Research Center of the Ministry of Education Xuzhou China ； 2 Mine Digitization Engineering Research Center of the Ministry of Education ； 2 The State Key Laboratory of CAD\&CG, Zhejiang University ； 3 Mine Digitization Engineering Research Center of the Ministry of Education 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 15 pages, 8 figures

Enhancing IoMT Security with Explainable Machine Learning: A Case Study on the CICIOMT2024 Dataset

Mohammed Yacoubi, Omar Moussaoui, C. Drocourt

专题命中 推理评测 ：reasoning(abstract)

Journal ref The Third Edition of the International Conference on Connected Objects and Artificial Intelligence (COCIA'2025), Apr 2025, Casablanca (Maroc), Morocco

Shaken, Not Stirred: A Novel Dataset for Visual Understanding of Glasses in Human-Robot Bartending Tasks

Lukáš Gajdošech, Hassan Ali, Jan-Gerrit Habekost, Martin Madaras, Matthias Kerzel, Stefan Wermter

机构 * Department of Applied Informatics, Faculty of Mathematics, Physics and Informatics, Comenius University（应用信息学院，数学物理学院，科门ius大学） ； Knowledge Technology Group, Department of Informatics, University of Hamburg（知识技术组，信息学院，汉堡大学） 纠错

专题命中 推理评测 ：planning(abstract)

Comments Submitted and Accepted for Presentation at the IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2025

Teaching an Old LLM Secure Coding: Localized Preference Optimization on Distilled Preferences

Mohammad Saqib Hasan, Saikat Chakraborty, Santu Karmaker, Niranjan Balasubramanian

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted to ACL 2025 (Main)

All You Need Is A Fuzzing Brain: An LLM-Powered System for Automated Vulnerability Detection and Patching

Ze Sheng, Qingxiao Xu, Jianwei Huang, Matthew Woodcock, Heqing Huang, Alastair F. Donaldson, Guofei Gu, Jeff Huang

专题命中 推理评测 ：reasoning(abstract)

Comments 14 pages, 5 figures

Differential Morphological Profile Neural Networks for Semantic Segmentation

David Huangal, J. Alex Hurt

专题命中 推理评测 ：planning(abstract)

Comments 14 pages, 7 figures

PixFoundation 2.0: Do Video Multi-Modal LLMs Use Motion in Visual Grounding?

Mennatullah Siam

专题命中 推理评测 ：reasoning(abstract)

Comments Work under review in NeurIPS 2025 with the title "Are we using Motion in Referring Segmentation? A Motion-Centric Evaluation"

Introducing LCOAI: A Standardized Economic Metric for Evaluating AI Deployment Costs

Eliseo Curcio

专题命中 推理评测 ：planning(abstract)

Understanding and evaluating computer vision models through the lens of counterfactuals

Pushkar Shukla

专题命中 推理评测 ：reasoning(abstract)

Fact or Facsimile? Evaluating the Factual Robustness of Modern Retrievers

Haoyu Wu, Qingcheng Zeng, Kaize Ding

专题命中 推理评测 ：reasoning(abstract)

Comments Proceedings of the 34th ACM International Conference on Information and Knowledge Management

MedFoundationHub: A Lightweight and Secure Toolkit for Deploying Medical Vision Language Foundation Models

Xiao Li, Yanfan Zhu, Ruining Deng, Wei-Qi Wei, Yu Wang, Shilin Zhao, Yaohong Wang, Haichun Yang, Yuankai Huo

机构 * Vanderbilt University（范德比尔特大学） ； Weill Cornell Medicine（韦尔·科恩医学中心） ； Vanderbilt University Medical Center（范德比尔特大学医学中心） ； UT MD Anderson Cancer Center（德克萨斯大学MD安德森癌症中心） 纠错

专题命中 推理评测 ：reasoning(abstract)