大模型推理能力

Physics Knowledge in Frontier Models: A Diagnostic Study of Failure Modes

Ieva Bagdonaviciute, Vibhav Vineet

专题命中 推理评测 ：reasoning(abstract)

Comments 8 pages, 7 figures. Preprint. v2: Updated experiments and diagnostics; formatting fixes

VITRIX-CLIPIN: Enhancing Fine-Grained Visual Understanding in CLIP via Instruction Editing Data and Long Captions

Ziteng Wang, Siqi Yang, Limeng Qiao, Lin Ma

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted to NeurIPS 2025

SITE: towards Spatial Intelligence Thorough Evaluation

Wenqi Wang, Reuben Tan, Pengyue Zhu, Jianwei Yang, Zhengyuan Yang, Lijuan Wang, Andrey Kolobov, Jianfeng Gao, Boqing Gong

机构 * Boston University（波士顿大学） ； Microsoft Research（微软研究院） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted to ICCV 2025

Understanding and Estimating the Execution Time of Quantum Circuits

Ning Ma, Heng Li

专题命中 推理评测 ：planning(abstract)

WEAVE: Unleashing and Benchmarking the In-context Interleaved Comprehension and Generation

Wei Chow, Jiachun Pan, Yongyuan Liang, Mingze Zhou, Xue Song, Liyu Jia, Saining Zhang, Siliang Tang, Juncheng Li, Fengda Zhang, Weijia Wu, Hanwang Zhang, Tat-Seng Chua

机构 * National University of Singapore（新加坡国立大学） ； Nanyang Technological University（南洋理工大学） ； University of Maryland, College Park（马里兰大学学院公园分校） ； Zhejiang University（浙江大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

SEAL: Subspace-Anchored Watermarks for LLM Ownership

Yanbo Dai, Zongjie Li, Zhenlan Ji, Shuai Wang

专题命中 推理评测 ：reasoning(abstract)

DEFT-LLM: Disentangled Expert Feature Tuning for Micro-Expression Recognition

Ren Zhang, Huilai Li, Chao qi, Guoliang Xu, Tianyu Zhou, Wei wei, Jianqin Yin

机构 * College of Intelligent Engineering and Automation, Beijing University of Posts and Telecommunications（智能工程与自动化学院，北京邮电大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

EIDSeg: A Pixel-Level Semantic Segmentation Dataset for Post-Earthquake Damage Assessment from Social Media Images

Huili Huang, Chengeng Liu, Danrong Zhang, Shail Patel, Anastasiya Masalava, Sagar Sadak, Parisa Babolhavaeji, WeiHong Low, Max Mahdi Roozbahani, J. David Frost

专题命中 推理评测 ：planning(abstract)

Comments Camera-Ready for AAAI-AISI26

DENTEX: Dental Enumeration and Tooth Pathosis Detection Benchmark for Panoramic X-ray

Ibrahim Ethem Hamamci, Sezgin Er, Omer Faruk Durugol, Gulsade Rabia Cakmak, Ezequiel de la Rosa, Enis Simsar, Atif Emre Yuksel, Sadullah Gultekin, Serife Damla Ozdemir, Kaiyuan Yang, Mehmet Berke Isler, Mustafa Salih Gucez, Shenxiao Mei, Chenglong Ma, Feihong Shen, Kaidi Shen, Huikai Wu, Han Wu, Lanzhuju Mei, Zhiming Cui, Niels van Nistelrooij, Khalid El Ghoul, Steven Kempers, Tong Xi, Shankeeth Vinayahalingam, Kyoungyeon Choi, Jaewon Shin, Eunyi Lyou, Lanshan He, Yusheng Liu, Lisheng Wang, Tudor Dascalu, Shaqayeq Ramezanzade, Azam Bakhshandeh, Lars Bjørndal, Bulat Ibragimov, Hongwei Bran Li, Sarthak Pati, Bernd Stadlinger, Albert Mehl, Mehmet Kemal Ozdemir, Mustafa Gundogar, Bjoern Menze

机构 * Department of Quantitative Biomedicine, University of Zurich（苏黎世大学定量生物医学系） ； Harvard Medical School（哈佛医学院） ； Department of Computer Science, ETH Zurich（苏黎世联邦理工学院计算机科学系） ； ETH AI Center, ETH Zurich（苏黎世联邦理工学院人工智能中心） ； Center for Dental Medicine, University of Zurich（苏黎世大学牙科医学中心） ； Department of Computer Engineering, Bogazici University（博雅大学计算机工程系） ； Department of Endodontics, Istanbul Medipol University（伊斯坦布尔Medipol大学牙体医学系） ； University of Oklahoma, College of Dentistry, Graduate Periodontics Department（俄克拉荷马大学牙科学院研究生牙周病学系） 纠错

专题命中 推理评测 ：planning(abstract)

Evaluating Software Process Models for Multi-Agent Class-Level Code Generation

Wasique Islam Shafin, Md Nakhla Rafi, Zhenhao Li, Tse-Hsun Chen

专题命中 推理评测 ：reasoning(abstract)

Clinically-aligned Multi-modal Chest X-ray Classification

Phillip Sloan, Edwin Simpson, Majid Mirmehdi

专题命中 推理评测 ：reasoning(abstract)

Comments 9 Pages, 2 Figures, 3 Tables & 2 Supplementary Tables in Appendix. Accepted to ML4H 2025 (Proceedings)

VietMEAgent: Culturally-Aware Few-Shot Multimodal Explanation for Vietnamese Visual Question Answering

Hai-Dang Nguyen, Minh-Anh Dang, Minh-Tan Le, Minh-Tuan Le

机构 * Faculty Of Information Technology, VNU University of Engineering and Technology（信息科技学院，越南工程与技术大学） ； IT-BT Convergence Technology Division, Vietnam-Korea Institute of Science and Technology（IT-BT融合技术部，越南-韩国科学技术院） ； TADI Global Lab, TADI Global Company Limited（TADI全球实验室，TADI全球公司） ； Faculty of Finance, Banking Academy of Vietnam（金融学院，越南银行学院） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 7 pages, 3 figures, 3 tables, FAIR 2025 conference

CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models

Xiao An, Jiaxing Sun, Zihan Gui, Wei He

机构 * State Key Lab. LIESMARS, Wuhan University（武汉大学遥感信息与地学实验室国家重点实验室） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted by NeurIPS 2025 Track on Datasets and Benchmarks

VideoChain: A Transformer-Based Framework for Multi-hop Video Question Generation

Arpan Phukan, Anupam Pandey, Deepjyoti Bodo, Asif Ekbal

机构 * Department of Computer Science and Engineering, IIT Patna（计算机科学与工程系，印度理工学院帕纳） 纠错

专题命中 推理评测 ：reasoning(abstract)

VideoSSR: Video Self-Supervised Reinforcement Learning

Zefeng He, Xiaoye Qu, Yafu Li, Siyuan Huang, Daizong Liu, Yu Cheng

机构 * Shanghai Artificial Intelligence Laboratory（上海人工智能实验室） ； The Chinese University of Hong Kong（香港中文大学） ； Shanghai Jiao Tong University（上海交通大学） ； Wuhan University（武汉大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

InfiniBench: A Benchmark for Large Multi-Modal Models in Long-Form Movies and TV Shows

Kirolos Ataallah, Eslam Abdelrahman, Mahmoud Ahmed, Chenhui Gou, Khushbu Pahwa, Jian Ding, Mohamed Elhoseiny

机构 * KAUST（卡塔尔科技大学） ； Monash University（墨尔本大学） ； RICE University（里士满大学） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted for oral presentation at the EMNLP 2025 main conference

Agentic Refactoring: An Empirical Study of AI Coding Agents

Kosei Horikawa, Hao Li, Yutaro Kashiwa, Bram Adams, Hajimu Iida, Ahmed E. Hassan

专题命中 推理评测 ：planning(abstract)

Comments 23 pages, 7 Tables, 5 Figuress, Submitted to ACM Transactions on Software Engineering and Methodology(TOSEM)

STARC-9: A Large-scale Dataset for Multi-Class Tissue Classification for CRC Histopathology

Barathi Subramanian, Rathinaraja Jeyaraj, Mitchell Nevin Peterson, Terry Guo, Nigam Shah, Curtis Langlotz, Andrew Y. Ng, Jeanne Shen

专题命中 推理评测 ：planning(abstract)

Comments 37 pages, 18 figures, Accepted in NeurIPS 2025

SAFe-Copilot: Unified Shared Autonomy Framework

Phat Nguyen, Erfan Aasi, Shiva Sreeram, Guy Rosman, Andrew Silva, Sertac Karaman, Daniela Rus

机构 * MIT CSAIL（麻省理工学院计算机科学与人工智能实验室） ； TRI（丰田研究机构） ； MIT LIDS（麻省理工学院领导力与决策科学实验室） 纠错

专题命中 推理评测 ：reasoning(abstract)

A Tool for Benchmarking Large Language Models' Robustness in Assessing the Realism of Driving Scenarios

Jiahui Wu, Chengjie Lu, Aitor Arrieta, Shaukat Ali

专题命中 推理评测 ：reasoning(abstract)

Benchmarking and Studying the LLM-based Agent System in End-to-End Software Development

Zhengran Zeng, Yixin Li, Rui Xie, Wei Ye, Shikun Zhang

专题命中 推理评测 ：planning(abstract)

A Framework for Human-Reason-Aligned Trajectory Evaluation in Automated Vehicles

Lucas Elbert Suryana, Saeed Rahmani, Simeon Craig Calvert, Arkady Zgonnikov, Bart van Arem

机构 * Department of Transport and Planning（交通与规划部门） ； Centre for Meaningful Human Control（有意义的人控中心） ； Delft University of Technology（代尔夫特理工大学） 纠错

专题命中 推理评测 ：planning(abstract)

Comments This version incorporates revisions based on peer-review feedback from a new submission. The work has been accepted and is being prepared for publication

SurgAnt-ViVQA: Learning to Anticipate Surgical Events through GRU-Driven Temporal Cross-Attention

Shreyas C. Dhake, Jiayuan Huang, Runlong He, Danyal Z. Khan, Evangelos B. Mazomenos, Sophia Bano, Hani J. Marcus, Danail Stoyanov, Matthew J. Clarkson, Mobarak I. Hoque

机构 * UCL Hawkes Institute（UCL哈维斯研究所） ； University College London（伦敦大学学院） ； Dept of Medical Physics & Biomedical Engineering（医学物理与生物医学工程系） ； UCL（伦敦大学学院） ； Dept of Computer Science（计算机科学系） ； National Hospital for Neurology and Neurosurgery（神经病学与神经外科国家医院） ； Division of Informatics, Imaging and Data Science（信息学、成像与数据科学 division） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 12 pages

ChartAB: A Benchmark for Chart Grounding & Dense Alignment

Aniruddh Bansal, Davit Soselia, Dang Nguyen, Tianyi Zhou

机构 * University of Maryland, College Park（马里兰大学学院公园分校） 纠错

专题命中 推理评测 ：reasoning(abstract)

A Comprehensive Empirical Evaluation of Agent Frameworks on Code-centric Software Engineering Tasks

Zhuowen Yin, Cuifeng Gao, Chunsong Fan, Wenzhang Yang, Yinxing Xue, Lijun Zhang

专题命中 推理评测 ：reasoning(abstract)

A Cloud-Based Spatio-Temporal GNN-Transformer Hybrid Model for Traffic Flow Forecasting with External Feature Integration

Zhuo Zheng, Lingran Meng, Ziyu Lin

专题命中 推理评测 ：planning(abstract)

TRUST-VL: An Explainable News Assistant for General Multimodal Misinformation Detection

Zehong Yan, Peng Qi, Wynne Hsu, Mong Li Lee

专题命中 推理评测 ：reasoning(abstract)

Comments EMNLP 2025 Oral; Project Homepage: https://yanzehong.github.io/trust-vl/

LLM-as-a-Judge for Software Engineering: Literature Review, Vision, and the Road Ahead

Junda He, Jieke Shi, Terry Yue Zhuo, Christoph Treude, Jiamou Sun, Zhenchang Xing, Xiaoning Du, David Lo

专题命中 推理评测 ：reasoning(abstract)

CPathAgent: An Agent-based Foundation Model for Interpretable High-Resolution Pathology Image Analysis Mimicking Pathologists' Diagnostic Logic

Yuxuan Sun, Yixuan Si, Chenglu Zhu, Kai Zhang, Zhongyi Shui, Bowen Ding, Tao Lin, Lin Yang

机构 * College of Computer Science and Technology, Zhejiang University, China（浙江大学计算机科学与技术学院） ； Research Center for Industries of the Future and School of Engineering, Westlake University, China（未来产业研究中心和西湖大学工程学院） ； Department of Computer Science and Engineering, The Ohio State University, USA（俄亥俄州立大学计算机科学与工程系） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments 52 pages, 34 figures

3D-RAD: A Comprehensive 3D Radiology Med-VQA Dataset with Multi-Temporal Analysis and Diverse Diagnostic Tasks

Xiaotang Gai, Jiaxiang Liu, Yichen Li, Zijie Meng, Jian Wu, Zuozhu Liu

机构 * ZJU-Angelalign R&D Center for Intelligence Healthcare（浙江大学智能医疗研发中心） ； Zhejiang University（浙江大学） ； Zhejiang Key Laboratory of Medical Imaging Artificial Intelligence（浙江省医学影像人工智能重点实验室） ； Guangdong Institute of Intelligence Science and Technology（广东省智能科学与技术研究院） 纠错

专题命中 推理评测 ：reasoning(abstract)

Comments Accepted by NeurIPS 2025