In this work, we introduce SPLICE, a human-curated benchmark derived from the COIN instructional video dataset, designed to probe event-based reasoning across multiple dimensions: temporal, causal, spatial, contextual, and general knowledge. SPLICE includes 3,381 human-filtered videos spanning 12 categories and 180 sub-categories, such as sports, engineering, and housework. These videos are segmented into a total of 11,423 event clips. We evaluate both human participants and state-of-the-art vision-language models (VLMs) on the task of rearranging these clips into coherent event sequences to assess visual reasoning capabilities. Results reveal a significant gap: VLMs struggle to match human performance. While human-annotated textual descriptions improve model accuracy, they do not affect human performance, suggesting that models rely more on language priors than on visual understanding. Even with annotations, VLMs fall short of human-level reasoning, underscoring persistent challenges in visual reasoning. A deeper analysis across sub-categories shows that VLMs perform relatively better on videos where temporal and causal reasoning are dominant, compared to those where contextual and spatial reasoning are dominant. They also perform better on everyday tasks than on specialized ones.
DynaSolidGeo: A Dynamic Benchmark for Genuine Spatial Mathematical Reasoning of VLMs in Solid Geometry
East China Normal University（华东师范大学）；Zhongguancun Academy（中关村学院）；Huazhong University of Science and Technology（华中科技大学）；Peking University（北京大学）；Zhengzhou University（郑州大学）；Zhongguancun Institute of Artificial Intelligence（中关村人工智能研究院）
VideoASMR-Bench: Can AI-Generated ASMR Videos Fool VLMs and Humans?
The Chinese University of Hong Kong（香港中文大学）；National University of Singapore（新加坡国立大学）；Peking University（北京大学）；Monash University（墨尔本大学）；Video Rebirth；University of Oxford（牛津大学）
Gold Points Sniper: Self-guided Visual Reasoning in VLM for Fine-grained Action Understanding
Beijing National Research Center for Information Science and Technology (BNRist), Department of Automation, Tsinghua University（清华大学自动化系北京信息科学与技术国家研究中心）；State Key Laboratory of General Artificial Intelligence, Beijing Institute for General Artificial Intelligence (BIGAI)（北京通用人工智能研究院通用人工智能国家重点实验室）
CogRail: Benchmarking VLMs in Cognitive Intrusion Perception for Intelligent Railway Transportation Systems
State Key Laboratory of Multimodal Artificial Intelligence Systems, Institute of Automation, Chinese Academy of Sciences（多模态人工智能系统国家重点实验室，自动化研究所，中国科学院）；School of Automation, Beijing Institute of Technology（自动化学院，北京理工大学）；Signal & Communication Research Institute, China Academy of Railway Sciences（信号与通信研究所，中国铁路科学研究院）；Beijing Huairou Academy of Parallel Sensing（北京怀柔平行感知院）；School of Computer Science and Technology, Beijing Jiaotong University（计算机科学与技术学院，北京交通大学）；State Key Lab of Intelligent Transportation Systems, School of Transportation Science and Engineering, Beihang University（智能交通系统国家重点实验室，交通科学与工程学院，北京航空航天大学）
Teaching VLMs to Localize Specific Objects from In-context Examples
IBM Research（IBM研究院）；Weizmann Institute of Science（魏茨曼科学研究所）；Tel Aviv University（特拉维夫大学）；JKU Linz（林茨约翰内斯·开普勒大学）；Tuebingen AI Center（蒂宾根人工智能中心）；MIT-IBM（麻省理工学院-IBM联合机构）；MIT CSAIL（麻省理工学院计算机科学与人工智能实验室）
3D Modality-Aware Pre-training for Vision-Language Model in MRI Multi-organ Abnormality Detection
School of Electronic, Electrical Engineering and Physics, Fujian University of Technology（福建工程学院电子电气工程学院）；School of Computer Science and Engineering, Southeast University, China（东南大学计算机科学与工程学院）；Department of Medical Imaging, Suzhou Traditional Chinese Medicine Hospital, China（苏州中医医院影像科）
Many Dialects, Many Languages, One Cultural Lens: Evaluating Multilingual VLMs for Bengali Culture Understanding Across Historically Linked Languages and Regional Dialects
United International University（国际联合大学）；BRAC University（布拉塔克大学）；University of Maryland, Baltimore County（马里兰大学巴尔的摩县分校）
Evaluating Vision-Language Models as a Zero-Shot Learning Alternative to You Only Look Once and Optical Character Recognition for Nigerian License Plate Recognition
Ahmadu Bello University（艾哈迈杜·贝罗大学）；Bayero University Kano（卡诺贝罗大学）
