Video multimodal large language models (MLLMs) have made rapid progress in general and long-form video understanding, yet their ability to capture and use brief, answer-critical visual evidence remains underexplored. Momentary actions or state transitions may determine an answer while occupying only a small fraction of the video. Performance on broad video understanding tasks alone does not establish whether models can reliably identify and use this temporally localized evidence. We introduce Moment-Video, a benchmark for evaluating temporal fidelity through momentary visual event understanding. Questions are constructed around visually observable events or event sequences, requiring models to notice, count, describe, or reason about transient evidence. The benchmark contains 1,000 human-verified video-QA pairs across seven domains and 25 subcategories, covering four tasks: Temporal Occurrence, Temporal Counting, Action Description, and Temporal Reasoning. We evaluate 34 proprietary and open-source MLLMs. Under the main evaluation settings, the best-performing model, Seed-2.0-Pro, achieves 39.6% overall accuracy, while most open-source models remain below 25%. Diagnostic analyses show that denser frame sampling improves some models, but substantial errors persist even when sampled frames cover all annotated necessary event intervals in an audited subset. Performance also declines on longer videos, suggesting additional temporal-localization challenges. By exposing these limitations, Moment-Video provides a diagnostic benchmark to guide the evaluation and development of video MLLMs that more reliably understand brief, answer-critical visual events.
ClinHallu: A Benchmark for Diagnosing Stage-Wise Hallucinations in Medical MLLM Reasoning
The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州));DAMO Academy, Alibaba Group(阿里巴巴达摩院);Hupan Lab(湖畔实验室);Zhejiang University(浙江大学)
Diagnosing Shoulder Disorders Using Multimodal Large Language Models and Consumer-Grade Cameras
Bytedance(字节跳动);Peking University(北京大学);Peking University People’s Hospital(北京大学人民医院);Mohamed bin Zayed University of Artificial Intelligence(穆罕默德·本·扎耶德人工智能大学);The Chinese University of Hong Kong(香港中文大学)
State Beyond Appearance: Diagnosing and Improving State Consistency in Dial-Based Measurement Reading
Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(未来区块链与隐私计算北京先进创新中心);Beihang University(北航);Fudan University(复旦大学);Peking University(北京大学)
SSMNBench: Diagnosing Image-based Cross-View Human-Object Understanding via Single-View Sufficiency and Multi-View Necessity
The University of Queensland(昆士兰大学);Australian Institute for Machine Learning, Adelaide University(阿德莱德大学澳大利亚机器学习研究所);University of Technology Sydney(悉尼科技大学);Follow Me AI Pty LTD(Follow Me AI有限公司)
OmniBrainBench: A Comprehensive Multimodal Benchmark for Brain Imaging Analysis Across Multi-stage Clinical Tasks
Chinese University of Hong Kong(香港中文大学);Sun Yat-sen Memorial Hospital, Sun Yat-sen University(中山大学孙逸仙纪念医院);Southern Medical University(南方医科大学);Zhongshan Hospital, Fudan University(复旦大学中山医院);Department of Neurosurgery, Prince of Wales Hospital(威尔士王室医院神经外科部)
Diagnosing Knowledge Conflict in Multimodal Long-Chain Reasoning
Huazhong University of Science and Technology(华中科技大学);Nanyang Technological University(南洋理工大学);Beijing University of Posts and Telecommunications(北京邮电大学);Renmin University of China(中国人民大学)
Can MLLMs Read Students' Minds? Unpacking Multimodal Error Analysis in Handwritten Math
Lehigh University(里海大学);Squirrel Ai Learning(松鼠AI学习);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);Michigan State University(密歇根州立大学)
EndoBench: A Comprehensive Evaluation of Multi-Modal Large Language Models for Endoscopy Analysis
Chinese University of Hong Kong(中国香港大学);City University of Hong Kong(香港城市大学);University of Oxford(牛津大学);Shanghai AI Laboratory(上海人工智能实验室);The Sixth Affiliated Hospital, Sun Yat-sen University(中山大学第六附属医院)
ERGeoBench:A Comprehensive Benchmark for Embodied Reasoning and Geo-localization in Multimodal Large Language Models
Beijing University of Posts and Telecommunications(北京邮电大学);State Key Laboratory of Networking and Switching Technology(网络与交换技术国家重点实验室);School of Materials Science and Engineering(材料科学与工程学院);China Mobile Research Institute(中国移动研究院);College of Computing and Data Science(计算与数据科学学院)
Understanding the Role of Hallucination in Reinforcement Post-Training of Multimodal Reasoning Models
University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of Science and Technology of China(中国科学技术大学);Arizona State University(亚利桑那州立大学);Honda Research Institute, USA(本田美国研究所)