PhysicsMind: Sim and Real Mechanics Benchmarking for Physical Reasoning and Prediction in Foundational VLMs and World Models
Peking University(北京大学);Mohamed bin Zayed University of Artificial Intelligence(莫扎伊德大学人工智能学院);National University of Singapore(新加坡国立大学);University of North Carolina at Chapel Hill(北卡罗来纳大学教堂山分校);University of Science and Technology of China(中国科学技术大学);Cornell University(康奈尔大学);Hong Kong Polytechnic University(香港理工大学);City University of Hong Kong(香港城市大学)
Modern foundational Multimodal Large Language Models (MLLMs) and video world models have advanced significantly in mathematical, common-sense, and visual reasoning, but their grasp of the underlying physics remains underexplored. Existing benchmarks attempting to measure this matter rely on synthetic, Visual Question Answer templates or focus on perceptual video quality that is tangential to measuring how well the video abides by physical laws. To address this fragmentation, we introduce PhysicsMind, a unified benchmark with both real and simulation environments that evaluates law-consistent reasoning and generation over three canonical principles: Center of Mass, Lever Equilibrium, and Newton's First Law. PhysicsMind comprises two main tasks: i) VQA tasks, testing whether models can reason and determine physical quantities and values from images or short videos, and ii) Video Generation(VG) tasks, evaluating if predicted motion trajectories obey the same center-of-mass, torque, and inertial constraints as the ground truth. A broad range of recent models and video generation models is evaluated on PhysicsMind and found to rely on appearance heuristics while often violating basic mechanics. These gaps indicate that current scaling and training are still insufficient for robust physical understanding, underscoring PhysicsMind as a focused testbed for physics-aware multimodal models. Our data will be released upon acceptance.
LeafNet: A Large-Scale Dataset and Comprehensive Benchmark for Foundational Vision-Language Understanding of Plant Diseases
School of Electrical Engineering, Korea University(韩国大学电气工程学院);Department of Integrative Biology, The University of Texas at Austin(德克萨斯大学奥斯汀分校整合生物学系);Department of Software Engineering, FPT University(FPT大学软件工程系)
Optimization of Prompt Learning via Multi-Knowledge Representation for Vision-Language Models
School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院);Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所基础模型研究中心);Wuhan AI Research(武汉人工智能研究所);Peng Cheng Laboratory(鹏城实验室)
Evaluation of Cultural Competence of Vision-Language Models
Department of Computer Science, University of Copenhagen(计算机科学系,哥本哈根大学);Department of Rhetoric and Communication Studies, University of Richmond(修辞与传播研究系,里士满大学);Department of Data Science and Statistics, University of Richmond(数据科学与统计系,里士满大学);Google Research(谷歌研究);ILLC, University of Amsterdam(阿姆斯特丹大学ILLC中心);Pioneer Centre of AI, Denmark(丹麦先锋人工智能中心)
Zooming into Comics: Region-Aware RL Improves Fine-Grained Comic Understanding in Vision-Language Models
School of Computer and Communication Sciences, EPFL(瑞士联邦理工学院计算机与通信科学学院);Department of Computer Science and Engineering, Chalmers University of Technology(楚科奇技术大学计算机科学与工程系);IVRL, EPFL(EPFL智能机器人实验室)
Exploring the Frontier of Vision-Language Models: A Survey of Current Methodologies and Future Directions
Department of Computer Science and Engineering, IIT Patna, India(印度帕纳大学计算机科学与工程系);Stanford University(斯坦福大学);Amazon AI(亚马逊人工智能);Indian Institute of Technology Patna, India(印度帕纳大学)
Guided Prompt Evolution for Vision-Language Models Adaptation
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院,清华大学);Sun Yat-sen University(中山大学);Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
MultihopSpatial: Multi-hop Compositional Spatial Reasoning Benchmark for Vision-Language Model
Electronics and Telecommunications Research Institute, South Korea(韩国电信研究院);Korea Advanced Institute of Science and Technology, South Korea(韩国科学技术院);Sungkyunkwan University, South Korea(成均馆大学);DeepAuto, South Korea(DeepAuto)
InteractVLM: 3D Interaction Reasoning from 2D Foundational Models
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);University of Amsterdam (UvA)(阿姆斯特丹大学);Inria(法国国家信息与自动化研究所);École normale supérieure(巴黎高等师范学院);CNRS(法国国家科学研究中心);PSL Research University(巴黎文理研究大学)
Cognitive Science Program, University of California, Berkeley(加州大学伯克利分校认知科学项目);Department of Electrical and Computer Engineering, University of California San Diego(加州大学圣地亚哥分校电气与计算机工程系);School of Computer Science, Georgia Institute of Technology & Emory University(佐治亚理工学院计算机科学学院及埃默里大学);Department of Computer Science, Johns Hopkins University(约翰霍普金斯大学计算机科学系);Department of Cognitive Science, University of California San Diego(加州大学圣地亚哥分校认知科学系);Equal Advising Department of Computer Science & Wilmer Eye Institute, Johns Hopkins University(约翰霍普金斯大学计算机科学系及威尔默眼科研究所);Language Technologies Institute, Carnegie Mellon University(卡内基梅隆大学语言技术研究所);Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所);Weinberg Institute for Cognitive Science, University of Michigan(密歇根大学韦恩伯格认知科学研究所)
Peking University(北京大学);Hong Kong University of Science and Technology(香港科学与技术大学);Chinese University of Hong Kong(香港中文大学);University of California, Santa Barbara(加州大学圣芭芭拉分校)
Embodied4C: Measuring What Matters for Embodied Vision-Language Navigation
Karlsruhe Institute of Technology(卡尔斯鲁厄理工学院);UAS Esslingen(埃森嫩大学);TU Wien(维也纳技术大学);Dr. Ing. h.c. F. Porsche AG(保时捷股份有限公司);University of Michigan(密歇根大学);Voxel51 Inc.(Voxel51公司)
Specialized curricula for training vision-language models in retinal image analysis
Imperial College London(伦敦帝国学院);University of Southampton(南安普顿大学);Moorfields Eye Hospital NHS Foundation Trust(摩尔菲尔兹眼科医院NHS基金会信托);Medical University of Vienna(维也纳医科大学);Technical University of Munich(慕尼黑工业大学);Institute of Molecular and Clinical Ophthalmology Basel(巴塞尔分子与临床眼科研究所);University of Basel(巴塞尔大学)
RAICL: Retrieval-Augmented In-Context Learning for Vision-Language-Model Based EEG Seizure Detection
Ministry of Education Key Laboratory of Image Processing and Intelligent Control, School of Artificial Intelligence and Automation, Huazhong University of Science and Technology(教育部图像处理与智能控制重点实验室,人工智能与自动化学院,华中科技大学);State Key Laboratory of Brain Cognition and Brain-inspired Intelligence Technology, Institute of Automation, Chinese Academy of Sciences(脑认知与脑启发智能技术国家重点实验室,自动化研究所,中国科学院)
Investigating Zero-Shot Diagnostic Pathology in Vision-Language Models with Efficient Prompt Design
Department of Computer Science and Software Engineering (CSSE) Concordia University(计算机科学与软件工程系(CSSE)康科迪亚大学);University of Montreal Hospital Center(蒙特利尔大学医院中心);Mila–Quebec AI Institute(魁北克人工智能研究所)
Explain Before You Answer: A Survey on Compositional Visual Reasoning
Monash University(墨尔本大学);Stanford University(斯坦福大学);University of Washington(华盛顿大学);Griffith University(格里菲斯大学);Princeton University(普林斯顿大学);Allen Institute for Artificial Intelligence(人工智能研究院)
Videoprompter: an ensemble of foundational models for zero-shot video understanding
University of Central Florida(中佛罗里达大学);Mohamed bin Zayed University of AI(穆罕默德·本·扎耶德人工智能大学);Australian National University(澳大利亚国立大学);Linkoping University(林雪平大学)
LoMo: Local Modality Substitution for Deeper Vision-Language Fusion
Fudan University(复旦大学);Shanghai Innovation Institute(上海创新研究院);Shanghai Jiao Tong University(上海交通大学);University of Science and Technology of China(中国科学技术大学)
Vlaser: Vision-Language-Action Model with Synergistic Embodied Reasoning
University of Science and Technology of China(中国科学技术大学);Shanghai AI Laboratory(上海人工智能实验室);Shanghai Jiao Tong University(上海交通大学);Zhejiang University(浙江大学);Nanjing University(南京大学);Fudan University(复旦大学);Tsinghua University(清华大学);NUS(新加坡国立大学);Northeastern University(东北大学);Shenzhen University(深圳大学)