Vision-Language-Action (VLA) models convert high-level language instructions into concrete, executable actions, a task that is especially challenging in open-world environments. We present Visual Foresight Planning (ForeAct), a general and efficient planner that guides a VLA step-by-step using imagined future observations and subtask descriptions. With an imagined future observation, the VLA can focus on visuo-motor inference rather than high-level semantic reasoning, leading to improved accuracy and generalization. Our planner comprises a highly efficient foresight image generation module that predicts a high-quality 640$\times$480 future observation from the current visual input and language instruction within only 0.33s on an H100 GPU, together with a vision-language model that reasons over the task and produces subtask descriptions for both the generator and the VLA. Importantly, state-of-the-art VLAs can integrate our planner seamlessly by simply augmenting their visual inputs, without any architectural modification. The foresight generator is pretrained on over 1 million multi-task, cross-embodiment episodes, enabling it to learn robust embodied dynamics. We evaluate our framework on a benchmark that consists of 11 diverse, multi-step real-world tasks. It achieves an average success rate of 87.4%, demonstrating a +40.9% absolute improvement over the $π_0$ baseline (46.5%) and a +30.3% absolute improvement over $π_0$ augmented with textual subtask guidance (57.1%).
ForesightSafety-VLA: A Unified Diagnostic Safety Benchmark for Vision-Language-Action Models
Brain-inspired Cognitive AI Lab, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所类脑认知智能实验室);Beijing Key Laboratory of Safe AI and Superalignment(北京市安全人工智能与超级对齐重点实验室);Beijing Institute of AI Safety and Governance(北京人工智能安全与治理研究所);Gaoling School of AI, Renmin University of China(中国人民大学高瓴人工智能学院);University of Chinese Academy of Sciences (UCAS)(中国科学院大学)
Learning Vision-Language-Action World Models for Autonomous Driving
MoE Key Lab of Artificial Intelligence, AI Institute, Shanghai Jiao Tong University(上海交通大学人工智能研究院教育部人工智能重点实验室);Central Research Institute, Huawei(华为中央研究院)
LaWAM: Latent World Action Models for Efficient Dynamics-Aware Robot Policies
Tsinghua University(清华大学);Jilin University(吉林大学);Nankai University(南开大学);Peking University(北京大学);Harbin Institute of Technology(哈尔滨工业大学);Zhongguancun Academy(中关村学院);Striding.AI;Infinigence AI