Generalist robot manipulation policies have advanced rapidly, yet existing benchmarks remain limited in systematically evaluating their capabilities. Many rely on simple, short-horizon, or skill-narrow tasks with limited capability coverage, and are often conducted only in simulation or only in the real world. Simulation enables scalable feedback but misses physical deployment challenges, while real-world evaluation is costly, time-consuming, and difficult to reproduce. We introduce RoboDojo, a unified sim-and-real benchmark for comprehensive evaluation of generalist robot manipulation policies. RoboDojo includes 42 simulation tasks and 18 real-world tasks covering diverse and complementary manipulation capabilities. The simulation benchmark evaluates five dimensions: generalization, memory, precision, long-horizon execution, and open-vocabulary instruction following, while the real-world benchmark exposes policies to challenging physical-world deployment conditions. RoboDojo supports scalable evaluation through heterogeneous parallel simulation in Isaac Sim and provides RoboDojo-RealEval, a reproducible real-world evaluation system with remote cloud access, standardized hardware, scene reset, evaluation protocol, and deployment interface. Together with XPolicyLab, policies can be integrated once and evaluated across simulation and real-world settings with minimal adaptation. We integrate 30 policies into XPolicyLab and evaluate them on RoboDojo, establishing a public leaderboard and systematic analysis of current policy performance. The website is available at http://robodojo-benchmark.com/.
An Unexpected Robot Policy: Early Evaluations of GPT-6 Astra on RoboDojo and Beyond
RoboProbe;RoboDojo;The University of Hong Kong(香港大学);Tsinghua University(清华大学);University of California, Berkeley(加州大学伯克利分校);Princeton University(普林斯顿大学);Massachusetts Institute of Technology(麻省理工学院);Peking University(北京大学)
EBench: Elemental Diagnosis of Generalist Mobile Manipulation Policies
Shanghai AI Laboratory(上海人工智能实验室);Xi’an Jiaotong University(西安交通大学);Institute for AI Industry Research (AIR), Tsinghua University(清华大学智能产业研究院);Tsinghua University(清华大学);University of Science and Technology of China(中国科学技术大学);Shanghai Jiao Tong University(上海交通大学);Zhejiang University(浙江大学)
Effective Tuning Strategies for Generalist Robot Manipulation Policies
University of Adelaide(阿德莱德大学);Commonwealth Scientific and Industrial Research Organisation (CSIRO)(联邦科学与工业研究组织(CSIRO));Shanghai Jiao Tong University(上海交通大学);TikTok
ReFineVLA: Multimodal Reasoning-Aware Generalist Robotic Policies via Teacher-Guided Fine-Tuning
VinRobotics;University of Texas at Arlington(德克萨斯大学阿灵顿分校);Max Planck Research School for Intelligent Systems (IMPRS-IS)(智能系统Max Planck研究学校);Intelligent Autonomous Systems Lab(智能自主系统实验室);TU Darmstadt(德累斯顿技术大学);Automation & Control Institute(自动化与控制研究所);TU Wien(维也纳技术大学);Austrian Institute of Technology (AIT)(奥地利技术研究所)
Toward Generalist Neural Motion Planners for Robotic Manipulators: Challenges and Opportunities
J. Mike Walker ’66 Department of Mechanical Engineering, Texas A&M University(J. Mike Walker ’66 机械工程系,德克萨斯A&M大学);Lab of Biomechatronics and Intelligent Robotics, Department of Biomedical Engineering, Tandon School of Engineering, New York University(生物机械与智能机器人实验室,生物医学工程系,Tandon工程学院,纽约大学);Department of Computer Science, Columbia University(计算机科学系,哥伦比亚大学);Zachry Department of Civil and Environmental Engineering, Texas A&M University(土木与环境工程系,德克萨斯A&M大学)
OXE-AugE: A Large-Scale Robot Augmentation of OXE for Scaling Cross-Embodiment Policy Learning
Department of EECS, UC Berkeley(电子工程与计算机科学系,加州大学伯克利分校);GRASP Laboratory, University of Pennsylvania(格拉斯实验室,宾夕法尼亚大学);Department of CS, UT Austin(计算机科学系,得克萨斯大学奥斯汀分校)
Atomic Action Slicing: Planner-Aligned Options for Generalist VLA Agents
Sofia University 'St. Kliment Ohridski(索菲亚大学 '圣克莱门特·欧里基斯基');Technical University of Sofia(索菲亚技术大学);EEMCS, University of Twente(EEMCS,特文特大学);GATE Institute, Sofia University 'St. Kliment Ohridski(GATE研究所,索菲亚大学 '圣克莱门特·欧里基斯基')
LIBERO-Industry: Benchmarking Robotic Manipulation under Industrial Process Constraints
Institute of AI for Engineering, Tongji University(同济大学工程人工智能研究院);The Chinese University of Hong Kong(香港中文大学);University of Aberdeen(阿伯丁大学);University of Cambridge(剑桥大学)
LAPT-Scale: Scaling Embodied Policies with Latent Action Pre-Training on Human Videos
Joy Future Academy, JD(京东探索研究院);School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen(哈尔滨工业大学(深圳)计算机科学与技术学院);Tsinghua SIGS, Tsinghua University(清华大学深圳国际研究生院);Artificial Intelligence, The Hong Kong University of Science and Technology (Guangzhou)(香港科技大学(广州)人工智能学院)