WorldPlanner: Monte Carlo Tree Search and MPC with Action-Conditioned Visual World Models
Center for Robotics and Embodied Intelligence, Tandon School of Engineering, New York University, Brooklyn, NY(机器人与具身智能中心,工程学院,纽约大学,布鲁克林,纽约);FAIR at Meta(Meta的FAIR)
R. Khorrambakht, Joaquim Ortiz-Haro, Joseph Amigo, Omar Mostafa, Daniel Dugas, Franziska Meier, Ludovic Righetti
Robots must understand their environment from raw sensory inputs and reason about the consequences of their actions in it to solve complex tasks. Behavior Cloning (BC) leverages task-specific human demonstrations to learn this knowledge as end-to-end policies. However, these policies are difficult to transfer to new tasks, and generating training data is challenging because it requires careful demonstrations and frequent environment resets. In contrast to such policy-based view, in this paper we take a model-based approach where we collect a few hours of unstructured easy-to-collect play data to learn an action-conditioned visual world model, a diffusion-based action sampler, and optionally a reward model. The world model -- in combination with the action sampler and a reward model -- is then used to optimize long sequences of actions with a Monte Carlo Tree Search (MCTS) planner. The resulting plans are executed on the robot via a zeroth-order Model Predictive Controller (MPC). We show that the action sampler mitigates hallucinations of the world model during planning and validate our approach on 3 real-world robotic tasks with varying levels of planning and modeling complexity. Our experiments support the hypothesis that planning leads to a significant improvement over BC baselines on a standard manipulation test environment.
Slot-MPC: Goal-Conditioned Model Predictive Control with Object-Centric Representations
Autonomous Intelligent Systems(自主智能系统);Computer Science Institute VI(计算机科学研究所VI);Intelligent Systems and Robotics(智能系统与机器人);Center for Robotics(机器人中心);Lamarr Institute for Machine Learning and Artificial Intelligence(拉马尔人工智能学习与智能研究所);University of Bonn, Germany(波恩大学,德国)
Department of Mechanical Engineering and Materials Science, Duke University(机械工程与材料科学系,杜克大学);Department of Electrical and Computer Engineering, Duke University(电气与计算机工程系,杜克大学);Department of Computer Science, Duke University(计算机科学系,杜克大学)
Effective Online 3D Bin Packing with Lookahead Parcels Using Monte Carlo Tree Search
Key Lab of High Confidence Software Technologies (Peking University), Ministry of Education China(高可信软件技术重点实验室(北京大学));Faculty of Computing, Harbin Institute of Technology, Harbin, China(计算机学院,哈尔滨工业大学,哈尔滨,中国);JD Logistic, Beijing, China(京东物流,北京,中国);School of Computer Science, Peking University, Beijing, China(计算机科学学院,北京大学,北京,中国)
Optimal-Horizon Social Robot Navigation in Heterogeneous Crowds
National Key Laboratory of Human-Machine Hybrid Augmented Intelligence(人机混合增强智能国家重点实验室);Nation Engineering Research Center for Visual Information and Applications(视觉信息与应用国家工程研究中心);Institute of Artificial Intelligence and Robotics(人工智能与机器人研究所);Xi’an Jiaotong University(西安交通大学)
Vision-Language Model Predictive Control for Manipulation Planning and Trajectory Generation
School of Control Science and Engineering, Shandong University(山东大学控制科学与工程学院);Department of Computer Science, The University of Manchester(曼彻斯特大学计算机科学系)
Dynamic Risk-Aware MPPI for Mobile Robots in Crowds via Efficient Monte Carlo Approximations
Cognitive Robotics Department, TU Delft(代尔夫特理工大学认知机器人部门);Damen Naval(达门海军);Centre for Intelligent Transport, Queen Mary University of London(伦敦大学玛丽女王学院智能交通中心)