Solving real-world manipulation tasks requires robots to have a repertoire of skills applicable to a wide range of circumstances. When using learning-based methods to acquire such skills, the key challenge is to obtain training data that covers diverse and feasible variations of the task, which often requires non-trivial manual labor and domain knowledge. In this work, we introduce Active Task Randomization (ATR), an approach that learns robust skills through the unsupervised generation of training tasks. ATR selects suitable tasks, which consist of an initial environment state and manipulation goal, for learning robust skills by balancing the diversity and feasibility of the tasks. We propose to predict task diversity and feasibility by jointly learning a compact task representation. The selected tasks are then procedurally generated in simulation using graph-based parameterization. The active selection of these training tasks enables skill policies trained with our framework to robustly handle a diverse range of objects and arrangements at test time. We demonstrate that the learned skills can be composed by a task planner to solve unseen sequential manipulation problems based on visual inputs. Compared to baseline methods, ATR can achieve superior success rates in single-step and sequential manipulation tasks.
RPG: Robust Policy Gating for Smooth Multi-Skill Transitions in Humanoid Fighting
Center for Artificial Intelligence and Robotics, Shenzhen International Graduate School, Tsinghua University(人工智能与机器人中心,深圳国际研究生院,清华大学);Shanghai AI Laboratory(上海人工智能实验室);Northwestern Polytechnical University(西北工业大学);Shanghai Jiao Tong University(上海交通大学)
Diff-Transfer: Model-based Robotic Manipulation Skill Transfer via Differentiable Physics Simulation
Nanjing University(南京大学);National University of Singapore(新加坡国立大学);University of Science and Technology of China(中国科学技术大学);University of California, Berkeley(加州大学伯克利分校);Carnegie Mellon University(卡内基梅隆大学)
PIN-WM: Learning Physics-INformed World Models for Non-Prehensile Manipulation
National University of Defense Technology(国防科技大学);Wuhan University(武汉大学);Shenzhen University(深圳大学);Guangdong Laboratory of Artificial Intelligence and Digital Economy(广东人工智能与数字经济实验室)
From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation
Nanyang Technological University(南洋理工大学);Tongji University(同济大学);Shanghai Institute of Intelligent Science and Technology(上海自主智能无人系统科学中心);Beihang University(北京航空航天大学);VinUniversity