Multi-goal policy learning for robotic manipulation is challenging. Prior successes have used state-based representations of the objects or provided demonstration data to facilitate learning. In this paper, by hand-coding a high-level discrete representation of the domain, we show that policies to reach dozens of goals can be learned with a single network using Q-learning from pixels. The agent focuses learning on simpler, local policies which are sequenced together by planning in the abstract space. We compare our method against standard multi-goal RL baselines, as well as other methods that leverage the discrete representation, on a challenging block construction domain. We find that our method can build more than a hundred different block structures, and demonstrate forward transfer to structures with novel objects. Lastly, we deploy the policy learned in simulation on a real robot.
AM-Bench: A Modular Simulation Suite and Benchmark for Aerial Manipulation Policy Learning
The Robotics Institute, School of Computer Science, Carnegie Mellon University(卡内基梅隆大学计算机学院机器人研究所);Department of Aerospace Engineering, Pennsylvania State University(宾夕法尼亚州立大学航空航天工程系);School of Mechanical Engineering, Kyung Hee University(庆熙大学机械工程学院)
Learning a Skill-sequence-dependent Policy for Long-horizon Manipulation Tasks
Xi’an Jiaotong-Liverpool University(西交利物浦大学);The Chinese University of Hong Kong (Shenzhen)(香港中文大学(深圳));Shenzhen Institute of Artificial Intelligence and Robotics for Society(深圳人工智能与机器人研究院)
FoAM: Foresight-Augmented Multi-Task Imitation Policy for Robotic Manipulation
University of Southern California(南加州大学);Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, Shanghai Jiao Tong University(上海交通大学人工智能学院)
Reward-Based Environment States for Robot Manipulation Policy Learning
Engineering school UPSSITECH(UPSSITECH 工程学院);University of Toulouse III(图卢兹第三大学);IRIT, Paul Sabatier University(保罗·萨巴捷大学 IRIT 研究所);CNRS(法国国家科学研究中心);School of Computer Science(计算机科学学院);University of Lincoln(林肯大学)
L-SDPPO: Policy Optimization of Spiking Diffusion Policy for Intra-vehicular Robotic Manipulation
Department of Control Science and Engineering, Harbin Institute of Technology(控制科学与工程系,哈尔滨工业大学);Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong(机械与自动化工程系,香港中文大学)
Benchmarking Structured Policies and Policy Optimization for Real-World Dexterous Object Manipulation
Technical University of Darmstadt(达姆施塔特工业大学);University of Washington(华盛顿大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Cornell University(康奈尔大学);Toyota Technological Institute at Chicago(芝加哥丰田技术研究所)
Diffusion Stabilizer Policy for Automated Surgical Robot Manipulations
UM-SJTU Joint Intuitute(UM-SJTU联合学院);Shanghai Jiao Tong University(上海交通大学);Department of Computer Science and Engineering(计算机科学与工程系);The Chinese University of Hong Kong(香港中文大学);Department of Automation(自动化系)
Discrete Policy: Learning Disentangled Action Space for Multi-Task Robotic Manipulation
Syracuse University(雪城大学);Midea Group(美的集团);Shanghai University(上海大学);East China Normal University(华东师范大学);Beijing Innovation Center of Humanoid Robotics(北京人形机器人创新中心)
Tactile-Conditioned Diffusion Policy for Force-Aware Robotic Manipulation
Department of Computer Science, Technical University of Darmstadt(德累斯顿技术大学计算机科学系);German Research Center for AI (DFKI)(德国人工智能研究中心);Centre for Cognitive Science, Technical University of Darmstadt(德累斯顿技术大学认知科学中心);Hessian Center for Artificial Intelligence (Hessian.AI), Darmstadt(黑森人工智能中心(Hessian.AI));Robotics Institute Germany (RIG)(德国机器人研究所)
InCoM: Intent-Driven Perception and Structured Coordination for Mobile Manipulation
Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences(中国科学院大学先进交叉学科学院);AnyverseDynamics
AnyBimanual: Transferring Unimanual Policy for General Bimanual Manipulation
Tsinghua Shenzhen International Graduate School, Tsinghua University(清华大学深圳国际研究生院);School of Electrical and Electronic Engineering, Nanyang Technological University(南洋理工大学电气与电子工程学院)