Object packing by autonomous robots is an im-portant challenge in warehouses and logistics industry. Most conventional data-driven packing planning approaches focus on regular cuboid packing, which are usually heuristic and limit the practical use in realistic applications with everyday objects. In this paper, we propose a deep hierarchical reinforcement learning approach to simultaneously plan packing sequence and placement for irregular object packing. Specifically, the top manager network infers packing sequence from six principal view heightmaps of all objects, and then the bottom worker network receives heightmaps of the next object to predict the placement position and orientation. The two networks are trained hierarchically in a self-supervised Q-Learning framework, where the rewards are provided by the packing results based on the top height , object volume and placement stability in the box. The framework repeats sequence and placement planning iteratively until all objects have been packed into the box or no space is remained for unpacked items. We compare our approach with existing robotic packing methods for irregular objects in a physics simulator. Experiments show that our approach can pack more objects with less time cost than the state-of-the-art packing methods of irregular objects. We also implement our packing plan with a robotic manipulator to show the generalization ability in the real world.
Deliberate Planning of 3D Bin Packing on Packing Configuration Trees
National University of Defense Technology, China(国防科技大学);Wuhan University, China(武汉大学);Shenzhen University, China(深圳大学);Xiangjiang Laboratory, China(湘江实验室)
Robotic Manipulation Framework Based on Semantic Keypoints for Packing Shoes of Different Sizes, Shapes, and Softness
College of Mechanical and Electrical Engineering, Nanjing University of Aeronautics and Astronautics(机械与电子工程学院,南京航空航天大学);State Key Laboratory of Internet of Things for Smart City(智能城市物联网国家重点实验室);Department of Electromechanical Engineering, University of Macau(机电工程系,澳门大学)
Benchmarking Classical Coverage Path Planning Heuristics on Irregular Hexagonal Grids for Maritime Coverage Scenarios
Facultad de Ingeniería y Ciencias, Universidad Adolfo Ibáñez(工程与科学学院,阿道弗·伊巴涅斯大学);Dirección de Programas, Investigación y Desarrollo, Armada de Chile(智利海军计划、研究与开发 Directorate);Millennium Nucleus for Social Data Science (SODAS)(社会科学数据科学千年核基金(SODAS));Millennium Nucleus in Data Science for Plant Resilience (PhytoLearning)(植物韧性数据科学千年核基金(PhytoLearning))
HERB: Human-augmented Efficient Reinforcement learning for Bin-packing
BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy, and with the Department of Excellence in Robotics and AI, Scuola Superiore Sant’Anna, Pisa, Italy(生物机器人研究所,圣安娜高等学院,意大利比萨,以及与机器人与人工智能卓越部门,圣安娜高等学院,意大利比萨);Institute for Systems and Robotics, Instituto Superior Técnico, Universidade de Lisboa(系统与机器人研究所,技术高等学院,里斯本大学)
OPA-Pack: Object-Property-Aware Robotic Bin Packing
Department of Computer Science and Engineering, the Chinese University of Hong Kong(计算机科学与工程系,香港中文大学);Hong Kong Centre for Logistics Robotics(香港物流机器人中心);School of Data Science, Lingnan University(数据科学学院,岭南大学);Department of Mechanical and Automation Engineering, the Chinese University of Hong Kong(机械与自动化工程系,香港中文大学)
Hierarchical generative modelling for autonomous robots
Intel Labs(英特尔实验室);University College London(伦敦大学学院);Wellcome Centre for Human Neuroimaging(惠康神经影像中心);Queen Square Institute of Neurology(皇后广场神经学研究所);UCL Robotics Institute(伦敦大学学院机器人研究所)