AutoBag:学习打开塑料袋并插入物品
AutoBag: Learning to Open Plastic Bags and Insert Objects
摘要:
薄塑料袋在零售商店、医疗保健、食品处理、回收、家庭和学校午餐室中无处不在。它们对于感知(由于镜面反射和遮挡)和操纵(由于其3D可变形结构的动力学)都具有挑战性。我们制定的任务“装袋:”操纵普通的塑料购物袋,从一个非结构化的初始状态到一个开放的状态,其中至少有一个固体物体可以插入袋和解除运输两个处理。我们提出了一个自监督学习框架,双臂机器人学习识别的处理和边缘的塑料袋使用紫外线荧光标记,在执行时,机器人不使用紫外线标记或紫外线灯。我们提出了AutoBag算法,机器人使用学习的感知模型通过迭代操作打开塑料袋。我们提出了新的指标,以评估袋状态和新的运动原语的质量重新定向和打开袋的基础上视觉观察。在物理实验中,使用AutoBag的YuMi机器人能够打开袋子,并且在各种初始袋子配置中插入至少一个物品的成功率为16/30。补充材料可在https://sites.google.com/view/autobag上查阅。
英文摘要:
Thin plastic bags are ubiquitous in retail stores, healthcare, food handling, recycling, homes, and school lunchrooms. They are challenging both for perception (due to specularities and occlusions) and for manipulation (due to the dynamics of their 3D deformable structure). We formulate the task of "bagging:" manipulating common plastic shopping bags with two handles from an unstructured initial state to an open state where at least one solid object can be inserted into the bag and lifted for transport. We propose a self-supervised learning framework where a dual-arm robot learns to recognize the handles and rim of plastic bags using UV-fluorescent markings; at execution time, the robot does not use UV markings or UV light. We propose the AutoBag algorithm, where the robot uses the learned perception model to open a plastic bag through iterative manipulation. We present novel metrics to evaluate the quality of a bag state and new motion primitives for reorienting and opening bags based on visual observations. In physical experiments, a YuMi robot using AutoBag is able to open bags and achieve a success rate of 16/30 for inserting at least one item across a variety of initial bag configurations. Supplementary material is available at https://sites.google.com/view/autobag.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。