从人类演示中学习机器人对不规则物体的装箱顺序
Robotic Learning the Sequence of Packing Irregular Objects from Human Demonstrations
AI总结:
本文提出利用 VR 平台 BoxED 收集人类演示并训练马尔可夫模型,以预测不规则物体的类人装箱顺序,实验显示其预测比人类生成顺序更常被判定为类人。
摘要:
我们解决机器人对杂货等不规则物体进行箱内装载的挑战。鉴于这些物体具有多样的物理属性,并且支配其放置与操作的约束复杂,采用预编程策略变得不可行。我们的方法是直接从专家演示中学习,以提取隐含的任务知识和策略,从而确保物体安全定位、高效利用空间,并生成能够增强人机信任的类人行为。我们依靠人类演示学习一个 Markov chain(马尔可夫链),用于针对给定的一组物品预测物体装箱顺序,随后将其与人类表现进行比较。实验结果表明,该模型优于人类表现:它生成的顺序预测被人类归类为类人行为的频率,高于人类生成的顺序。人类演示是使用我们提出的 VR 平台 BoxED 收集的,该平台是一个箱体包装环境,用于模拟真实世界的物体和场景,以便为教授机器人而快速、顺畅地收集数据。我们收集了 43 名参与者的数据,他们使用类似超市物品共包装了 263 个箱子,产生 4644 次物体操作。我们的 VR 平台可以轻松适配新场景和新物体,并与数据集一起在 https://github.com/andrejfsantos4/BoxED 公开发布。
英文摘要:
We tackle the challenge of robotic bin packing with irregular objects, such as groceries. Given the diverse physical attributes of these objects and the complex constraints governing their placement and manipulation, employing preprogrammed strategies becomes unfeasible. Our approach is to learn directly from expert demonstrations in order to extract implicit task knowledge and strategies to ensure safe object positioning, efficient use of space, and the generation of human-like behaviors that enhance human-robot trust. We rely on human demonstrations to learn a Markov chain for predicting the object packing sequence for a given set of items and then compare it with human performance. Our experimental results show that the model outperforms human performance by generating sequence predictions that humans classify as human-like more frequently than human-generated sequences. The human demonstrations were collected using our proposed VR platform, BoxED, which is a box packaging environment for simulating real-world objects and scenarios for fast and streamlined data collection with the purpose of teaching robots. We collected data from 43 participants packing a total of 263 boxes with supermarket-like objects, yielding 4644 object manipulations. Our VR platform can be easily adapted to new scenarios and objects, and is publicly available, alongside our dataset, at https://github.com/andrejfsantos4/BoxED.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。