arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.18546cs.ROcs.AIcs.CV
收藏

杂乱场景中由热图引导的高效6自由度抓取检测

Efficient Heatmap-Guided 6-Dof Grasp Detection in Cluttered Scenes

Tsinghua University(清华大学);Shanghai AI Laboratory(上海人工智能实验室);Beijing National Research Center for Information Science and Technology (BNRist)(北京信息科学与技术国家研究中心)

Siang Chen, Wei Tang, Pengwei Xie, Wenming Yang, Guijin Wang

AI总结:

针对杂乱场景下6自由度抓取生成质量与实时性受限的问题,提出以抓取热图为引导的全局到局部式高效抓取检测框架,结合非均匀锚点采样,实现了实时高精度检测,在真实机器人实验中取得94%抓取成功率与100%杂乱完成率。

摘要:

在杂乱场景中实现快速、鲁棒的物体抓取是机器人技术的关键组成部分。当前大多数研究采用完整的观测点云生成6自由度抓取位姿,忽略了从全局语义中挖掘的引导信息,因此限制了高质量抓取的生成以及实时性能。在本研究中,我们发现常用的热图在6自由度抓取生成的效率方面被低估了。因此,我们提出了一种结合抓取热图作为引导的有效局部抓取生成器,它以“全局到局部、语义到点”的方式进行推理。具体而言,我们采用高斯编码和基于网格的策略来预测抓取热图作为引导,将局部点聚合到可抓取区域中,并提供全局语义信息。此外,我们设计了一种新颖的非均匀锚点采样机制,以提高抓取的准确性和多样性。得益于图像空间中的高效编码,以及仅聚焦于局部可抓取区域内的点,我们的框架能够实时执行高质量的抓取检测,并取得了当前最优的结果。此外,真实机器人实验证明了我们方法的有效性,抓取成功率达94%,杂乱场景完成率达100%。我们的代码可在https://github.com/THU-VCLab/HGGD获取。

英文摘要:

Fast and robust object grasping in clutter is a crucial component of robotics. Most current works resort to the whole observed point cloud for 6-Dof grasp generation, ignoring the guidance information excavated from global semantics, thus limiting high-quality grasp generation and real-time performance. In this work, we show that the widely used heatmaps are underestimated in the efficiency of 6-Dof grasp generation. Therefore, we propose an effective local grasp generator combined with grasp heatmaps as guidance, which infers in a global-to-local semantic-to-point way. Specifically, Gaussian encoding and the grid-based strategy are applied to predict grasp heatmaps as guidance to aggregate local points into graspable regions and provide global semantic information. Further, a novel non-uniform anchor sampling mechanism is designed to improve grasp accuracy and diversity. Benefiting from the high-efficiency encoding in the image space and focusing on points in local graspable regions, our framework can perform high-quality grasp detection in real-time and achieve state-of-the-art results. In addition, real robot experiments demonstrate the effectiveness of our method with a success rate of 94% and a clutter completion rate of 100%. Our code is available at https://github.com/THU-VCLab/HGGD.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑