arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2410.01702cs.RO

$\mathcal{D(R,O)}$ Grasp:面向跨本体灵巧抓取的机器人与物体交互统一表示

$\mathcal{D(R,O)}$ Grasp: A Unified Representation of Robot and Object Interaction for Cross-Embodiment Dexterous Grasping

National University of Singapore(新加坡国立大学);School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University(上海交通大学电子信息与电气工程学院);Zhiyuan College, Shanghai Jiao Tong University(上海交通大学致远学院)

Zhenyu Wei, Zhixuan Xu, Jingxiang Guo, Yiwen Hou, Chongkai Gao, Zhehao Cai, Jiayu Luo, Lin Shao

AI总结:

提出 $\mathcal{D(R,O)}$ Grasp 统一交互表示框架,由机器人手描述与物体点云预测稳定有效抓取,实现跨本体泛化,并在仿真和 LeapHand 真机中验证高成功率与快速推理。

摘要:

灵巧抓取是机器人操作中一项基础但具有挑战性的技能,需要机器人手与物体之间进行精确交互。本文提出 $\mathcal{D(R,O)}$ Grasp,这是一个新颖框架,用于对处于抓取姿态的机器人手与物体之间的交互进行建模,从而能够在多种机器人手和物体几何形状之间实现广泛泛化。我们的模型以机器人手的描述和物体点云作为输入,高效预测运动学有效且稳定的抓取,展示出对不同机器人本体和物体几何形状的强适应性。在仿真和真实世界环境中进行的大量实验验证了本方法的有效性:在多种机器人手上,其成功率、抓取多样性和推理速度均取得显著提升。在三种不同灵巧机器人手上测试时,本方法在仿真中于不到一秒内达到 87.53% 的平均成功率。在使用 LeapHand 的真实世界实验中,该方法同样取得 89% 的平均成功率。$\mathcal{D(R,O)}$ Grasp 为复杂多变环境中的灵巧抓取提供了鲁棒解决方案。代码、附录和视频可在项目网站 https://nus-lins-lab.github.io/drograspweb/ 获取。

英文摘要:

Dexterous grasping is a fundamental yet challenging skill in robotic manipulation, requiring precise interaction between robotic hands and objects. In this paper, we present $\mathcal{D(R,O)}$ Grasp, a novel framework that models the interaction between the robotic hand in its grasping pose and the object, enabling broad generalization across various robot hands and object geometries. Our model takes the robot hand's description and object point cloud as inputs and efficiently predicts kinematically valid and stable grasps, demonstrating strong adaptability to diverse robot embodiments and object geometries. Extensive experiments conducted in both simulated and real-world environments validate the effectiveness of our approach, with significant improvements in success rate, grasp diversity, and inference speed across multiple robotic hands. Our method achieves an average success rate of 87.53% in simulation in less than one second, tested across three different dexterous robotic hands. In real-world experiments using the LeapHand, the method also demonstrates an average success rate of 89%. $\mathcal{D(R,O)}$ Grasp provides a robust solution for dexterous grasping in complex and varied environments. The code, appendix, and videos are available on our project website at https://nus-lins-lab.github.io/drograspweb/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑