arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.08065cs.RO
收藏

基于四足机器人前腿的动态物体捕捉

Dynamic Object Catching with Quadruped Robot Front Legs

Ecole Polytechnique Federale de Lausanne (EPFL)(洛桑联邦理工学院)

André Schakkal, Guillaume Bellegarda, Auke Ijspeert

AI总结:

本文提出一种四足机器人后腿站立时用前腿动态捕捉物体的框架,集成视觉检测、轨迹预测与PD控制,并验证了三种最佳捕捉位置选择方法,其中基于高斯混合模型的方法实现了80%的捕捉成功率。

摘要:

本文提出了一个使用四足机器人前腿进行动态物体捕捉的框架,该机器人在此过程中用后腿站立。该系统集成了计算机视觉、轨迹预测和腿部控制,使四足机器人能够利用机载摄像头视觉检测、追踪并成功捕捉抛掷物。利用微调的YOLOv8模型进行物体检测,并采用基于回归的轨迹预测模块,四足机器人迭代调整其前腿位置以预测并拦截物体。捕捉动作包括确定最佳捕捉位置、使用笛卡尔PD控制控制前腿,并在恰当时刻并拢双腿。我们提出并验证了三种选择最佳捕捉位置的不同方法:1)将预测轨迹与垂直平面相交;2)在预测轨迹上选择与机器人腿部处于标称位置时的中心距离最小的点;3)在建模机器人可达空间的高斯混合模型(GMM)上,选择预测轨迹上似然度最高的点。实验结果展示了在各种场景下稳健的捕捉能力,其中GMM方法取得了最佳性能,实现了80%的捕捉成功率。该系统实际运行的视频演示可在 https://youtu.be/sm7RdxRfIYg 查看。

英文摘要:

This paper presents a framework for dynamic object catching using a quadruped robot's front legs while it stands on its rear legs. The system integrates computer vision, trajectory prediction, and leg control to enable the quadruped to visually detect, track, and successfully catch a thrown object using an onboard camera. Leveraging a fine-tuned YOLOv8 model for object detection and a regression-based trajectory prediction module, the quadruped adapts its front leg positions iteratively to anticipate and intercept the object. The catching maneuver involves identifying the optimal catching position, controlling the front legs with Cartesian PD control, and closing the legs together at the right moment. We propose and validate three different methods for selecting the optimal catching position: 1) intersecting the predicted trajectory with a vertical plane, 2) selecting the point on the predicted trajectory with the minimal distance to the center of the robot's legs in their nominal position, and 3) selecting the point on the predicted trajectory with the highest likelihood on a Gaussian Mixture Model (GMM) modelling the robot's reachable space. Experimental results demonstrate robust catching capabilities across various scenarios, with the GMM method achieving the best performance, leading to an 80% catching success rate. A video demonstration of the system in action can be found at https://youtu.be/sm7RdxRfIYg .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑