arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.03031cs.RO
收藏

面向机器人草莓采摘的单次6DoF位姿与3D尺寸估计

Single-Shot 6DoF Pose and 3D Size Estimation for Robotic Strawberry Harvesting

University of Groningen(格罗宁根大学)

Lun Li, Hamidreza Kasaei

AI总结:

本研究提出一种深度学习方法,可单次估计草莓的6DoF位姿与3D尺寸,在合成数据训练下兼具高精度、强抗遮挡性与高速推理能力,适用于机器人草莓采摘场景。

摘要:

本研究提出了一种深度学习方法,可同时确定草莓的6自由度(6DoF)位姿与3D尺寸,旨在大幅提升机器人采摘效率。我们的模型在合成草莓数据集上训练,该数据集在Ignition Gazebo模拟器中自动生成,研究特别关注草莓固有的对称性特征。借助域随机化技术,模型表现出优异性能:在模拟数据集上的3D交并比(IoU)得分平均精度(AP)达到84.77%。通过在真实世界数据集上测试模型的实证评估,验证了即便训练基于合成数据,该模型仍适用于真实草莓采摘场景。模型还具备强大的遮挡处理能力,即便草莓被其他草莓或叶片遮挡,仍能保持准确的检测性能。此外,模型推理速度极快,最高可达60帧每秒(FPS)。

英文摘要:

In this study, we introduce a deep-learning approach for determining both the 6DoF pose and 3D size of strawberries, aiming to significantly augment robotic harvesting efficiency. Our model was trained on a synthetic strawberry dataset, which is automatically generated within the Ignition Gazebo simulator, with a specific focus on the inherent symmetry exhibited by strawberries. By leveraging domain randomization techniques, the model demonstrated exceptional performance, achieving an 84.77\% average precision (AP) of 3D Intersection over Union (IoU) scores on the simulated dataset. Empirical evaluations, conducted by testing our model on real-world datasets, underscored the model's viability for real-world strawberry harvesting scenarios, even though its training was based on synthetic data. The model also exhibited robust occlusion handling abilities, maintaining accurate detection capabilities even when strawberries were obscured by other strawberries or foliage. Additionally, the model showcased remarkably swift inference speeds, reaching up to 60 frames per second (FPS).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑