arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.04307cs.RO
收藏

气动软体机器人三维本体感知的Zero-Shot仿真到现实迁移学习

Toward Zero-Shot Sim-to-Real Transfer Learning for Pneumatic Soft Robot 3D Proprioceptive Sensing

New York University(纽约大学);Carnegie Mellon University(卡内基梅隆大学)

Uksang Yoo, Hanwen Zhao, Alvaro Altamirano, Wenzhen Yuan, Chen Feng

摘要:

气动软体机器人在操作任务中具有许多优点。值得注意的是,其固有的合规性使其在非结构化和脆弱的环境中安全可靠。然而,由于气动软体机器人的高自由度和复杂的变形行为,其全身形状感知具有挑战性。基于嵌入式摄像头和深度学习的视觉本体感知方法通过从高维感知数据中提取全身形状信息,为本体感知提供了很好的解决方案。但目前的训练数据收集过程使其难以用于许多应用。为了解决这一挑战,我们提出并展示了一个强大的模拟到真实的管道,允许收集的软体机器人的形状信息,在高保真点云表示。使用真实的内部摄像机图像对在模拟数据上训练的模型进行评估。结果表明,该模型执行的平均倒角距离为8.85 mm和尖端位置误差为10.12 mm,即使有外部扰动的气动软体机器人的长度为100.0 mm。我们还证明了模拟到真实的管道的潜力,探索不同的视觉模式的配置,以改善基于视觉的重建结果。代码和数据集可在https://github.com/DeepSoRo/DeepSoRoSim2Real上获得。

英文摘要:

Pneumatic soft robots present many advantages in manipulation tasks. Notably, their inherent compliance makes them safe and reliable in unstructured and fragile environments. However, full-body shape sensing for pneumatic soft robots is challenging because of their high degrees of freedom and complex deformation behaviors. Vision-based proprioception sensing methods relying on embedded cameras and deep learning provide a good solution to proprioception sensing by extracting the full-body shape information from the high-dimensional sensing data. But the current training data collection process makes it difficult for many applications. To address this challenge, we propose and demonstrate a robust sim-to-real pipeline that allows the collection of the soft robot's shape information in high-fidelity point cloud representation. The model trained on simulated data was evaluated with real internal camera images. The results show that the model performed with averaged Chamfer distance of 8.85 mm and tip position error of 10.12 mm even with external perturbation for a pneumatic soft robot with a length of 100.0 mm. We also demonstrated the sim-to-real pipeline's potential for exploring different configurations of visual patterns to improve vision-based reconstruction results. The code and dataset are available at https://github.com/DeepSoRo/DeepSoRoSim2Real.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑