基于时空神经网络的外部载荷下连续体机器人形状估计
Estimating Continuum Robot Shape under External Loading using Spatiotemporal Neural Networks
AI总结:
本文提出一种时空神经网络方法,融合肌腱位移和图像数据,通过贝塞尔曲线拟合实现连续体机器人三维形状估计,在载荷下误差低至0.22毫米,优于现有方法。
摘要:
本文提出了一种基于学习的方法,用于准确估计受外部载荷作用的柔性连续体机器人的三维形状。所提出的方法引入了一种时空神经网络架构,该架构融合多模态输入,包括当前和历史肌腱位移数据以及RGB图像,以生成表示机器人变形构型的点云。该网络集成了一个用于时间特征提取的循环神经模块、一个用于空间特征提取的编码模块,以及一个多模态融合模块,用于将视觉数据中提取的空间特征与历史执行器输入的时间依赖关系相结合。通过将贝塞尔曲线拟合到预测的点云上,实现了连续的三维形状重建。实验验证表明,我们的方法实现了高精度,平均形状估计误差为0.08毫米(无载荷)和0.22毫米(有载荷),在TDCR形状感知方面优于最先进的方法。结果验证了基于深度学习的时空数据融合在载荷条件下精确形状估计的有效性。
英文摘要:
This paper presents a learning-based approach for accurately estimating the 3D shape of flexible continuum robots subjected to external loads. The proposed method introduces a spatiotemporal neural network architecture that fuses multi-modal inputs, including current and historical tendon displacement data and RGB images, to generate point clouds representing the robot's deformed configuration. The network integrates a recurrent neural module for temporal feature extraction, an encoding module for spatial feature extraction, and a multi-modal fusion module to combine spatial features extracted from visual data with temporal dependencies from historical actuator inputs. Continuous 3D shape reconstruction is achieved by fitting Bézier curves to the predicted point clouds. Experimental validation demonstrates that our approach achieves high precision, with mean shape estimation errors of 0.08 mm (unloaded) and 0.22 mm (loaded), outperforming state-of-the-art methods in shape sensing for TDCRs. The results validate the efficacy of deep learning-based spatiotemporal data fusion for precise shape estimation under loading conditions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。