arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.08033cs.RO
收藏

基于单目图像的绳驱动软体机器人三维力估计方法

A three-dimensional force estimation method for the cable-driven soft robot based on monocular images

School of Information and Control Engineering, China University of Mining and Technology(中国矿业大学信息与控制工程学院)

Xiaohan Zhu, Ran Bu, Zhen Li, Fan Xu, Hesheng Wang

AI总结:

针对软体机器人实时接触反馈不足的问题,提出融合单目图像与多维度驱动信息的端到端三维力估计网络,通过统一特征表示模块实现多模态信息融合,实验验证其力估计精度优于现有相关工作。

摘要:

软体操作臂以其在应对高安全性要求交互任务(如机器人辅助手术、老年护理等)中的优势而闻名,但实时接触反馈方面存在的挑战阻碍了其在精准操作中的进一步应用。本文提出一种端到端网络,用于估计软体机器人的三维接触力,旨在提升其在交互任务中的能力。该方法的特点是直接将单目图像与多维度驱动信息融合后作为网络输入。与采用三维形状信息作为网络输入的相关研究相比,该方法简化了原始数据的预处理流程,进而降低了位形重构误差。本文设计了统一特征表示模块,将系统驱动信号的低维特征提升至与图像特征相同的层级,以促进多模态信息更顺畅的融合。该方法已在软体机器人测试平台上通过实验验证,在三维力估计中取得了令人满意的精度(平均相对误差为0.84%,而相关工作中已报道的最佳结果为2.2%)。

英文摘要:

Soft manipulators are known for their superiority in coping with high-safety-demanding interaction tasks, e.g., robot-assisted surgeries, elderly caring, etc. Yet the challenges residing in real-time contact feedback have hindered further applications in precise manipulation. This paper proposes an end-to-end network to estimate the 3D contact force of the soft robot, with the aim of enhancing its capabilities in interactive tasks. The presented method features directly utilizing monocular images fused with multidimensional actuation information as the network inputs. This approach simplifies the preprocessing of raw data compared to related studies that utilize 3D shape information for network inputs, consequently reducing configuration reconstruction errors. The unified feature representation module is devised to elevate low-dimensional features from the system's actuation signals to the same level as image features, facilitating smoother integration of multimodal information. The proposed method has been experimentally validated in the soft robot testbed, achieving satisfying accuracy in 3D force estimation (with a mean relative error of 0.84% compared to the best-reported result of 2.2% in the related works).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑