arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.04660cs.RO
收藏

基于触觉图像分割的旋转滑移预测

Rotational Slippage Prediction from Segmentation of Tactile Images

University Institute for Engineering Research, Miguel Hernández University(米格尔·埃尔南德斯大学工程研究大学研究所);Computer Science Research Institute, University of Alicante(阿利坎特大学计算机科学研究所);University of Alicante(阿利坎特大学)

Julio Castaño-Amoros, Pablo Gil

AI总结:

本文提出利用Digit触觉传感器和神经网络分割接触区域,结合细化算法预测旋转滑移,在自建数据集上达到95% Dice和91% IoU,真实场景误差小于3度,可防止物体滑落。

摘要:

在机器人系统中添加触觉传感器正成为一种常见做法,以实现比仅使用外部摄像头操纵物体的机器人系统更复杂的操作技能。触觉传感器的关键在于它们提供了关于抓取物理特性的额外信息。在本文中,我们实现了一个系统,利用名为Digit的基于视觉的触觉传感器来预测和量化手中物体的旋转滑移。我们的系统包含一个神经网络,用于获取分割的接触区域(物体-传感器),随后使用细化算法从该区域计算滑移旋转角度。此外,我们创建了自己的触觉分割数据集,据我们所知,这是文献中的第一个此类数据集,用于训练和评估我们的神经网络,在Dice和IoU指标上分别获得了95%和91%的结果。在真实场景实验中,我们的系统能够对未见过的物体预测旋转滑移,最大平均旋转误差为3度。因此,我们的系统可用于防止物体因滑移而掉落。

英文摘要:

Adding tactile sensors to a robotic system is becoming a common practice to achieve more complex manipulation skills than those robotics systems that only use external cameras to manipulate objects. The key of tactile sensors is that they provide extra information about the physical properties of the grasping. In this paper, we implemented a system to predict and quantify the rotational slippage of objects in hand using the vision-based tactile sensor known as Digit. Our system comprises a neural network that obtains the segmented contact region (object-sensor), to later calculate the slippage rotation angle from this region using a thinning algorithm. Besides, we created our own tactile segmentation dataset, which is the first one in the literature as far as we are concerned, to train and evaluate our neural network, obtaining results of 95% and 91% in Dice and IoU metrics. In real-scenario experiments, our system is able to predict rotational slippage with a maximum mean rotational error of 3 degrees with previously unseen objects. Thus, our system can be used to prevent an object from falling due to its slippage.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑