arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2404.01170cs.ROeess.IV
收藏

Force-EvT:基于事件视觉Transformer的机器人夹爪力测量再审视

Force-EvT: A Closer Look at Robotic Gripper Force Measurement with Event-based Vision Transformer

Purdue University(普渡大学);Khalifa University(哈利法大学)

Qianyu Guo, Ziqing Yu, Jiaming Fu, Yawen Lu, Yahya Zweiri, Dongming Gan

AI总结:

本文提出Force-EvT方法,利用事件相机和Vision Transformer实现机器人夹爪的实时力测量,通过25组事件数据验证其在多种场景下优于现有方法。

摘要:

机器人夹爪作为机器人与物体交互和操作的关键部件,正在各行各业受到越来越多的关注。尽管过去已取得显著进展,传统刚性夹爪在处理不规则物体时仍存在局限,并可能损坏易碎物体。我们已证明软体夹爪具备可变形性,能够适应多种物体形状并最大程度地保护物体。与此同时,动态视觉传感器(例如事件相机)能够捕捉微小的亮度变化并以事件形式异步输出,不同于RGB相机在低光照和快速运动环境中表现不佳。本文提出了一种基于动态视觉的算法,用于测量施加在夹爪上的力。具体而言,我们首先搭建了一套DVXplorer Lite系列事件相机,采集了二十五组事件数据。其次,受Vision Transformer(ViT)算法在密集图像预测任务中出色表现的启发,我们提出了一种新方法,展示了实时力估计的潜力,并满足真实场景的需求。我们在广泛的场景和设置下对所提算法进行了充分评估,结果表明其持续优于近期方法。

英文摘要:

Robotic grippers are receiving increasing attention in various industries as essential components of robots for interacting and manipulating objects. While significant progress has been made in the past, conventional rigid grippers still have limitations in handling irregular objects and can damage fragile objects. We have shown that soft grippers offer deformability to adapt to a variety of object shapes and maximize object protection. At the same time, dynamic vision sensors (e.g., event-based cameras) are capable of capturing small changes in brightness and streaming them asynchronously as events, unlike RGB cameras, which do not perform well in low-light and fast-moving environments. In this paper, a dynamic-vision-based algorithm is proposed to measure the force applied to the gripper. In particular, we first set up a DVXplorer Lite series event camera to capture twenty-five sets of event data. Second, motivated by the impressive performance of the Vision Transformer (ViT) algorithm in dense image prediction tasks, we propose a new approach that demonstrates the potential for real-time force estimation and meets the requirements of real-world scenarios. We extensively evaluate the proposed algorithm on a wide range of scenarios and settings, and show that it consistently outperforms recent approaches.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑