arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2204.08586cs.RO
收藏

具有选择性透射软膜的多模态接近和视觉触觉传感

Multimodal Proximity and Visuotactile Sensing With a Selectively Transmissive Soft Membrane

University of Pennsylvania(宾夕法尼亚大学)

Jessica Yin, Gregory M. Campbell, James Pikul, Mark Yim

摘要:

在机器人感知系统中发现的最常见的传感模式是视觉和触觉,它们一起可以提供全局和高度本地化的数据用于操作。然而,这些感测模态在关键时刻通常不能充分捕获目标对象的行为,因为它们从与末端执行器的静态受控接触过渡到动态和不受控运动。在这项工作中,我们提出了一种新型的多模式视觉触觉传感器,可以同时提供视觉触觉和邻近深度数据。该传感器集成了RGB摄像头和气压传感器,以利用红外飞行时间(ToF)摄像头来感测触摸,以通过利用选择性透射软膜来感测接近度,以实现双感测模式。我们提出的机械设计,制造技术,算法实现,和评估传感器的触觉和接近方式。该传感器在三个开环机器人任务中进行了演示:接近和接触物体,捕捉和投掷。触觉和接近数据的融合可以用来捕获关于目标对象的过渡行为的关键信息,用于基于传感器的动态操纵控制。

英文摘要:

The most common sensing modalities found in a robot perception system are vision and touch, which together can provide global and highly localized data for manipulation. However, these sensing modalities often fail to adequately capture the behavior of target objects during the critical moments as they transition out of static, controlled contact with an end-effector to dynamic and uncontrolled motion. In this work, we present a novel multimodal visuotactile sensor that provides simultaneous visuotactile and proximity depth data. The sensor integrates an RGB camera and air pressure sensor to sense touch with an infrared time-of-flight (ToF) camera to sense proximity by leveraging a selectively transmissive soft membrane to enable the dual sensing modalities. We present the mechanical design, fabrication techniques, algorithm implementations, and evaluation of the sensor's tactile and proximity modalities. The sensor is demonstrated in three open-loop robotic tasks: approaching and contacting an object, catching, and throwing. The fusion of tactile and proximity data could be used to capture key information about a target object's transition behavior for sensor-based control in dynamic manipulation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑