arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2307.00671cs.RO
收藏

在研发实验室中利用多模态感知执行机器人插入任务

Leveraging Multi-modal Sensing for Robotic Insertion Tasks in R&D Laboratories

University of Liverpool(利物浦大学);King’s College London(伦敦国王学院)

Aaron Butterworth, Gabriella Pizzuto, Leszek Pecyna, Andrew I. Cooper, Shan Luo

AI总结:

针对化学实验室中机器人开环放置玻璃小瓶的局限性,提出结合视觉、力和触觉的多模态感知方法,将插入成功率从48.78%提升至89.55%,促进人机协作闭环。

摘要:

在化学实验室中进行大量实验会产生耗费研究人员时间的重复性动作,将这些常规操作自动化是非常理想的。先前在机器人化学领域的实验已实现了大量实验的自主执行,然而,这些过程在从固体或液体添加到最终产物分析的所有阶段都依赖于自动化机器。在这些系统中,机器之间的每次转换都需要机器人化学家拾取并放置玻璃小瓶,然而,这目前是使用开环方法执行的,这要求机器人使用的所有设备都处于明确定义的已知位置。我们寻求在小瓶处理过程中开始闭环,这种方式同时也能促进化学实验室环境中的人机协作。为此,机器人必须能够检测其收集的小瓶的有效放置位置,并可靠地将它们插入检测到的位置。我们创建了一种单模态视觉方法来估计放置位置,以便在引入两种额外的反馈方法(力和触觉反馈)之前提供基线。我们的视觉方法结合了经典计算机视觉方法和CNN判别器来检测可能的插入点,然后抓取小瓶并将其定位在插入点上方,多模态方法使用高效的搜索模式引导最终的插入动作。通过我们的实验,我们展示了基线插入率48.78%在加入我们的“力与视觉”多模态反馈方法后提升至89.55%。

英文摘要:

Performing a large volume of experiments in Chemistry labs creates repetitive actions costing researchers time, automating these routines is highly desirable. Previous experiments in robotic chemistry have performed high numbers of experiments autonomously, however, these processes rely on automated machines in all stages from solid or liquid addition to analysis of the final product. In these systems every transition between machine requires the robotic chemist to pick and place glass vials, however, this is currently performed using open loop methods which require all equipment being used by the robot to be in well defined known locations. We seek to begin closing the loop in this vial handling process in a way which also fosters human-robot collaboration in the chemistry lab environment. To do this the robot must be able to detect valid placement positions for the vials it is collecting, and reliably insert them into the detected locations. We create a single modality visual method for estimating placement locations to provide a baseline before introducing two additional methods of feedback (force and tactile feedback). Our visual method uses a combination of classic computer vision methods and a CNN discriminator to detect possible insertion points, then a vial is grasped and positioned above an insertion point and the multi-modal methods guide the final insertion movements using an efficient search pattern. Through our experiments we show the baseline insertion rate of 48.78% improves to 89.55% with the addition of our "force and vision" multi-modal feedback method.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑