通过机器人技能学习加速实验室自动化中的样品刮取
Accelerating Laboratory Automation Through Robot Skill Learning For Sample Scraping
AI总结:
本研究提出一种无模型强化学习方法,使机器人学习从样品瓶中刮取粉末的策略,实现完全自主的样品刮取,加速实验室自动化进程。
摘要:
使用实验室机器人进行自主实验为减轻科学家繁琐任务提供了一条有吸引力的途径,同时加速材料发现以应对气候变化和制药等热点问题。虽然某些实验工作流程已经可以从自动化中受益,但由于处理不同工具、化学品和玻璃器皿时需要高水平的运动功能和灵巧性,样品制备仍然手动进行。化学领域的一个基本工作流程是结晶,其中一个应用是多晶型筛选,即从晶体中获得三维分子结构。对于这一过程,尽可能多地回收样品至关重要,因为合成分子在时间和金钱上都很昂贵。为此,化学家在转移到成像板之前刮取小瓶以回收样品内容物。自动化这一过程具有挑战性,因为它超越了机器人插入任务,因为基本要求是在受限环境(样品小瓶)内执行精细粒度运动。受人类化学家从瓶中刮取粉末过程的启发,我们的工作提出了一种无模型强化学习方法,用于学习刮取策略,从而实现完全自主的样品刮取程序。我们首先使用插入模拟小瓶中的实验室刮刀,创建一个具有Panda Franka Emika机器人的场景特定模拟环境,以演示如何在模拟中成功学习刮取策略。然后,我们在实验室环境中在真实机器人操纵器上训练和评估我们的方法,并表明我们的方法可以在各种设置下自主刮取粉末。
英文摘要:
The use of laboratory robotics for autonomous experiments offers an attractive route to alleviate scientists from tedious tasks while accelerating material discovery for topical issues such as climate change and pharmaceuticals. While some experimental workflows can already benefit from automation, sample preparation is still carried out manually due to the high level of motor function and dexterity required when dealing with different tools, chemicals, and glassware. A fundamental workflow in chemical fields is crystallisation, where one application is polymorph screening, i.e., obtaining a three dimensional molecular structure from a crystal. For this process, it is of utmost importance to recover as much of the sample as possible since synthesising molecules is both costly in time and money. To this aim, chemists scrape vials to retrieve sample contents prior to imaging plate transfer. Automating this process is challenging as it goes beyond robotic insertion tasks due to a fundamental requirement of having to execute fine-granular movements within a constrained environment (sample vial). Motivated by how human chemists carry out this process of scraping powder from vials, our work proposes a model-free reinforcement learning method for learning a scraping policy, leading to a fully autonomous sample scraping procedure. We first create a scenario-specific simulation environment with a Panda Franka Emika robot using a laboratory scraper that is inserted into a simulated vial, to demonstrate how a scraping policy can be learned successfully in simulation. We then train and evaluate our method on a real robotic manipulator in laboratory settings, and show that our method can autonomously scrape powder across various setups.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。