arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.08160cs.RO
收藏

Chemistry3D:面向化学实验的机器人交互基准

Chemistry3D: Robotic Interaction Benchmark for Chemistry Experiments

Tsinghua University(清华大学);Wuhan University(武汉大学);South China University of Technology(华南理工大学)

Shoujie Li, Yan Huang, Changqing Guo, Tong Wu, Jiawei Zhang, Linrui Zhang, Wenbo Ding

AI总结:

该研究提出基于 NVIDIA Omniverse 的 Chemistry3D 化学实验机器人仿真工具包,支持反应可视化、液体与透明物体模拟及 Sim2Real 验证。

摘要:

仿真引擎的出现彻底改变了机器人的学习与运行效率,提供了低成本且快速的流程。然而,缺少专为化学场景定制的通用仿真平台,阻碍了机器人操作与反应过程可视化的进展。为填补这一空白,我们提出 Chemistry3D,这是一个整合了大量化学与机器人知识的创新工具包。Chemistry3D 不仅使机器人能够执行化学实验,还可实时可视化反应过程中的温度、颜色和 pH 变化。Chemistry3D 构建于 NVIDIA Omniverse 平台之上,提供机器人操作、视觉检测和液体流动控制接口,便于模拟液体和透明实体等特殊对象。利用该工具包,我们设计了强化学习(RL)任务、目标检测和机器人操作场景。此外,为辨别渲染引擎与真实世界之间的差异,我们采用 Sim2Real 开展了透明物体检测实验,验证了该工具包出色的仿真性能。源代码可在 https://github.com/huangyan28/Chemistry3D 获取,相关教程可访问 https://www.omni-chemistry.com。

英文摘要:

The advent of simulation engines has revolutionized learning and operational efficiency for robots, offering cost-effective and swift pipelines. However, the lack of a universal simulation platform tailored for chemical scenarios impedes progress in robotic manipulation and visualization of reaction processes. Addressing this void, we present Chemistry3D, an innovative toolkit that integrates extensive chemical and robotic knowledge. Chemistry3D not only enables robots to perform chemical experiments but also provides real-time visualization of temperature, color, and pH changes during reactions. Built on the NVIDIA Omniverse platform, Chemistry3D offers interfaces for robot operation, visual inspection, and liquid flow control, facilitating the simulation of special objects such as liquids and transparent entities. Leveraging this toolkit, we have devised RL tasks, object detection, and robot operation scenarios. Additionally, to discern disparities between the rendering engine and the real world, we conducted transparent object detection experiments using Sim2Real, validating the toolkit's exceptional simulation performance. The source code is available at https://github.com/huangyan28/Chemistry3D, and a related tutorial can be found at https://www.omni-chemistry.com.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑