The advent of simulation engines has revolutionized learning and operational efficiency for robots, offering cost-effective and swift pipelines. However, the lack of a universal simulation platform tailored for chemical scenarios impedes progress in robotic manipulation and visualization of reaction processes. Addressing this void, we present Chemistry3D, an innovative toolkit that integrates extensive chemical and robotic knowledge. Chemistry3D not only enables robots to perform chemical experiments but also provides real-time visualization of temperature, color, and pH changes during reactions. Built on the NVIDIA Omniverse platform, Chemistry3D offers interfaces for robot operation, visual inspection, and liquid flow control, facilitating the simulation of special objects such as liquids and transparent entities. Leveraging this toolkit, we have devised RL tasks, object detection, and robot operation scenarios. Additionally, to discern disparities between the rendering engine and the real world, we conducted transparent object detection experiments using Sim2Real, validating the toolkit's exceptional simulation performance. The source code is available at https://github.com/huangyan28/Chemistry3D, and a related tutorial can be found at https://www.omni-chemistry.com.
MATTERIX: toward a digital twin for robotics-assisted chemistry laboratory automation
University of Toronto(多伦多大学);Acceleration Consortium(加速联盟);Vector Institute(向量研究所);University of Liverpool(利物浦大学);University of Salento(萨勒诺大学);NVIDIA Canadian Institute for Advanced Research(NVIDIA加拿大高级研究机构);Georgia Institute of Technology(佐治亚理工学院)
RobotPerf: An Open-Source, Vendor-Agnostic, Benchmarking Suite for Evaluating Robotics Computing System Performance
Acceleration Robotics(加速机器人公司);Alpen-Adria-Universität Klagenfurt(阿尔卑斯-亚得里亚大学克拉根福分校);Harvard University(哈佛大学);Georgia Institute of Technology(佐治亚理工学院);Carnegie Mellon University(卡内基梅隆大学);Johannes Kepler University Linz(约翰·开普勒林茨大学);Ford Motor Company(福特汽车公司);AMD(AMD公司);Intel(英特尔公司);Boston University(波士顿大学);Barnard College, Columbia University(哥伦比亚大学巴纳德学院)
A Cross-Embodiment Gripper Benchmark for Rigid-Object Manipulation in Aerial and Industrial Robotics
Faculty of Mechanical Engineering, Technical University of Kosice(机械工程学院,科西策技术大学);GRVC Robotics Lab of Seville(塞维利亚GRVC机器人实验室);Brubotics, Vrije Universiteit Brussel and IMEC(Brubotics、布鲁塞尔自由大学和IMEC)
RoboBPP: Benchmarking Robotic Online Bin Packing with Physics-based Simulation
National University of Defense Technology(国防科技大学);Institute of AI for Industries, Chinese Academy of Sciences(中国科学院人工智能产业研究院);Wuhan University(武汉大学);Shenzhen University(深圳大学);JD Explore Academy(京东探索研究院);China Post Technology Company(中国邮政技术公司)
RAMP: A Benchmark for Evaluating Robotic Assembly Manipulation and Planning
Birmingham University(伯明翰大学);The Manufacturing Technology Centre(制造技术中心);Applied AI Lab, Oxford Robotics Institute, University of Oxford(牛津大学牛津机器人研究所应用人工智能实验室)
Cross-Modal Benchmarking for Robotic Perception in Natural Environments
CSIRO Robotics, CSIRO, Australia(CSIRO机器人研究所,CSIRO,澳大利亚);University of Sydney (USyd), Australia(悉尼大学(USyd),澳大利亚);Queensland University of Technology (QUT), Australia(昆士兰理工大学(QUT),澳大利亚)
EEG-Driven Intention Decoding: Offline Deep Learning Benchmarking on a Robotic Rover
Department of Computer Science, Imam Mohammad Ibn Saud Islamic University(计算机科学系,伊玛目穆罕默德·伊本·沙特伊斯兰大学);Department of Computer Science, King Saud University(计算机科学系,国王沙特大学)
Using Language Models as Closed-Loop High-Level Planners for Robotics Applications: A Brief Overview and Benchmarks
Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California(南加州大学明希德电气与计算机工程系);Department of Aeronautics and Astronautics, Stanford University(斯坦福大学航空航天工程系);Department of Mechanical Engineering, Stanford University(斯坦福大学机械工程系)
The ACRV Picking Benchmark (APB): A Robotic Shelf Picking Benchmark to Foster Reproducible Research
Australian Centre for Robotic Vision(澳大利亚机器人视觉中心);Queensland University of Technology(昆士兰科技大学);Amazon Robotics LLC(亚马逊机器人有限责任公司);University of Adelaide(阿德莱德大学)
OpenLORIS-Object: A Robotic Vision Dataset and Benchmark for Lifelong Deep Learning
Intel Labs(英特尔实验室);City University of Hong Kong(香港城市大学);Tsinghua University(清华大学);Beijing University of Posts and Telecommunications(北京邮电大学);Wuhan University(武汉大学);University of Bologna(博洛尼亚大学);Dublin City University(都柏林城市大学);Imperial College London(帝国理工学院)
A Retrospective on the Robot Air Hockey Challenge: Benchmarking Robust, Reliable, and Safe Learning Techniques for Real-world Robotics
Intelligent Autonomous Systems, TU Darmstadt(达姆施塔特工业大学智能自主系统研究所);German Research Center for AI (DFKI)(德国人工智能研究中心);Huawei German research center(华为德国研究中心);Huawei Noah’s Ark Lab(华为诺亚方舟实验室);University College London(伦敦大学学院);Idiap Research Institute(伊迪亚普研究所);EPFL(洛桑联邦理工学院);University of Luxembourg(卢森堡大学);Karlsruher Institut für Technologie(卡尔斯鲁厄理工学院);Universita di Bologna(博洛尼亚大学);Politecnico di Milano(米兰理工大学);Centre for Cognitive Science(认知科学中心)
Benchmarking Simulated Robotic Manipulation through a Real World Dataset
Data61, Commonwealth Scientific and Industrial Research Organisation (CSIRO)(联邦科学与工业研究组织(CSIRO)Data61研究所);Queensland University of Technology (QUT)(昆士兰科技大学(QUT))
PREVENT: Proactive Risk Evaluation and Vigilant Execution of Tasks for Mobile Robotic Chemists using Multi-Modal Behavior Trees
Department of Chemistry and Material Innovation Factory, University of Liverpool(化学系和材料创新工厂,利物浦大学);Center for Life Science Automation, University of Rostock(生命科学自动化中心,罗斯托克大学)