arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2510.02464cs.ROcs.HC
收藏

ERUPT:一款用于在扩展现实中与机器人运动规划器交互的开源工具包

ERUPT: An Open Toolkit for Interfacing with Robot Motion Planners in Extended Reality

Parasol Lab, Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign(Parasol实验室,Siebel计算与数据科学学院,伊利诺伊大学厄巴纳-香槟分校);Insper;Department of Computer Science at Instituto Tecnológico Autónomo de México (ITAM)(墨西哥自主技术学院计算机科学系)

Isaac Ngui, Courtney McBeth, André Santos, Grace He, Katherine J. Mimnaugh, James D. Motes, Luciano Soares, Marco Morales, Nancy M. Amato

AI总结:

本研究提出开源XR工具包ERUPT,集成MoveIt框架支持交互式机器人运动规划,提供多模态自然交互与路径可视化,可在虚拟空间验证后部署到实体机器人。

摘要:

我们提出了扩展现实通用规划工具包(Extended Reality Universal Planning Toolkit,ERUPT),这是一套用于交互式运动规划的扩展现实(XR)系统。该系统允许用户在规划机器人路径的同时创建并动态重构环境。在沉浸式三维XR环境中,用户能获得更强的空间感知能力。XR还解锁了更丰富的自然交互能力,用户可以像在现实世界中一样抓取、调整环境中的物体,而非通过鼠标键盘操作投影在二维电脑屏幕上的场景。我们的系统与操作规划框架MoveIt集成,用户可发送运动规划请求,并在虚拟现实或增强现实中可视化生成的机器人路径。系统提供了多种交互模式,支持用户修改环境中的物体并与虚拟机器人交互。操作人员可以可视化机器人运动,在虚拟空间中无碰撞风险地验证机器人在环境中移动时的预期行为,随后可将规划好的路径部署到现实世界的实体机器人上。

英文摘要:

We present the Extended Reality Universal Planning Toolkit (ERUPT), an extended reality (XR) system for interactive motion planning. This paper serves to introduce our open-source system to others who can use it as a base to develop immersive robot interaction applications. Our system allows users to create and dynamically reconfigure environments while they plan robot paths. ERUPT uses XR to provide a broad range of natural interaction capabilities, allowing users to grab and adjust objects in the environment similar to interaction in the real world, rather than using a mouse and keyboard with the scene projected onto a 2D computer screen. Our system integrates with MoveIt, a manipulation planning framework, allowing users to send motion planning requests and visualize the resulting robot paths in virtual or augmented reality. We provide a broad range of interaction modalities, allowing users to modify objects in the environment and interact with a virtual robot. Our system allows operators to visualize robot motions, ensuring desired behavior as it moves throughout the environment, without risk of collisions within a virtual space, and to then deploy planned paths on physical robots in the real world. Code can be found at https://github.com/parasollab/erupt.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑