一种灵活的基于场的策略学习框架,适用于多样化的机器人系统和传感器
A Flexible Field-Based Policy Learning Framework for Diverse Robotic Systems and Sensors
AI总结:
本文提出一种灵活的基于场的策略学习框架,通过整合扩散策略控制与3D语义场景表示,实现跨机器人系统的高效泛化与任务成功率提升。
摘要:
我们提出了一种跨机器人视觉运动学习框架,将扩散策略控制与D3Fields生成的3D语义场景表示相结合,以实现操纵任务的类别级泛化。其模块化设计支持多种机器人摄像头配置,包括配备Microsoft Azure Kinect阵列的UR5机械臂和配备Intel RealSense传感器的双臂操作器,通过低延迟的控制栈和直观的远程操作。统一的配置层使在不同设置之间无缝切换,以实现灵活的数据收集、训练和评估。在抓取和提升方块任务中,该框架在仅100次演示示例后实现了80%的成功率,展示了在不同平台和传感模态之间稳健的技能转移。该设计为跨机器人泛化的现实世界研究提供了可扩展的途径。
英文摘要:
We present a cross robot visuomotor learning framework that integrates diffusion policy based control with 3D semantic scene representations from D3Fields to enable category level generalization in manipulation. Its modular design supports diverse robot camera configurations including UR5 arms with Microsoft Azure Kinect arrays and bimanual manipulators with Intel RealSense sensors through a low latency control stack and intuitive teleoperation. A unified configuration layer enables seamless switching between setups for flexible data collection training and evaluation. In a grasp and lift block task the framework achieved an 80 percent success rate after only 100 demonstration episodes demonstrating robust skill transfer between platforms and sensing modalities. This design paves the way for scalable real world studies in cross robotic generalization.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。