通过粒子模拟的策略学习实现挖掘机自主障碍物移除
Autonomous Obstacle Removal for Excavators through Policy Learning with Particle Simulation
AI总结:
提出一种基于粒子模拟的课程学习框架,通过RGB-D感知和参数化轨迹输出,实现挖掘机在不同埋深条件下自主移除地面障碍物,并在真实12吨挖掘机上验证了鲁棒性。
摘要:
从地面自主移除障碍物是一项重要的土方工程任务,但由于挖掘机必须随着土壤-障碍物条件的变化在重复循环中调整其挖掘轨迹,因此难以自动化。学习这种状态依赖行为需要一个能够再现累积土壤-障碍物相互作用的训练环境,包括接触状态、地形变形和障碍物可见性。因此,基于粒子的模拟适用于相关的策略学习。然而,粒子模拟计算成本高,重复的挖掘循环进一步增加了学习成本。我们观察到障碍物的埋藏条件决定了任务难度和模拟成本:更深的埋藏使障碍物移除更难,同时也需要更多粒子进行精确模拟。这一观察启发了一种基于埋藏条件的课程学习策略。我们提出了一种时间高效的模拟到现实策略学习框架,其中策略从RGB-D测量中观察地形和障碍物信息,然后输出参数化的挖掘轨迹;在此过程中,模拟器在可控埋藏条件下再现了真实挖掘机所使用的相同观测-动作接口。课程从浅埋条件开始,逐步增加埋藏深度,同时调整粒子数量,从而同时控制任务难度和模拟成本。实验表明,所提出的框架成功学习了一个有效的障碍物移除策略,而基线方法即使在完整一周的训练后也失败。所提出的课程在三天内实现了有效性能,并成功迁移到一台在开阔地面上操作各种钢制障碍物的真实12吨挖掘机上,从而展示了鲁棒的障碍物移除能力。
英文摘要:
Autonomous obstacle removal from the ground is an important earthwork task, but this is difficult to automate because an excavator must adapt its excavation trajectories over repeated cycles as soil-obstacle conditions change. Learning such state-dependent behavior requires a training environment that reproduces accumulated soil-obstacle interactions, including contact states, terrain deformation, and obstacle visibility. Accordingly, particle-based simulation is suitable for the relevant policy learning. However, particle simulation is computationally expensive, and repeated excavation cycles further increase the learning cost. We observe that the burial condition of an obstacle governs both task difficulty and simulation cost: deeper burial makes obstacle removal harder while also requiring more particles for accurate simulation. This observation motivates a burial-conditioned curriculum learning strategy. We propose a time-efficient sim-to-real policy learning framework in which the policy observes terrain and obstacle information from RGB-D measurements and then outputs a parameterized excavation trajectory; in this process, the simulator reproduces in a real-world excavator the same observation-action interface it uses under controllable burial conditions. The curriculum begins with shallow burial conditions and progressively increases burial depth while adjusting particle count, thus simultaneously controlling task difficulty and simulation cost. Experiments show that the proposed framework successfully learns an effective obstacle-removal policy, whereas baseline methods fail even after a full week of training. The proposed curriculum achieves effective performance within three days and achieves successful transfer to a real 12-ton excavator operating on open ground with various steel obstacles, thus demonstrating robust obstacle removal.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。