arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2607.06388cs.ROcs.CVcs.LG
收藏

学习在多障碍物环境中安全投掷物体

Learning to Throw Objects Safely in Multi-Obstacle Environments

University of Groningen(格罗宁根大学);University of Edinburgh(爱丁堡大学)

Mohammadreza Kasaei, Klemen Voncina, Hamidreza Kasaei

AI总结:

研究在多障碍物环境中安全投掷物体的问题,引入势场状态表示,结合动觉演示初始化,用SAC等算法优化,经模拟和真实机器人实验,该表示在成功率和扩展性上表现出色,实现了模拟到真实的可靠迁移。

摘要:

机器人投掷能够在机器人的直接工作空间之外快速有效地放置物体,但在杂乱环境中的可靠投掷仍未得到充分探索。现有方法,如TossingBot,从视觉输入中学习投掷策略,但假设环境无障碍物。本文解决了在场景中随机放置障碍物的情况下将物体投掷到目标篮筐的问题。我们引入了一种势场状态表示,它在固定大小的网格上紧凑地编码篮筐吸引力和障碍物排斥力,使强化学习(RL)策略能够在任意数量和配置的障碍物中进行泛化。该策略从动觉演示初始化,并使用三种先进的RL算法(SAC、DDPG、TD3)在模拟中进行优化。其中,SAC在各种场景中实现了最一致的性能。我们将势场表示与显式状态编码进行比较,证明它具有更高的成功率和对未见障碍物配置的更好扩展性。使用未见可投掷物体的真实机器人实验证实了强大的模拟到真实的迁移能力,在杂乱场景中成功率高达90%。这些结果表明,PFR为非结构化环境中安全高效的机器人投掷提供了一种实用且强大的表示。

英文摘要:

Robotic throwing enables fast and efficient object placement beyond the robot's immediate workspace, but reliable throwing in cluttered environments remains underexplored. Existing approaches, such as TossingBot, learn throwing strategies from visual input but assume obstacle-free settings. In this paper, we address the problem of throwing objects into a target basket while avoiding obstacles placed randomly in the scene. We introduce a potential field state representation that compactly encodes both basket attraction and obstacle repulsion on a fixed-size grid, enabling reinforcement learning (RL) policies to generalize across arbitrary numbers and configurations of obstacles. The policy is initialized from kinesthetic demonstrations and optimized in simulation using three state-of-the-art RL algorithms (SAC, DDPG, TD3). Among these, SAC achieves the most consistent performance across scenarios. We compare the potential field representation against explicit state encodings and demonstrate that it achieves higher success rates and better scalability to unseen obstacle configurations. Real-robot experiments with unseen throwable objects confirm robust sim-to-real transfer, achieving up to $90\%$ success in cluttered scenes. These results demonstrate that PFR provides a practical and robust representation for safe and efficient robotic throwing in unstructured environments. A video showcasing our experiments is available at: https://youtu.be/ZZnJf8ua2dE

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑