arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2409.09883cs.RO
收藏

建议安全替代方案的机器人

Robots that Suggest Safe Alternatives

UC San Diego(加州大学圣地亚哥分校);Robotics Institute, Carnegie Mellon University(卡内基梅隆大学机器人研究所)

Hyun Joe Jeong, Rosy Chen, Andrea Bajcsy

AI总结:

本研究提出SALT框架,通过在目标空间构建安全控制问题并利用可达避障值网络作为安全滤波器,使机器人在无法安全执行用户目标时自动建议安全且可接受的替代方案。

摘要:

目标条件策略(如通过模仿学习学到的策略)为人类提供了一种简便的方式来影响机器人完成的任务。然而,当面临分布外请求时,无法保证这些机器人策略能够安全执行或取得成功。在本研究中,我们使机器人能够知道何时可以自信地执行用户的期望目标,并在无法执行时自动建议安全的替代方案。我们的方法受控制论安全滤波器启发,其中安全滤波器以最小幅度调整机器人的候选动作以实现安全。我们的核心思想是将替代方案建议构建为目标空间(而非动作空间)中的安全控制问题。在离线阶段,我们使用可达性分析计算一个目标参数化的可达避障值网络,该网络量化了机器人预训练策略的安全性和活性。在线阶段,我们的机器人将可达避障值网络作为安全滤波器,监控人类给定的目标,并主动建议相似但满足安全规范的替代方案。我们在室内导航和 Franka Panda 桌面操作的仿真实验中,以及使用离散和连续目标表示的情况下,演示了我们的安全替代方案(SALT)框架。我们发现,SALT 能够学习预测闭环执行的成功与失败,作为监控器比开环不确定性量化更不悲观,并且提出的替代方案始终与人们认为可接受的方案保持一致。

英文摘要:

Goal-conditioned policies, such as those learned via imitation learning, provide an easy way for humans to influence what tasks robots accomplish. However, these robot policies are not guaranteed to execute safely or to succeed when faced with out-of-distribution requests. In this work, we enable robots to know when they can confidently execute a user's desired goal, and automatically suggest safe alternatives when they cannot. Our approach is inspired by control-theoretic safety filtering, wherein a safety filter minimally adjusts a robot's candidate action to be safe. Our key idea is to pose alternative suggestion as a safe control problem in goal space, rather than in action space. Offline, we use reachability analysis to compute a goal-parameterized reach-avoid value network which quantifies the safety and liveness of the robot's pre-trained policy. Online, our robot uses the reach-avoid value network as a safety filter, monitoring the human's given goal and actively suggesting alternatives that are similar but meet the safety specification. We demonstrate our Safe ALTernatives (SALT) framework in simulation experiments with indoor navigation and Franka Panda tabletop manipulation, and with both discrete and continuous goal representations. We find that SALT is able to learn to predict successful and failed closed-loop executions, is a less pessimistic monitor than open-loop uncertainty quantification, and proposes alternatives that consistently align with those people find acceptable.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑