arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2202.01997cs.ROcs.SYeess.SY
收藏

信号时序逻辑规范下的半监督轨迹反馈控制器综合

Semi-Supervised Trajectory-Feedback Controller Synthesis for Signal Temporal Logic Specifications

Stanford University(斯坦福大学)

Karen Leung, Marco Pavone

摘要:

有时空规则规定机器人在复杂环境中应如何操作,例如,道路规则规定了(自动驾驶)车辆在道路上的行为。然而,将这些规则无缝地整合到机器人控制策略中仍然具有挑战性,特别是对于实时应用。在这项工作中,给定一个所需的时空规格表示的信号时序逻辑(STL)语言,我们提出了一个半监督控制器的合成技术,是调谐到类人的行为,同时满足所需的STL规范。离线时,我们通过对抗性训练方案合成了一个伪反馈神经网络控制器,该训练方案在计算控制时总结了过去的时空行为,然后在线时,我们执行梯度步骤以提高规范满意度。离线阶段的核心是一个基于模仿的正则化组件,它促进了更好的政策探索,并有助于诱导自然的人类行为。我们的实验表明,与仅在以前的工作中优化STL目标相比,具有基于模仿的正则化导致更高的定性和定量性能。我们证明了我们的方法的有效性与说明性的案例研究,并表明我们提出的控制器优于一个国家的最先进的射击方法在性能和计算时间。

英文摘要:

There are spatio-temporal rules that dictate how robots should operate in complex environments, e.g., road rules govern how (self-driving) vehicles should behave on the road. However, seamlessly incorporating such rules into a robot control policy remains challenging especially for real-time applications. In this work, given a desired spatio-temporal specification expressed in the Signal Temporal Logic (STL) language, we propose a semi-supervised controller synthesis technique that is attuned to human-like behaviors while satisfying desired STL specifications. Offline, we synthesize a trajectory-feedback neural network controller via an adversarial training scheme that summarizes past spatio-temporal behaviors when computing controls, and then online, we perform gradient steps to improve specification satisfaction. Central to the offline phase is an imitation-based regularization component that fosters better policy exploration and helps induce naturalistic human behaviors. Our experiments demonstrate that having imitation-based regularization leads to higher qualitative and quantitative performance compared to optimizing an STL objective only as done in prior work. We demonstrate the efficacy of our approach with an illustrative case study and show that our proposed controller outperforms a state-of-the-art shooting method in both performance and computation time.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑