RTAEval:一个用于评估运行时保证逻辑的框架
RTAEval: A framework for evaluating runtime assurance logic
AI总结:
针对运行时保证方法缺乏统一评估工具的问题,本文提出低代码框架 RTAEval,支持快速构建场景、运行多种 RTA 逻辑并收集、评估和可视化性能数据。
摘要:
运行时保证(RTA)解决的是在使用不可信(或实验性)控制器时保持自主系统安全的问题。这可以通过在不可信控制器与安全控制器之间显式切换的逻辑来实现,也可以通过过滤不可信控制器所提供输入的逻辑来实现。尽管已有若干工具实现了 RTA 的特定实例,但目前尚缺乏一个用于评估不同方法的框架。鉴于 RTA 问题在构建安全自主系统中的重要性,需要一种评估工具。在本文中,我们提出 RTAEval 框架,它是一个低代码框架,可用于在多种场景中快速评估面向不同类型智能体的不同 RTA 逻辑。RTAEval 旨在快速创建场景、运行不同的 RTA 逻辑,并收集可用于评估和可视化性能的数据。在本文中,我们描述了 RTAEval 的不同组件,并展示如何使用它创建和评估涉及多种飞机模型的场景。
英文摘要:
Runtime assurance (RTA) addresses the problem of keeping an autonomous system safe while using an untrusted (or experimental) controller. This can be done via logic that explicitly switches between the untrusted controller and a safety controller, or logic that filters the input provided by the untrusted controller. While several tools implement specific instances of RTAs, there is currently no framework for evaluating different approaches. Given the importance of the RTA problem in building safe autonomous systems, an evaluation tool is needed. In this paper, we present the RTAEval framework as a low code framework that can be used to quickly evaluate different RTA logics for different types of agents in a variety of scenarios. RTAEval is designed to quickly create scenarios, run different RTA logics, and collect data that can be used to evaluate and visualize performance. In this paper, we describe different components of RTAEval and show how it can be used to create and evaluate scenarios involving multiple aircraft models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。