期待意外:制定用于应对未预测事件和条件的自主系统设计原则
Expecting the Unexpected: Developing Autonomous-System Design Principles for Reacting to Unpredicted Events and Conditions
AI总结:
本文论证自主系统必然遭遇未预测事件,并提出可预先应用的设计原则,以帮助系统在首次面对未知情况时正确应对,支撑可信下一代自主系统的工程基础。
摘要:
在开发自主系统时,工程师和其他利益相关者会付出巨大努力,使系统为所有可预见的事件和条件做好准备。然而,这些系统仍必然会遇到在设计时未被考虑的事件和条件。出于安全、成本或伦理等原因,人们通常非常希望这些新情况在首次遇到时就能得到正确处理。在本文中,我们首先论证我们的立场:未预测的事件和条件将始终存在,其驱动因素尤其包括:现实世界中的新发明;系统在全球范围部署和使用的多样性;以及多个看似不太可能、在设计时可能被忽视的事件不仅会发生,而且会同时发生这一不可忽视的概率。随后,我们主张尽管存在这种不可预测性,处理这些事件和条件确实是可能的。因此,我们提出并举例说明若干设计原则;若提前应用这些原则,可使系统在未来应对未预测的环境。最后,我们讨论了这项工作以及对意外更广泛的理论研究,如何能够为开发可信的下一代自主系统的工程原则基础作出贡献。
英文摘要:
When developing autonomous systems, engineers and other stakeholders make great effort to prepare the system for all foreseeable events and conditions. However, these systems are still bound to encounter events and conditions that were not considered at design time. For reasons like safety, cost, or ethics, it is often highly desired that these new situations be handled correctly upon first encounter. In this paper we first justify our position that there will always exist unpredicted events and conditions, driven among others by: new inventions in the real world; the diversity of world-wide system deployments and uses; and, the non-negligible probability that multiple seemingly unlikely events, which may be neglected at design time, will not only occur, but occur together. We then argue that despite this unpredictability property, handling these events and conditions is indeed possible. Hence, we offer and exemplify design principles that when applied in advance, can enable systems to deal, in the future, with unpredicted circumstances. We conclude with a discussion of how this work and a broader theoretical study of the unexpected can contribute toward a foundation of engineering principles for developing trustworthy next-generation autonomous systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。