arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1802.07218cs.GTcs.RO
收藏

评估无人机系统空域一体化方案的三维博弈理论框架

A 3D Game Theoretical Framework for the Evaluation of Unmanned Aircraft Systems Airspace Integration Concepts

Bilkent University(比尔肯特大学)

Negin Musavi, Ayman Manzoor, Yildiray Yildiz

摘要:

预测无人机系统(UAS)集成到国家空域系统(NAS)的结果是一个复杂的问题,需要通过仿真研究来解决,然后才允许UAS进入NAS的日常访问。本文着重于提供一个三维(3D)的仿真框架,使用博弈论的方法来评估集成的概念,使用有人驾驶和无人驾驶飞行器共存的情况下。在所提出的方法中,人类驾驶员的交互决策过程中纳入空域模型,可以填补空白,在文献中,通常假设飞行员的行为是已知的先验。提出的人类驾驶员行为建模使用动态k级推理概念和近似强化学习。k级推理概念是博弈论中的一个概念,它基于人类具有不同决策水平的假设。在传统的“静态”方法中,每个代理人对他或她的对手做出假设,并相应地选择他或她的行动。另一方面,在动态的k级推理中,智能体可以更新他们对对手的信念,并修改他们的k级规则。在这项研究中,神经拟合Q迭代,这是一个近似的强化学习方法,被用来模拟飞行员的三维机动的时间扩展的决策。在有人驾驶飞机和配备有感知和规避算法的全自主无人机的情况下,使用示例3D场景进行无人机集成分析。

英文摘要:

Predicting the outcomes of integrating Unmanned Aerial Systems (UAS) into the National Airspace System (NAS) is a complex problem which is required to be addressed by simulation studies before allowing the routine access of UAS into the NAS. This paper focuses on providing a 3-dimensional (3D) simulation framework using a game theoretical methodology to evaluate integration concepts using scenarios where manned and unmanned air vehicles co-exist. In the proposed method, human pilot interactive decision making process is incorporated into airspace models which can fill the gap in the literature where the pilot behavior is generally assumed to be known a priori. The proposed human pilot behavior is modeled using dynamic level-k reasoning concept and approximate reinforcement learning. The level-k reasoning concept is a notion in game theory and is based on the assumption that humans have various levels of decision making. In the conventional "static" approach, each agent makes assumptions about his or her opponents and chooses his or her actions accordingly. On the other hand, in the dynamic level-k reasoning, agents can update their beliefs about their opponents and revise their level-k rule. In this study, Neural Fitted Q Iteration, which is an approximate reinforcement learning method, is used to model time-extended decisions of pilots with 3D maneuvers. An analysis of UAS integration is conducted using an example 3D scenario in the presence of manned aircraft and fully autonomous UAS equipped with sense and avoid algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑