arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1904.08477cs.ROcs.LGstat.ML
收藏

无人机系统空域一体化方案评估的博弈论框架

A Game Theoretical Framework for the Evaluation of Unmanned Aircraft Systems Airspace Integration Concepts

Negin Musavi

摘要:

预测将无人机系统(UAS)集成到国家航空航天(NAS)中的结果是一个复杂的问题,在允许UAS常规访问NAS之前,需要通过仿真研究来解决。本论文的重点是提供二维和三维仿真框架,使用博弈论方法来评估集成概念的情况下,有人驾驶和无人驾驶飞行器共存。文献中的根本差距是有人驾驶和无人驾驶飞行器之间的相互作用模型是不够的:a)它们假设飞行员的行为是先验已知的,b)它们忽略了决策过程。这项工作的贡献是提出了一个建模框架,其中,人类飞行员的反应建模使用强化学习和一个游戏理论的概念,称为k级推理,以填补这一空白。k级推理的概念是基于人类具有不同决策水平的假设。强化学习是一种植根于人类学习的数学学习方法。在这项工作中,一个经典的和一个近似的强化学习(神经拟合Q迭代)方法被用来模拟飞行员的时间扩展决策与二维和三维机动。无人机集成的分析进行了使用示例场景中存在的有人驾驶飞机和全自主无人机配备感测和避免算法。

英文摘要:

Predicting the outcomes of integrating Unmanned Aerial Systems (UAS) into the National Aerospace (NAS) is a complex problem which is required to be addressed by simulation studies before allowing the routine access of UAS into the NAS. This thesis focuses on providing 2D and 3D simulation frameworks using a game theoretical methodology to evaluate integration concepts in scenarios where manned and unmanned air vehicles co-exist. The fundamental gap in the literature is that the models of interaction between manned and unmanned vehicles are insufficient: a) they assume that pilot behavior is known a priori and b) they disregard decision making processes. The contribution of this work is to propose a modeling framework, in which, human pilot reactions are modeled using reinforcement learning and a game theoretical concept called level-k reasoning to fill this gap. The level-k reasoning concept is based on the assumption that humans have various levels of decision making. Reinforcement learning is a mathematical learning method that is rooted in human learning. In this work, a classical and an approximate reinforcement learning (Neural Fitted Q Iteration) methods are used to model time-extended decisions of pilots with 2D and 3D maneuvers. An analysis of UAS integration is conducted using example scenarios in the presence of manned aircraft and fully autonomous UAS equipped with sense and avoid algorithms.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑