A Game Theoretical Framework for the Evaluation of Unmanned Aircraft Systems Airspace Integration Concepts
Negin Musavi
备注:
This thesis is submitted in partial fulfillment of the requirements for the degree of Master of Science in Mechanical Engineering in the Graduate School of Engineering and Science of Bilkent University. http://repository.bilkent.edu.tr/handle/11693/33526
Predicting the outcomes of integrating Unmanned Aerial Systems (UAS) into the National Aerospace (NAS) is a complex problem which is required to be addressed by simulation studies before allowing the routine access of UAS into the NAS. This thesis focuses on providing 2D and 3D simulation frameworks using a game theoretical methodology to evaluate integration concepts in scenarios where manned and unmanned air vehicles co-exist. The fundamental gap in the literature is that the models of interaction between manned and unmanned vehicles are insufficient: a) they assume that pilot behavior is known a priori and b) they disregard decision making processes. The contribution of this work is to propose a modeling framework, in which, human pilot reactions are modeled using reinforcement learning and a game theoretical concept called level-k reasoning to fill this gap. The level-k reasoning concept is based on the assumption that humans have various levels of decision making. Reinforcement learning is a mathematical learning method that is rooted in human learning. In this work, a classical and an approximate reinforcement learning (Neural Fitted Q Iteration) methods are used to model time-extended decisions of pilots with 2D and 3D maneuvers. An analysis of UAS integration is conducted using example scenarios in the presence of manned aircraft and fully autonomous UAS equipped with sense and avoid algorithms.
Separation Assurance between Heterogeneous Fleets of Small Unmanned Aerial Systems via Multi-Agent Reinforcement Learning
Department of Mechanical and Aerospace Engineering, George Washington University(机械与航空航天工程系,乔治华盛顿大学);Department of Electrical and Computer Engineering, Purdue University(电气与计算机工程系,普渡大学)
Language Conditioning Improves Accuracy of Aircraft Goal Prediction in Non-Towered Airspace
Georgia Institute of Technology(佐治亚理工学院);School of Aerospace Engineering(航空航天工程学院);School of Electrical and Computer Engineering(电气与计算机工程学院);School of Mechanical Engineering(机械工程学院)
Toward Increased Airspace Safety: Quadrotor Guidance for Targeting Aerial Objects
Carnegie Mellon University(卡内基梅隆大学)
随着商用无人机(UAV)市场的蓬勃发展,在受保护或敏感空域中发现的小型遥控或自主飞机越来越多。移除这些飞机的现有解决方案要么是军用级的,对国内使用来说太具破坏性,要么是由在国内高调案例中被证明无效的令人不安的遥控反无人机车辆组成。在这项工作中,我们研究了使用四旋翼自主瞄准半静止和移动的空中物体,很少或没有先验知识的目标的飞行特性。制导和控制命令仅由机载单目摄像机提供的信息生成。我们从文献中的导弹制导的灵感,并证明了最佳的制导方法实施的四旋翼,但不能使用的导弹。结果首次通过命中成功和追求持续时间与各种方法。最后,我们介绍了CMU Team Tartan在MBZIRC 2020挑战1比赛中的参赛作品,展示了简单的视线引导方法在结构化比赛环境中的有效性。
Reinforcement Learning-Based Air Traffic Deconfliction
Boeing Research & Technology(波音研究与技术部);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校)
保持良好净空(Remain Well Clear)是无人驾驶航空器在拥挤空域中安全运行的关键技术,它通过适当的间隔距离使航空器远离危险。这项工作的重点是自动化的水平分离的两个飞机,并提出了避障问题作为一个二维代理优化任务。通过我们的设计,代理任务是更保守的,以保证在主域中的解决方案的执行。使用强化学习(RL),我们优化了回避策略,并对动态、交互和决策进行建模。通过递归地采样产生的策略和代理转换,系统将回避策略转换为完整的回避轨迹。然后,求解器使用Robot操作系统(ROS)界面将轨迹发布为飞机要遵循的一组航路点。所提出的系统生成一个快速和可实现的回避轨迹,满足安全要求。我们的系统的评估是在高保真仿真和全尺寸飞机演示完成的。此外,本文得出结论,一个巨大的集成努力,使现实生活中的基于RL的系统演示。