arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2101.12501cs.ROcs.AIcs.LGcs.SYeess.SYmath.OC
收藏

阵风作用下MAV的学习与无模型自适应控制

Learning-based vs Model-free Adaptive Control of a MAV under Wind Gust

ENSTA Bretagne(法国布列塔尼国立高等先进技术学院);Flinders University(弗林德斯大学);ONERA(法国航空航天研究院);Université Paris-Saclay(巴黎萨克雷大学)

Thomas Chaffre, Julien Moras, Adrien Chan-Hon-Tong, Julien Marzat, Karl Sammut, Gilles Le Chenadec, Benoit Clement

摘要:

未知变化条件下的导航问题是控制领域中最重要和研究最多的问题之一。经典的基于模型的自适应控制方法只能在提供了一个方便的工厂或环境模型时才能应用。最近的无模型自适应控制方法旨在通过直接从传感器反馈学习工厂和/或过程的物理特性来消除这种依赖性。虽然已经有以前的尝试,在改善这些技术,它仍然是一个悬而未决的问题,是否有可能应付现实世界中的不确定性的控制系统,是完全基于任一范例。我们提出了一种概念上简单的基于学习的方法,由一个完整的状态反馈控制器组成,通过基于Soft Actor-Critic算法的深度强化学习框架进行鲁棒调整。我们比较它,在现实的模拟,无模型控制器,使用相同的深度强化学习框架下控制的微型飞行器阵风。结果表明,基于学习的自适应控制方法在现代动态系统中的巨大潜力。

英文摘要:

Navigation problems under unknown varying conditions are among the most important and well-studied problems in the control field. Classic model-based adaptive control methods can be applied only when a convenient model of the plant or environment is provided. Recent model-free adaptive control methods aim at removing this dependency by learning the physical characteristics of the plant and/or process directly from sensor feedback. Although there have been prior attempts at improving these techniques, it remains an open question as to whether it is possible to cope with real-world uncertainties in a control system that is fully based on either paradigm. We propose a conceptually simple learning-based approach composed of a full state feedback controller, tuned robustly by a deep reinforcement learning framework based on the Soft Actor-Critic algorithm. We compare it, in realistic simulations, to a model-free controller that uses the same deep reinforcement learning framework for the control of a micro aerial vehicle under wind gust. The results indicate the great potential of learning-based adaptive control methods in modern dynamical systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑