arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1303.2987eess.SYcs.SYmath.OC
收藏

基于批量模式强化学习的周期性参考跟踪及其在基因调控网络控制中的应用

On Periodic Reference Tracking Using Batch-Mode Reinforcement Learning with Application to Gene Regulatory Network Control

Imperial College London(帝国理工学院);Boehringer-Ingelheim Pharma GmbH & Co KG.(勃林格殷格翰制药);University of Liège(列日大学)

Aivar Sootla, Natalja Strelkowa, Damien Ernst, Mauricio Barahona, Guy-Bart Stan

AI总结:

本文扩展了批量模式强化学习算法Fitted Q Iteration,利用参考轨迹的未来值和周期性先验知识,解决周期性参考跟踪问题,并在合成生物学基因调控网络广义抑制子中验证了其有效性。

摘要:

本文在批量模式强化学习框架下考虑周期性参考跟踪问题,该框架研究仅从一组轨迹的知识求解最优控制问题的方法。具体地,我们将现有的批量模式强化学习算法(称为Fitted Q Iteration)扩展到周期性参考跟踪问题。所提出的周期性参考跟踪算法显式利用了参考轨迹未来值及其周期性的先验知识。我们讨论了该方法的特点,并在一个称为广义抑制子的合成生物学基因调控网络的参考跟踪问题上进行了说明。该系统能产生衰减但持久的振荡,使其成为跟踪问题的一个有趣系统。在配套论文中,我们还研究了切换开关系统的调节问题,其主要目标是将系统状态驱动到状态空间中的特定有界区域。

英文摘要:

In this paper, we consider the periodic reference tracking problem in the framework of batch-mode reinforcement learning, which studies methods for solving optimal control problems from the sole knowledge of a set of trajectories. In particular, we extend an existing batch-mode reinforcement learning algorithm, known as Fitted Q Iteration, to the periodic reference tracking problem. The presented periodic reference tracking algorithm explicitly exploits a priori knowledge of the future values of the reference trajectory and its periodicity. We discuss the properties of our approach and illustrate it on the problem of reference tracking for a synthetic biology gene regulatory network known as the generalised repressilator. This system can produce decaying but long-lived oscillations, which makes it an interesting system for the tracking problem. In our companion paper we also take a look at the regulation problem of the toggle switch system, where the main goal is to drive the system's states to a specific bounded region in the state space.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑