arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.04503eess.SYcs.SY
收藏

不确定非线性系统的数据驱动鲁棒强化学习控制:迈向全自动、基于胰岛素的人工胰腺

Data-Driven Robust Reinforcement Learning Control of Uncertain Nonlinear Systems: Towards a Fully-Automated, Insulin-Based Artificial Pancreas

Alexandros Tanzanakis, John Lygeros

AI总结:

本文提出数据驱动的鲁棒强化学习λ-Policy Iteration跟踪控制方法,并通过DMMS.R模拟器验证其在全自动胰岛素闭环血糖控制中的优越性能。

摘要:

本文针对一类受未知有界不确定性影响的通用离散时间非线性系统,提出了一种新颖的鲁棒跟踪控制方案。通过在标称系统未知的情况下求解一个参数化最优跟踪控制问题并采用合适的代价函数,所得最优跟踪控制策略能够通过使原始不确定非线性系统获得足够小的跟踪误差来确保闭环稳定性。最优跟踪控制器的计算通过推导一种新颖的基于Q函数的λ-Policy Iteration算法完成。所提算法不仅具备严格的理论保证,还避免了传统强化学习方法的技术缺陷。通过采用数据驱动、仅评价器(critic-only)最小二乘实现,该算法在被诊断为1型和2型糖尿病患者的全自动、基于胰岛素的闭环血糖控制问题上进行了性能评估。研究使用Epsilon Group提供、获美国FDA认可的DMMS.R模拟器,在完全未预告进餐和运动的设置下,对大量虚拟受试者开展了全面的在硅临床实验。仿真结果突出表明,所推导方法实现了优越的血糖调控行为,并且在为个性化医疗设计高效闭环给药系统方面已整体成熟。

英文摘要:

In this paper, a novel robust tracking control scheme for a general class of discrete-time nonlinear systems affected by unknown bounded uncertainty is presented. By solving a parameterized optimal tracking control problem subject to the unknown nominal system and a suitable cost function, the resulting optimal tracking control policy can ensure closed-loop stability by achieving a sufficiently small tracking error for the original uncertain nonlinear system. The computation of the optimal tracking controller is accomplished through the derivation of a novel Q-function-based $λ$-Policy Iteration algorithm. The proposed algorithm not only enjoys rigorous theoretical guarantees, but also avoids technical weaknesses of conventional reinforcement learning methods. By employing a data-driven, critic-only least squares implementation, the performance of the proposed algorithm is evaluated to the problem of fully-automated, insulin-based, closed-loop glucose control for patients diagnosed with Type 1 and Type 2 Diabetes Mellitus. The U.S. FDA-accepted DMMS.R simulator from the Epsilon Group is used to conduct a comprehensive in silico clinical campaign on a rich set of virtual subjects under completely unannounced meal and exercise settings. Simulation results underline the superior glycaemic behavior achieved by the derived approach, as well as its overall maturity for the design of highly-effective, closed-loop drug delivery systems for personalized medicine.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑