arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2611.06338cs.LGcs.AI
收藏

基于有偏梯度的调参学习:节气门无模型控制的迭代反馈调谐

Learning to Tune with Biased Gradients: Iterative Feedback Tuning of Model-Free Control on Throttle Valves

Univ. Grenoble Alpes, CNRS, GIPSA-lab(格勒诺布尔阿尔卑斯大学,法国国家科学研究中心,GIPSA实验室)

Félix Martinez-Jiménez, Sander Miller-Murphy, Tobie Ondoa-Essomba, Emmanuel Witrant

AI总结:

该研究针对节气门无模型控制的迭代反馈调谐存在的梯度有偏问题,分析误差来源,在数字孪生和硬件节气门上测试不同更新规则,发现梯度噪声结构决定最佳规则,数字孪生可重现机制但无法复现硬件上的性能排名。

摘要:

迭代反馈调谐(IFT)通过随机梯度下降学习固定结构控制器的参数。在每次迭代中,会在被控对象上运行两次闭环实验:第一次测量跟踪误差,第二次由该误差驱动,提供用于估计代价梯度的灵敏度。该估计仅对线性被控对象无偏。我们研究汽车电子节气门的有偏情况,其摩擦和静摩擦在不同节气门及运行间存在差异,由智能比例(无模型)控制器控制,该控制器为增量式PI控制器。我们发现,两次实验开始时控制器状态的不匹配(由静摩擦导致不可避免)会产生与第二次实验幅度成反比的误差。在10个节气门的数字孪生模型上,IFT梯度仅在69%的低成本区域为下降方向,摩擦是原因,所有更新规则均会达到平台后发生漂移。在两个硬件节气门中,最佳更新规则取决于梯度的噪声结构。在第一个节气门中,一个梯度分量被噪声掩盖,Adam优于高斯-牛顿法,其归一化和动量各优化一个参数。在第二个节气门中,两个分量均一致,相同的归一化会放大高斯-牛顿法正确忽略的方向,Adam会漂移到比初始控制器更差的状态。数字孪生模型重现了该机制,但未重现此排名。

英文摘要:

Iterative feedback tuning (IFT) learns the parameters of a fixed-structure controller by stochastic gradient descent. At each iteration, two closed-loop experiments are run on the plant: the first one measures the tracking error, and the second one, driven by this error, provides the sensitivities from which the gradient of the cost is estimated. This estimate is unbiased for linear plants only. We study the biased case on automotive electronic throttle valves, whose friction and stiction vary between valves and runs, controlled by an intelligent proportional (model-free) controller, which is an incremental PI controller. We show that the mismatch of the controller state at the start of the two experiments, which stiction makes unavoidable, adds an error inversely proportional to the amplitude of the second experiment. On digital twins of ten valves, the IFT gradient is a descent direction in only 69\% of the low-cost region, friction being the cause, and all update rules plateau and then drift. On two hardware valves, the best update rule depends on the noise structure of the gradient. On the first valve, where one gradient component is buried in noise, Adam outperforms Gauss--Newton, its normalisation and its momentum each improving one parameter. On the second valve, where both components are consistent, the same normalisation amplifies a direction that Gauss--Newton rightly discounts, and Adam drifts to a controller worse than the initial one. The twins reproduce the mechanism but not this ranking.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑