arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2501.06181eess.SYcs.SYmath.OC
收藏

具有部分和非对称信息的零和随机动态博弈的最优响应收敛性

Best Response Convergence for Zero-sum Stochastic Dynamic Games with Partial and Asymmetric Information

Yuxiang Guan, Iman Shames, Tyler H. Summers

AI总结:

针对部分非对称信息下的无限时域零和随机LQDG,论文研究最优响应迭代的快速收敛,并用高阶信念动态的可控性、可观测性衰减解释有限阶策略可近似Nash均衡。

摘要:

我们分析了用于求解具有部分和非对称信息的无限时域零和随机线性二次动态博弈(LQDG)Nash均衡的最优响应动态。我们在纯线性动态输出反馈控制策略类别内推导了每个参与者最优响应的显式表达式,其中每个控制策略的内部状态维数是系统状态维数的整数倍。随着每次最优响应,参与者形成越来越高阶的信念状态,从而产生无限维内部状态。然而,我们在大量数值实验中观察到,博弈的值仅在几次迭代后便收敛,这表明与越来越高阶信念状态相关的策略最终不再带来收益。为帮助解释这种收敛,我们的数值分析揭示了高阶信念动态中可控性和可观测性Gramian特征值以及Hankel奇异值的快速衰减,表明高阶信念动态对两个参与者而言都变得越来越难以控制和观测。因此,高阶信念动态可以由低阶信念动态以有界误差紧密近似,因而内部状态维数有限的反馈策略可以紧密近似一个Nash均衡。

英文摘要:

We analyze best response dynamics for finding a Nash equilibrium of an infinite horizon zero-sum stochastic linear quadratic dynamic game (LQDG) with partial and asymmetric information. We derive explicit expressions for each player's best response within the class of pure linear dynamic output feedback control strategies where the internal state dimension of each control strategy is an integer multiple of the system state dimension. With each best response, the players form increasingly higher-order belief states, leading to infinite-dimensional internal states. However, we observe in extensive numerical experiments that the game's value converges after just a few iterations, suggesting that strategies associated with increasingly higher-order belief states eventually provide no benefit. To help explain this convergence, our numerical analysis reveals rapid decay of the controllability and observability Gramian eigenvalues and Hankel singular values in higher-order belief dynamics, indicating that the higher-order belief dynamics become increasingly difficult for both players to control and observe. Consequently, the higher-order belief dynamics can be closely approximated by low-order belief dynamics with bounded error, and thus feedback strategies with limited internal state dimension can closely approximate a Nash equilibrium.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑