arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.02741cs.GTcs.LG
收藏

具有状态约束和单边信息的零和微分博弈

State-Constrained Zero-Sum Differential Games with One-Sided Information

Arizona State University(亚利桑那州立大学)

Mukesh Ghimire, Lei Zhang, Zhe Xu, Yi Ren

AI总结:

研究具有状态约束和单边信息的零和微分博弈,扩展了无约束博弈的值存在性结论,推导了计算行为策略的子动态原理,并揭示了信念操纵策略的底层结构。

摘要:

我们研究具有状态约束和单边信息的零和微分博弈,其中知情玩家(Player 1)拥有一个未知于非知情玩家(Player 2)的分类收益类型。Player 1 的目标是在不违反约束的情况下最小化其收益,而 Player 2 的目标则是尽可能违反状态约束,或在无法违反时最大化收益。此类博弈的一个例子是足球中的一对一对抗。在没有状态约束的情况下,Cardaliaguet(2007)证明了此类博弈的值存在,且对于玩家的共同信念是凸的。我们的理论贡献是将该结果扩展到具有状态约束的博弈中,并推导出计算行为策略所需的原始和对偶子动态原理。与关注离散动态博弈中无悔学习可扩展性的现有研究不同,我们的研究揭示了由信息不对称和状态约束导致的信念操纵策略的底层结构。该结构对于在具有连续动作和长时间窗口的博弈上进行可扩展学习是必要的。我们使用一个简化的足球博弈来展示本研究的实用性,其中我们揭示了进攻方应该(或不应该)采取特定随机欺骗动作以利用信息不对称的球员位置和信念状态,并计算防守方应如何应对。

英文摘要:

We study zero-sum differential games with state constraints and one-sided information, where the informed player (Player 1) has a categorical payoff type unknown to the uninformed player (Player 2). The goal of Player 1 is to minimize his payoff without violating the constraints, while that of Player 2 is to violate the state constraints if possible, or to maximize the payoff otherwise. One example of the game is a man-to-man matchup in football. Without state constraints, Cardaliaguet (2007) showed that the value of such a game exists and is convex to the common belief of players. Our theoretical contribution is an extension of this result to games with state constraints and the derivation of the primal and dual subdynamic principles necessary for computing behavioral strategies. Different from existing works that are concerned about the scalability of no-regret learning in games with discrete dynamics, our study reveals the underlying structure of strategies for belief manipulation resulting from information asymmetry and state constraints. This structure will be necessary for scalable learning on games with continuous actions and long time windows. We use a simplified football game to demonstrate the utility of this work, where we reveal player positions and belief states in which the attacker should (or should not) play specific random deceptive moves to take advantage of information asymmetry, and compute how the defender should respond.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑