arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2305.01124cs.AIcs.GTcs.HC
收藏

人类对自适应机器的适应会收敛至博弈论均衡

Human adaptation to adaptive machines converges to game-theoretic equilibria

University of Washington(华盛顿大学)

Benjamin J. Chasnov, Lillian J. Ratliff, Samuel A. Burden

AI总结:

本研究通过实证测试人机一般和博弈中的机器学习算法,发现算法可直接基于人类行为观测引导互动收敛至机器最优的博弈论均衡,验证了博弈论在人机共适应互动结果预测与设计中的作用。

摘要:

从认知决策到物理设备辅助,自适应机器有潜力在多种场景下协助或干扰人类行为。因此,理解机器学习算法如何影响人类行为至关重要,尤其是在机器目标与人类目标不一致的情境中。由于人类会结合外显和内隐策略持续适应环境,当环境中存在自适应机器时,人与机器就构成了一场博弈。博弈论是用于建模两个及以上决策者之间互动的成熟框架,已被广泛应用于经济市场和机器算法领域。然而,现有方法多是对人类个体的适应如何受与自适应机器互动的影响做出假设,而非通过实证检验。\n本文测试了机器与人类受试者进行一般和博弈时的学习算法。我们的算法使机器能够从行动空间和策略空间的一系列博弈论均衡中,选择共同适应互动的结果。重要的是,这些机器学习算法可直接基于对人类行为的观测运行,无需像以往研究那样通过求解逆问题来估计人类的效用函数。令人意外的是,其中一种算法可以将人机互动导向机器的最优结果,即便人类会针对其感知到的成本格局做出最优响应,该算法仍能有效控制人类的行为。我们的研究结果表明,博弈论可用于预测和设计智能人类与机器之间共同适应互动的结果。

英文摘要:

Adaptive machines have the potential to assist or interfere with human behavior in a range of contexts, from cognitive decision-making to physical device assistance. Therefore it is critical to understand how machine learning algorithms can influence human actions, particularly in situations where machine goals are misaligned with those of people. Since humans continually adapt to their environment using a combination of explicit and implicit strategies, when the environment contains an adaptive machine, the human and machine play a game. Game theory is an established framework for modeling interactions between two or more decision-makers that has been applied extensively in economic markets and machine algorithms. However, existing approaches make assumptions about, rather than empirically test, how adaptation by individual humans is affected by interaction with an adaptive machine. Here we tested learning algorithms for machines playing general-sum games with human subjects. Our algorithms enable the machine to select the outcome of the co-adaptive interaction from a constellation of game-theoretic equilibria in action and policy spaces. Importantly, the machine learning algorithms work directly from observations of human actions without solving an inverse problem to estimate the human's utility function as in prior work. Surprisingly, one algorithm can steer the human-machine interaction to the machine's optimum, effectively controlling the human's actions even while the human responds optimally to their perceived cost landscape. Our results show that game theory can be used to predict and design outcomes of co-adaptive interactions between intelligent humans and machines.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑