arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2404.03054cs.AIcs.LG
收藏

面向通用行为智能体的机器学习目标识别设计

Goal Recognition Design for General Behavioral Agents using Machine Learning

Washington University in Saint Louis(华盛顿大学圣路易斯分校);Technion – Israel Institute of Technology(技术学院-以色列理工学院)

Robert Kasumba, Guanghui Yu, Chien-Ju Ho, Sarah Keren, William Yeoh

AI总结:

针对现有目标识别设计方法计算成本高、仅适配最优决策智能体的问题,提出基于机器学习的方法,通过预测最坏情况区分度并结合梯度优化框架优化环境,在降低区分度、提升效率的同时适配复杂场景,且经人类实验验证有效。

摘要:

目标识别设计(GRD)旨在对决策环境进行有限修改,以便更轻松地推断在这些环境中行动的智能体的目标。尽管目标识别设计领域已开展诸多研究,但现有方法计算成本高昂,且通常假设智能体的决策是(接近)最优的。为解决这些局限,我们将机器学习方法应用于目标识别设计,既能提升运行时效率,又能适配具有通用行为模型的智能体。\n遵循现有文献,我们采用最坏情况区分度(wcd)作为衡量决策环境中智能体目标推断难度的指标。我们的方法首先训练一个机器学习模型,用于预测给定环境和智能体行为模型下的wcd。随后,我们提出一种基于梯度的优化框架,该框架可适配多种约束,通过优化决策环境提升目标识别效果。\n通过大量仿真实验,我们证明所提方法在降低wcd方面优于现有方法,且提升了运行时效率。此外,我们的方法还能适配现有方法无法应用的场景,例如涉及灵活预算约束、更复杂环境以及次优智能体行为的场景。最后,我们开展了人类受试者实验,结果表明我们的方法所构建的环境能够助力高效识别人类决策者的目标。

英文摘要:

Goal recognition design (GRD) aims to make limited modifications to decision-making environments to make it easier to infer the goals of agents acting within those environments. Although various research efforts have been made in goal recognition design, existing approaches are computationally demanding and often assume that agents are (near-)optimal in their decision-making. To address these limitations, we leverage machine learning methods for goal recognition design that can both improve run-time efficiency and account for agents with general behavioral models. Following existing literature, we use worst-case distinctiveness (wcd) as a measure of the difficulty in inferring the goal of an agent in a decision-making environment. Our approach begins by training a machine learning model to predict the wcd for a given environment and the agent behavior model. We then propose a gradient-based optimization framework that accommodates various constraints to optimize decision-making environments for enhanced goal recognition. Through extensive simulations, we demonstrate that our approach outperforms existing methods in reducing wcd and enhances runtime efficiency. Moreover, our approach also adapts to settings in which existing approaches do not apply, such as those involving flexible budget constraints, more complex environments, and suboptimal agent behavior. Finally, we conducted human-subject experiments that demonstrate that our method creates environments that facilitate efficient goal recognition from human decision-makers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑