arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2004.07625cs.MA
收藏

我应该把这堵墙拆掉吗?通过评估新行为优化社交指标

Should I tear down this wall? Optimizing social metrics by evaluating novel actions

János Kramár, Neil Rabinowitz, Tom Eccles, Andrea Tacchetti

摘要:

治理的基本挑战之一是决定何时以及如何干预多代理系统,以影响整个集团的成功指标。当拟议的干预措施新颖而昂贵时,这尤其具有挑战性。例如,人们可能希望修改建筑物的布局以提高其逃生路线的效率。评估这种干预措施通常需要使用精心制作的模拟器,模拟器必须针对每个环境专门构建,并且可能成本高昂或不准确。这里我们研究一个简单的替代方案:通过观察外推优化(OBOE)。其想法是在没有任何干预的情况下使用观察到的行为轨迹来学习将环境状态映射到个体代理结果的预测模型,然后使用这些模型来评估和选择变化。我们评估OBOE在社会复杂的gridworld环境中,并考虑新的物理干预,我们的模型没有trainedon.We表明,神经网络模型训练,以预测代理回报基线环境中的干预措施是有效的选择。因此,OBOE可以为具有挑战性的问题提供指导,例如:“为了最小化这个群体的基尼指数,我应该拆除哪堵墙?"

英文摘要:

One of the fundamental challenges of governance is deciding when and how to intervene in multi-agent systems in order to impact group-wide metrics of success. This is particularly challenging when proposed interventions are novel and expensive. For example, one may wish to modify a building's layout to improve the efficiency of its escape route. Evaluating such interventions would generally require access to an elaborate simulator, which must be constructed ad-hoc for each environment, and can be prohibitively costly or inaccurate. Here we examine a simple alternative: Optimize By Observational Extrapolation (OBOE). The idea is to use observed behavioural trajectories, without any interventions, to learn predictive models mapping environment states to individual agent outcomes, and then use these to evaluate and select changes. We evaluate OBOE in socially complex gridworld environments and consider novel physical interventions that our models were not trained on. We show that neural network models trained to predict agent returns on baseline environments are effective at selecting among the interventions. Thus, OBOE can provide guidance for challenging questions like: "which wall should I tear down in order to minimize the Gini index of this group?"

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑