面向联合警察巡逻与调度的多智能体强化学习
Multi-Agent Reinforcement Learning for Joint Police Patrol and Dispatch
AI总结:
本文提出一种异构多智能体强化学习方法,将每个巡逻员建模为共享深度Q网络的独立智能体,并用混合整数规划处理调度决策,实现巡逻与调度的联合优化,从而提升响应效率与公平性。
摘要:
警察巡逻单位需要在执行预防性巡逻和被派遣处理紧急事件之间分配时间。在现有文献中,巡逻与调度决策通常被分开研究。我们考虑对这两类决策进行联合优化,以提高警察运营效率并缩短紧急呼叫的响应时间。方法/结果:我们提出一种新方法,用于联合优化多智能体巡逻与调度,以学习能够产生快速响应时间的策略。我们的方法将每个巡逻员视为独立的Q学习智能体,并共享一个表示状态-动作价值的深度Q网络。调度决策通过混合整数规划和组合动作空间中的价值函数近似来选择。我们证明,这种异构多智能体强化学习方法能够学习到优于仅针对巡逻或仅针对调度进行优化的联合策略。管理启示:针对巡逻与调度联合优化的策略可以在实现更有效服务的同时,针对可证明的灵活目标进行优化,例如鼓励响应效率与公平性的目标。
英文摘要:
Police patrol units need to split their time between performing preventive patrol and being dispatched to serve emergency incidents. In the existing literature, patrol and dispatch decisions are often studied separately. We consider joint optimization of these two decisions to improve police operations efficiency and reduce response time to emergency calls. Methodology/results: We propose a novel method for jointly optimizing multi-agent patrol and dispatch to learn policies yielding rapid response times. Our method treats each patroller as an independent Q-learner (agent) with a shared deep Q-network that represents the state-action values. The dispatching decisions are chosen using mixed-integer programming and value function approximation from combinatorial action spaces. We demonstrate that this heterogeneous multi-agent reinforcement learning approach is capable of learning joint policies that outperform those optimized for patrol or dispatch alone. Managerial Implications: Policies jointly optimized for patrol and dispatch can lead to more effective service while targeting demonstrably flexible objectives, such as those encouraging efficiency and equity in response.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。