基于频率的异构Agent有限通信巡逻
Frequency-Based Patrolling with Heterogeneous Agents and Limited Communication
摘要:
本文研究了多智能体基于频率的巡逻相交,圆图的条件下,图节点有非均匀的访问要求和代理有有限的通信能力。该任务被建模为一个部分可观测的马尔可夫决策过程,并开发了一个强化学习解决方案。每个代理从马尔可夫链中生成自己的策略,只有当代理占用相同或相邻的节点时才交换策略。这种对策略交换的约束对大型非结构化环境中的稀疏通信条件进行建模。实证研究结果提供了收敛特性,代理合作,学习巡逻政策的泛化到新的任务实例的观点。紧急的行为表明,异构代理之间的巡逻大型,非结构化的区域,以及概括的能力,以动态变化的节点访问要求的协调策略。
英文摘要:
This paper investigates multi-agent frequencybased patrolling of intersecting, circle graphs under conditions where graph nodes have non-uniform visitation requirements and agents have limited ability to communicate. The task is modeled as a partially observable Markov decision process, and a reinforcement learning solution is developed. Each agent generates its own policy from Markov chains, and policies are exchanged only when agents occupy the same or adjacent nodes. This constraint on policy exchange models sparse communication conditions over large, unstructured environments. Empirical results provide perspectives on convergence properties, agent cooperation, and generalization of learned patrolling policies to new instances of the task. The emergent behavior indicates learned coordination strategies between heterogeneous agents for patrolling large, unstructured regions as well as the ability to generalize to dynamic variation in node visitation requirements.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。