随机环境中资源驱动的受限Agent任务阶段划分技术
Resource-Driven Mission-Phasing Techniques for Constrained Agents in Stochastic Environments
摘要:
由于代理资源决定了它可能采取的行动,因此它应该仔细计划它在一段时间内拥有哪些资源,考虑其固有的限制(例如功率或有效载荷限制),其他代理对相同资源的竞争需求以及环境的随机性。一般来说,如果这些代理人能够利用甚至创造机会来改变他们在不同时间拥有的资源,他们就可以实现更多的目标。在资源约束的驱动下,智能体可以将其整体任务分解为一系列最优阶段,在每个阶段最优地重新配置其资源,并在每个阶段最优地使用其分配的资源,给定其随机环境的知识。在本文中,我们正式定义和分析这一约束,顺序优化问题的单代理和多代理上下文中。我们提出了一个家庭的混合整数线性规划(MILP)配方的这个问题,可以最佳地创建阶段(当阶段没有预定义)会计阶段创建的成本和限制。因为我们的公式multimedia也找到了在每个阶段的资源的最佳分配和在每个阶段使用分配的资源的最佳策略,他们利用这些耦合问题的结构。这使他们能够找到解决方案显着更快(在较大的问题更快的数量级)比其他解决方案的技术,我们证明经验。
英文摘要:
Because an agents resources dictate what actions it can possibly take, it should plan which resources it holds over time carefully, considering its inherent limitations (such as power or payload restrictions), the competing needs of other agents for the same resources, and the stochastic nature of the environment. Such agents can, in general, achieve more of their objectives if they can use --- and even create --- opportunities to change which resources they hold at various times. Driven by resource constraints, the agents could break their overall missions into an optimal series of phases, optimally reconfiguring their resources at each phase, and optimally using their assigned resources in each phase, given their knowledge of the stochastic environment. In this paper, we formally define and analyze this constrained, sequential optimization problem in both the single-agent and multi-agent contexts. We present a family of mixed integer linear programming (MILP) formulations of this problem that can optimally create phases (when phases are not predefined) accounting for costs and limitations in phase creation. Because our formulations multaneously also find the optimal allocations of resources at each phase and the optimal policies for using the allocated resources at each phase, they exploit structure across these coupled problems. This allows them to find solutions significantly faster(orders of magnitude faster in larger problems) than alternative solution techniques, as we demonstrate empirically.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。