arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1409.4561cs.MA
收藏

动态不确定环境下的分散式多智能体强化学习

Decentralised Multi-Agent Reinforcement Learning for Dynamic and Uncertain Environments

Andrei Marinescu, Ivana Dusparic, Adam Taylor, Vinny Cahill, Siobhán Clarke

摘要:

多智能体强化学习(MARL)是一种广泛用于分散控制问题优化的技术。然而,MARL的应用大多数是在静态环境中,而不适合当代理人的行为和环境条件是动态的和不确定的。在这样的环境中解决不确定性仍然是一个具有挑战性的问题,基于MARL的系统。环境的动态性质导致以前的知识如何代理交互变得过时。通过预测潜在变化的先进知识显著支持代理收敛到接近最优控制解决方案。在本文中,我们提出了P-MARL,一个分散的MARL算法增强了预测机制,提供准确的信息,即将到来的变化,在环境中。这种预测是通过采用人工神经网络与自组织地图相结合来实现的,该自组织地图检测并匹配环境中的变化。该算法在一个现实的智能电网的情况下进行了验证,并提供了一个92%的帕累托有效的解决方案,电动汽车充电问题。

英文摘要:

Multi-Agent Reinforcement Learning (MARL) is a widely used technique for optimization in decentralised control problems. However, most applications of MARL are in static environments, and are not suitable when agent behaviour and environment conditions are dynamic and uncertain. Addressing uncertainty in such environments remains a challenging problem for MARL-based systems. The dynamic nature of the environment causes previous knowledge of how agents interact to become outdated. Advanced knowledge of potential changes through prediction significantly supports agents converging to near-optimal control solutions. In this paper we propose P-MARL, a decentralised MARL algorithm enhanced by a prediction mechanism that provides accurate information regarding up-coming changes in the environment. This prediction is achieved by employing an Artificial Neural Network combined with a Self-Organising Map that detects and matches changes in the environment. The proposed algorithm is validated in a realistic smart-grid scenario, and provides a 92% Pareto efficient solution to an electric vehicle charging problem.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑