多智能体强化学习中的知识、信息和代理价值评估:智能建筑案例研究
Valuing knowledge, information and agency in Multi-agent Reinforcement Learning: a case study in smart buildings
摘要:
提高建筑物的能源效率可以大幅降低成本和排放。从历史上看,这一直被视为一个局部或单代理优化问题。然而,许多建筑物使用相同类型的热设备,例如电加热器和热水容器。在操作期间,这些建筑物中的居住者与设备不同地交互,从而将它们驱动到状态空间中的不同区域。强化学习代理可以从记录为传感器数据的这些交互中学习,以优化整体能效。然而,如果这些代理人在家庭层面上单独运作,他们就不能利用问题中的复制结构。在本文中,我们证明了这个问题确实可以受益于多智能体协作利用有针对性的探索允许更好的推广的状态空间。我们还研究了整合人类知识和额外传感器之间的权衡。结果表明,节省40%以上的协同多智能体系统利用专家知识或额外的传感器,而不会损失乘员的舒适度是可能的。我们发现,这样的多代理系统舒适优于可比的单代理系统。
英文摘要:
Increasing energy efficiency in buildings can reduce costs and emissions substantially. Historically, this has been treated as a local, or single-agent, optimization problem. However, many buildings utilize the same types of thermal equipment e.g. electric heaters and hot water vessels. During operation, occupants in these buildings interact with the equipment differently thereby driving them to diverse regions in the state-space. Reinforcement learning agents can learn from these interactions, recorded as sensor data, to optimize the overall energy efficiency. However, if these agents operate individually at a household level, they can not exploit the replicated structure in the problem. In this paper, we demonstrate that this problem can indeed benefit from multi-agent collaboration by making use of targeted exploration of the state-space allowing for better generalization. We also investigate trade-offs between integrating human knowledge and additional sensors. Results show that savings of over 40% are possible with collaborative multi-agent systems making use of either expert knowledge or additional sensors with no loss of occupant comfort. We find that such multi-agent systems comfortably outperform comparable single agent systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。