arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2211.17013cs.LG
收藏

利用强化学习探索气候变化政策

Climate Change Policy Exploration using Reinforcement Learning

Theodore Wolf

摘要:

气候变化是人类面临的一个非常复杂的问题。当许多变量相互作用时,人类很难掌握气候变化这一大规模问题的原因和影响。气候是一个动态系统,从长远来看,微小的变化可能产生巨大和不可预测的影响。了解如何以正确的方式推动这一系统可以帮助我们找到应对气候变化的创造性解决方案。在这项研究中,我们将深度强化学习和世界-地球系统模型相结合,以找到并解释可持续未来的创造性策略。这是Strnad等人工作的延伸,我们通过采取多个方向扩展了方法和分析。我们使用四个不同的强化学习代理不同的复杂性,以不同的方式探测环境,并找到各种策略。环境是一个低复杂度的世界地球系统模型,其目标是通过制定不同的政策,实现所有经济能源都由可再生能源生产的未来。我们使用一个基于行星边界的奖励函数,我们修改该函数以迫使智能体找到更广泛的策略。为了支持适用性,我们稍微修改了环境,通过注入噪声并使其完全可观察,以了解这些因素对智能体学习的影响。

英文摘要:

Climate Change is an incredibly complicated problem that humanity faces. When many variables interact with each other, it can be difficult for humans to grasp the causes and effects of the very large-scale problem of climate change. The climate is a dynamical system, where small changes can have considerable and unpredictable repercussions in the long term. Understanding how to nudge this system in the right ways could help us find creative solutions to climate change. In this research, we combine Deep Reinforcement Learning and a World-Earth system model to find, and explain, creative strategies to a sustainable future. This is an extension of the work from Strnad et al. where we extend on the method and analysis, by taking multiple directions. We use four different Reinforcement Learning agents varying in complexity to probe the environment in different ways and to find various strategies. The environment is a low-complexity World Earth system model where the goal is to reach a future where all the energy for the economy is produced by renewables by enacting different policies. We use a reward function based on planetary boundaries that we modify to force the agents to find a wider range of strategies. To favour applicability, we slightly modify the environment, by injecting noise and making it fully observable, to understand the impacts of these factors on the learning of the agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑