arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2302.11835cs.LGcs.AIcs.MAecon.GNq-fin.EC
收藏

强化学习用于在经济 ABM 校准中组合搜索方法

Reinforcement Learning for Combining Search Methods in the Calibration of Economic ABMs

Università Cattolica del Sacro Cuore(圣心天主教大学);Universität Bielefeld(比勒费尔德大学)

Aldo Glielmo, Marco Favorito, Debmallya Chanda, Domenico Delli Gatti

AI总结:

针对宏观经济 ABM 校准的高维无导数搜索问题,提出用强化学习在运行中动态选择并组合搜索方法,性能优于固定方法及人工组合。

摘要:

在经济学和金融学中校准基于智能体的模型(ABMs)通常涉及在非常大的参数空间中进行无导数搜索。在本研究中,我们在真实数据上对一个著名宏观经济 ABM 的校准过程中的多种搜索方法进行基准测试,并进一步评估通过组合不同方法形成的“混合策略”的性能。我们发现,基于随机森林代理模型的方法尤其高效,而且组合搜索方法通常会提升性能,因为任一单一方法的偏差都会得到缓解。基于这些观察,我们提出一种强化学习(RL)方案,用于在校准运行期间自动、即时地选择和组合搜索方法。RL 智能体只有在某一特定方法持续表现良好时才会继续利用该方法,而当该特定方法达到性能平台期时,则会探索新策略。由此产生的 RL 搜索方案优于所测试的任何其他方法或方法组合,并且不依赖任何先验信息或试错过程。

英文摘要:

Calibrating agent-based models (ABMs) in economics and finance typically involves a derivative-free search in a very large parameter space. In this work, we benchmark a number of search methods in the calibration of a well-known macroeconomic ABM on real data, and further assess the performance of "mixed strategies" made by combining different methods. We find that methods based on random-forest surrogates are particularly efficient, and that combining search methods generally increases performance since the biases of any single method are mitigated. Moving from these observations, we propose a reinforcement learning (RL) scheme to automatically select and combine search methods on-the-fly during a calibration run. The RL agent keeps exploiting a specific method only as long as this keeps performing well, but explores new strategies when the specific method reaches a performance plateau. The resulting RL search scheme outperforms any other method or method combination tested, and does not rely on any prior information or trial and error procedure.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑