arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2105.10099econ.THecon.GNq-fin.EC
收藏

从零开始学习:如何使用AI算法在随机环境中做出消费节省决策

Learning from zero: how to make consumption-saving decisions in a stochastic environment with an AI algorithm

Rui, Shi

摘要:

本练习提出了一种学习机制,使用人工智能文献中的行动者-批评者结构来模拟经济主体的决策过程。它的动机是通过强化好或坏的决定来学习的心理学文献。在一个环境模型中,为了学习做出决策,这个人工智能主体需要与其环境进行交互并做出探索性的行动。给定状态下的每个动作都会给智能体带来一个奖励信号。这些交互经验保存在智能体的记忆中,然后用于更新其对世界的主观信念。智能体的决策策略的形成和调整的基础上不断演变的主观信念。这个智能体不仅采取它知道会带来高回报的行动,它还探索其他可能性。这是采取探索性行动的过程,它确保代理人注意到环境的变化,并相应地调整其主观信念和决策。通过一个随机最优增长模型,我说明了在这种学习结构下的经济主体是适应经济的基本随机过程的变化。人工智能代理的探索水平可能不同,这导致在相同的环境中有不同的体验。这反映了他们不同的学习行为和获得的福利。所选择的经济结构具有宏观经济模型的基本决策问题,即,如何在一生中做出节约消费的决定,它可以推广到其他决策过程和经济模型。

英文摘要:

This exercise proposes a learning mechanism to model economic agent's decision-making process using an actor-critic structure in the literature of artificial intelligence. It is motivated by the psychology literature of learning through reinforcing good or bad decisions. In a model of an environment, to learn to make decisions, this AI agent needs to interact with its environment and make explorative actions. Each action in a given state brings a reward signal to the agent. These interactive experience is saved in the agent's memory, which is then used to update its subjective belief of the world. The agent's decision-making strategy is formed and adjusted based on this evolving subjective belief. This agent does not only take an action that it knows would bring a high reward, it also explores other possibilities. This is the process of taking explorative actions, and it ensures that the agent notices changes in its environment and adapt its subjective belief and decisions accordingly. Through a model of stochastic optimal growth, I illustrate that the economic agent under this proposed learning structure is adaptive to changes in an underlying stochastic process of the economy. AI agents can differ in their levels of exploration, which leads to different experience in the same environment. This reflects on to their different learning behaviours and welfare obtained. The chosen economic structure possesses the fundamental decision making problems of macroeconomic models, i.e., how to make consumption-saving decisions in a lifetime, and it can be generalised to other decision-making processes and economic models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑