arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2112.10993econ.THcs.GT
收藏

通过在线决策问题学习随机效用模型

Learning in Random Utility Models Via Online Decision Problems

Emerson Melo

摘要:

本文研究了重复随机选择情形下的随机效用模型(RUM),其中决策者不完全知道每个可供选择方案的收益。我们开发了一个基于梯度的学习算法,通过嵌入RUM到一个在线决策问题。我们发现,一大类RUM是汉南一致的(\citet{Hahn1957}),也就是说,RUM产生的预期收益之间的平均差异,并在事后最好的固定政策去为零的时期数量的增加。此外,我们表明,我们的基于梯度的算法是等价的跟随正则化的领导者(FTRL)算法,这是广泛用于机器学习文献中的重复随机选择问题的学习模型。因此,我们提供了一个经济接地优化框架的FTRL算法。最后,我们应用我们的框架来研究近因偏差,在正常形式的游戏,和预测市场中的无悔学习。

英文摘要:

This paper studies the Random Utility Model (RUM) in a repeated stochastic choice situation, in which the decision maker is imperfectly informed about the payoffs of each available alternative. We develop a gradient-based learning algorithm by embedding the RUM into an online decision problem. We show that a large class of RUMs are Hannan consistent (\citet{Hahn1957}); that is, the average difference between the expected payoffs generated by a RUM and that of the best-fixed policy in hindsight goes to zero as the number of periods increase. In addition, we show that our gradient-based algorithm is equivalent to the Follow the Regularized Leader (FTRL) algorithm, which is widely used in the machine learning literature to model learning in repeated stochastic choice problems. Thus, we provide an economically grounded optimization framework to the FTRL algorithm. Finally, we apply our framework to study recency bias, no-regret learning in normal form games, and prediction markets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑