A perfectly rational decision-maker chooses the best action with the highest utility gain from a set of possible actions. The optimality principles that describe such decision processes do not take into account the computational costs of finding the optimal action. Bounded rational decision-making addresses this problem by specifically trading off information-processing costs and expected utility. Interestingly, a similar trade-off between energy and entropy arises when describing changes in thermodynamic systems. This similarity has been recently used to describe bounded rational agents. Crucially, this framework assumes that the environment does not change while the decision-maker is computing the optimal policy. When this requirement is not fulfilled, the decision-maker will suffer inefficiencies in utility, that arise because the current policy is optimal for an environment in the past. Here we borrow concepts from non-equilibrium thermodynamics to quantify these inefficiencies and illustrate with simulations its relationship with computational resources.
Bounded Rational Decision-Making in Feedforward Neural Networks
Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Max Planck Institute for Biological Cybernetics(马克斯·普朗克生物控制论研究所);Graduate Training Center of Neuroscience(神经科学研究生培训中心)
Decisions and Performance Under Bounded Rationality: A Computational Benchmarking Approach
Rotterdam School of Management, Erasmus University(伊拉斯姆斯大学鹿特丹管理学院);LMU Munich(慕尼黑大学);CEPR(经济政策研究中心);Ifo(伊福经济研究所);IZA(劳动经济研究所);CREST-ENSAE;CESifo(CESifo经济研究所)
Performance of Bounded-Rational Agents With the Ability to Self-Modify
Basic Algorithms Research Copenhagen (BARC)(哥本哈根基础算法研究院);Univ. of Copenhagen(哥本哈根大学);University of Oxford(牛津大学)
嵌入在复杂环境中的代理的自我修改是难以避免的,无论是通过直接方式(例如自己的代码修改)还是间接方式(例如影响操作员,利用错误或环境)。有人认为,智能代理有动机避免修改其效用函数,使其未来的实例朝着相同的目标工作。Everitt et al.(2016)正式表明,提供自我修改的选项对于完全理性的代理人来说是无害的。我们表明,这一结果不再是真实的代理有限理性。在这样的代理中,自我修改可能导致性能的指数恶化和先前对准的代理的逐渐失准。我们研究了这种效应的大小如何取决于代理人理性中缺陷的类型和大小(下面1-4)。我们还讨论了模型假设和更广泛的问题和框架空间。我们研究了代理可以被限制理性的四种方式:它要么(1)不总是选择最佳行动,(2)与人类价值观不完全一致,(3)具有不准确的环境模型,或者(4)使用错误的时间贴现因子。我们表明,虽然在情况(2)-(4)中,由代理的不完美性引起的不对准不会随着时间的推移而增加,但(1)不对准可能呈指数增长。
University of Pennsylvania(宾夕法尼亚大学);Max Planck Institute for Intelligent Systems(马克斯·普朗克智能系统研究所);Max Planck Institute for Biological Cybernetics(马克斯·普朗克生物控制论研究所);Google Inc.(谷歌公司);Korea Advanced Institute of Science and Technology(韩国高等科学技术研究院);The Hebrew University(希伯来大学)
A maximum entropy model of bounded rational decision-making with prior beliefs and market feedback
Centre for Complex Systems, The University of Sydney(悉尼大学复杂系统中心);Securities Industry Research Centre of Asia-Pacific(亚太证券业研究中心);CoreLogic, Inc.(CoreLogic公司)