通过无模型强化学习实现不与边界比较的序列采样
Sequential sampling without comparison to boundary through model-free reinforcement learning
AI总结:
针对边界模型难以解释动物如何学习决策边界的问题,提出一种无需决策边界与证据积累的无模型强化学习序列采样模型,可复现典型知觉决策行为并统一解释训练前后表现。
摘要:
尽管证据整合至边界的模型已成功解释了不确定性下决策中广泛的行为与神经数据,但动物如何学习和优化该边界仍未解决。在此,我们提出一种用于不确定性下知觉决策的无模型强化学习算法,该算法完全摒弃了决策边界和证据积累的概念。我们的模型学习在给定可用证据时是承诺作出决策,还是付出代价继续采样信息。我们复现了知觉决策的典型特征,例如准确率和反应时对证据强度的依赖、收益机制对速度—准确率权衡的调节,以及许多其他特征。通过在同一框架内统一学习与决策,该模型既能解释训练期间不稳定的行为,也能解释训练后稳定的行为,为重新审视决策科学文献中大量被弃用的训练数据打开了大门。
英文摘要:
Although evidence integration to the boundary model has successfully explained a wide range of behavioral and neural data in decision making under uncertainty, how animals learn and optimize the boundary remains unresolved. Here, we propose a model-free reinforcement learning algorithm for perceptual decisions under uncertainty that dispenses entirely with the concepts of decision boundary and evidence accumulation. Our model learns whether to commit to a decision given the available evidence or continue sampling information at a cost. We reproduced the canonical features of perceptual decision-making such as dependence of accuracy and reaction time on evidence strength, modulation of speed-accuracy trade-off by payoff regime, and many others. By unifying learning and decision making within the same framework, this model can account for unstable behavior during training as well as stabilized post-training behavior, opening the door to revisiting the extensive volumes of discarded training data in the decision science literature.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。