arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2201.03904cs.AIcs.MSq-bio.NC
收藏

pymdp:用于离散状态空间中主动推理的Python库

pymdp: A Python library for active inference in discrete state spaces

Max Planck Institute of Animal Behavior(马克斯·普朗克动物行为研究所);Centre for the Advanced Study of Collective Behaviour(集体行为高级研究中心);University of Konstanz(康斯坦茨大学);VERSES Research Lab(VERSES研究实验室);University of Oxford(牛津大学);Imperial College London(帝国理工学院);Northeastern University(东北大学);University College London(伦敦大学学院);University of Sussex(萨塞克斯大学)

Conor Heins, Beren Millidge, Daphne Demekas, Brennan Klein, Karl Friston, Iain Couzin, Alexander Tschantz

摘要:

主动推理是对复杂系统中认知和行为的一种解释,它将行动、感知和学习结合在贝叶斯推理的理论框架下。主动推理在学术研究中的应用越来越多,特别是在试图模拟人类或动物行为的领域。虽然近年来,从主动推理文献中产生的一些代码已经用Python和Julia等开放源语言编写,但迄今为止,用于模拟主动推理代理的最流行的软件是SPM的DEM工具箱,这是一个最初为神经成像数据的统计分析和建模而开发的MATLAB库。对主动推理的兴趣日益增加,表现在数量上以及跨科学学科的应用多样化,因此需要通用的,广泛可用的和用户友好的代码,用于在开源科学计算语言(如Python)中模拟主动推理。我们在这里介绍的Python包pymdp(参见https://github.com/infer-actively/pymdp)代表了这个方向上的重要一步:即,我们提供了第一个开源包,用于使用部分可观察马尔可夫决策过程(POMDP)模拟主动推理。我们回顾了该软件包的结构,并解释了它的优势,如模块化设计和可定制性,同时提供了文本代码块,以演示如何使用它来轻松构建和运行主动推理过程。我们开发pymdp是为了增加主动推理框架的可访问性和曝光度,让具有不同学科背景的研究人员、工程师和开发人员使用。本着开源软件的精神,我们也希望它能在不断增长的活跃推理社区中激发新的创新、开发和协作。

英文摘要:

Active inference is an account of cognition and behavior in complex systems which brings together action, perception, and learning under the theoretical mantle of Bayesian inference. Active inference has seen growing applications in academic research, especially in fields that seek to model human or animal behavior. While in recent years, some of the code arising from the active inference literature has been written in open source languages like Python and Julia, to-date, the most popular software for simulating active inference agents is the DEM toolbox of SPM, a MATLAB library originally developed for the statistical analysis and modelling of neuroimaging data. Increasing interest in active inference, manifested both in terms of sheer number as well as diversifying applications across scientific disciplines, has thus created a need for generic, widely-available, and user-friendly code for simulating active inference in open-source scientific computing languages like Python. The Python package we present here, pymdp (see https://github.com/infer-actively/pymdp), represents a significant step in this direction: namely, we provide the first open-source package for simulating active inference with partially-observable Markov Decision Processes or POMDPs. We review the package's structure and explain its advantages like modular design and customizability, while providing in-text code blocks along the way to demonstrate how it can be used to build and run active inference processes with ease. We developed pymdp to increase the accessibility and exposure of the active inference framework to researchers, engineers, and developers with diverse disciplinary backgrounds. In the spirit of open-source software, we also hope that it spurs new innovation, development, and collaboration in the growing active inference community.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑