arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1902.00673cs.AI
收藏

信念动态提取

Belief dynamics extraction

University of Minnesota(明尼苏达大学);Baylor College of Medicine(贝勒医学院);Rice University(莱斯大学)

Arun Kumar, Zhengwei Wu, Xaq Pitkow, Paul Schrater

摘要:

动物的行为不仅仅是由当前的观察结果驱动的,而是受到内部状态的强烈影响。估计这些内部状态的结构对于理解行为的神经基础至关重要。原则上,内部状态可以通过反转行为模型来估计,如在逆基于模型的强化学习中。然而,这需要仔细的参数化和风险模型不匹配的动物。在这里,我们采取数据驱动的方法来推断潜在的状态直接从行为的观察,使用部分可观察的切换半马尔可夫过程。这个过程有两个关键因素来捕捉动物行为:它捕捉观察之间的非指数分布时间,以及潜伏状态之间的转换取决于动物的行为,这些特征需要更复杂的非马尔可夫模型来表示。为了证明我们的方法的实用性,我们将其应用到一个模拟的最佳代理执行觅食任务的观察,并发现该模型提取的潜在动态与代理的信念动态相对应。最后,我们应用我们的模型来识别猴子执行觅食任务的行为中的潜在状态,并找到集群的潜在状态,识别与预期等待一致的时间段。这种数据驱动的行为模型对于推断潜在的认知状态,从而测量这些状态的神经表征是有价值的。

英文摘要:

Animal behavior is not driven simply by its current observations, but is strongly influenced by internal states. Estimating the structure of these internal states is crucial for understanding the neural basis of behavior. In principle, internal states can be estimated by inverting behavior models, as in inverse model-based Reinforcement Learning. However, this requires careful parameterization and risks model-mismatch to the animal. Here we take a data-driven approach to infer latent states directly from observations of behavior, using a partially observable switching semi-Markov process. This process has two elements critical for capturing animal behavior: it captures non-exponential distribution of times between observations, and transitions between latent states depend on the animal's actions, features that require more complex non-markovian models to represent. To demonstrate the utility of our approach, we apply it to the observations of a simulated optimal agent performing a foraging task, and find that latent dynamics extracted by the model has correspondences with the belief dynamics of the agent. Finally, we apply our model to identify latent states in the behaviors of monkey performing a foraging task, and find clusters of latent states that identify periods of time consistent with expectant waiting. This data-driven behavioral model will be valuable for inferring latent cognitive states, and thereby for measuring neural representations of those states.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑