学习不学习:自然与养育在Silico
Learning Not to Learn: Nature versus Nurture in Silico
摘要:
动物具有丰富的感官,行为和运动技能的先天剧目,使它们能够在出生后立即与世界互动。同时,许多行为具有高度的适应性,可以通过学习来适应特定的环境。在这项工作中,我们使用数学分析和元学习(或“学习学习”)的框架来回答什么时候学习这种自适应策略是有益的,什么时候硬编码启发式行为。我们发现,生态的不确定性,任务的复杂性和智能体的生命周期的相互作用有至关重要的影响,元学习摊销贝叶斯推理的代理。有两种制度:一种是元学习产生一种学习算法,实现任务相关的信息集成,另一种是元学习印刻一种启发式或“硬编码”行为。进一步的分析表明,非适应性行为不仅对个体之间稳定的环境方面是最佳的,而且在适应环境实际上是非常有益的情况下,但不能在剩余的生命中足够快地被利用。因此,硬编码的行为不仅应该是那些总是有效的行为,而且应该是那些过于复杂而无法在合理的时间框架内学习的行为。
英文摘要:
Animals are equipped with a rich innate repertoire of sensory, behavioral and motor skills, which allows them to interact with the world immediately after birth. At the same time, many behaviors are highly adaptive and can be tailored to specific environments by means of learning. In this work, we use mathematical analysis and the framework of meta-learning (or 'learning to learn') to answer when it is beneficial to learn such an adaptive strategy and when to hard-code a heuristic behavior. We find that the interplay of ecological uncertainty, task complexity and the agents' lifetime has crucial effects on the meta-learned amortized Bayesian inference performed by an agent. There exist two regimes: One in which meta-learning yields a learning algorithm that implements task-dependent information-integration and a second regime in which meta-learning imprints a heuristic or 'hard-coded' behavior. Further analysis reveals that non-adaptive behaviors are not only optimal for aspects of the environment that are stable across individuals, but also in situations where an adaptation to the environment would in fact be highly beneficial, but could not be done quickly enough to be exploited within the remaining lifetime. Hard-coded behaviors should hence not only be those that always work, but also those that are too complex to be learned within a reasonable time frame.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。