生命,嗯,总能找到出路:通过行为搜索实现超适应性
Life, uh, Finds a Way: Hyperadaptability by Behavioral Search
AI总结:
提出超适应性理论,将行为构建为自修改搜索过程,通过动态排序连续行为集并结合认知图反馈循环与赫布学习,实现稳健的问题解决与导航能力。
摘要:
生命体能够解决它们很少或仅遇到一次的各种问题。在没有对这些问题进行大量和重复经验的情况下,它们能够以临时的方式解决这些问题。我们将这种总能找到物理可解问题解决方案的能力称为超适应性。为了解释如何实现超适应性,我们提出了一种理论,将行为构建为自修改搜索过程的物理表现。我们的系统不是随机探索,而是通过根据简单性和有效性动态排序无限连续行为集来实现稳健的问题解决。行为从认知图上的路径中采样,其顺序由紧密的行为执行/图修改反馈循环决定。我们使用赫布学习和支持灵活信息存储的新型谐波神经表示来实现认知图。我们通过模拟实验验证了我们的方法,结果显示在复杂迷宫中快速获得了高度稳健的导航能力,以及在经典强化学习问题的困难扩展上获得了高奖励。该框架为发展学习提供了新的理论模型,并为机器人能够自主掌握复杂技能和处理异常情况铺平了道路。
英文摘要:
Living beings are able to solve a wide variety of problems that they encounter rarely or only once. Without the benefit of extensive and repeated experience with these problems, they can solve them in an ad-hoc manner. We call this capacity to always find a solution to a physically solvable problem $hyperadaptability$. To explain how hyperadaptability can be achieved, we propose a theory that frames behavior as the physical manifestation of a self-modifying search procedure. Rather than exploring randomly, our system achieves robust problem-solving by dynamically ordering an infinite set of continuous behaviors according to simplicity and effectiveness. Behaviors are sampled from paths over cognitive graphs, their order determined by a tight behavior-execution/graph-modification feedback loop. We implement cognitive graphs using Hebbian-learning and a novel harmonic neural representation supporting flexible information storage. We validate our approach through simulation experiments showing rapid achievement of highly-robust navigation ability in complex mazes, as well as high reward on difficult extensions of classic reinforcement learning problems. This framework offers a new theoretical model for developmental learning and paves the way for robots that can autonomously master complex skills and handle exceptional circumstances.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。