arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.22170cs.MA
收藏

受人类启发的经典条件反射与工具性学习用于自主体导航

Human-Inspired Pavlovian and Instrumental Learning for Autonomous Agent Navigation

University of Bologna(博洛尼亚大学);National Research Council of Italy(意大利国家研究委员会)

Jingfeng Shan, Francesco Guidi, Mehrdad Saeidi, Enrico Testi, Elia Favarelli, Andrea Giorgetti, Davide Dardari, Alberto Zanella, Giorgio Li Pira, Francesca Starita, Anna Guerra

AI总结:

本文提出一种融合经典条件反射、工具性MF和工具性MB组件的混合强化学习架构,通过地理参考环境特征塑造内在价值信号,提升自主体在不确定环境中的导航安全性和效率。

摘要:

自主体在不确定环境中必须平衡快速响应与目标导向的规划。经典MF强化学习(RL)收敛缓慢且可能引发不安全探索,而MB方法计算成本高且易受模型不匹配影响。本文提出一种受人类启发的混合RL架构,整合经典条件反射、工具性MF和工具性MB组件。受神经科学中的经典条件反射和工具性学习启发,该框架考虑情境无线电提示,此处意指地理参考环境特征作为条件刺激(CS),以塑造内在价值信号并偏指导决策。学习进一步通过专用的动机信号由内部动机驱动。贝叶斯仲裁机制根据预测可靠性自适应地混合MF和MB估计。仿真结果表明,混合方法相比标准RL基线加速学习、提高操作安全性并减少高不确定性区域的导航。经典条件反射促进更安全的探索和更快的收敛,而仲裁使探索向高效、计划驱动的利用平稳过渡。总体而言,结果突显了生物启发模块化在不确定环境下的自主系统鲁棒性和适应性优势。

英文摘要:

Autonomous agents operating in uncertain environments must balance fast responses with goal-directed planning. Classical MF RL often converges slowly and may induce unsafe exploration, whereas MB methods are computationally expensive and sensitive to model mismatch. This paper presents a human-inspired hybrid RL architecture integrating Pavlovian, Instrumental MF, and Instrumental MB components. Inspired by Pavlovian and Instrumental learning from neuroscience, the framework considers contextual radio cues, here intended as georeferenced environmental features acting as CS, to shape intrinsic value signals and bias decision-making. Learning is further modulated by internal motivational drives through a dedicated motivational signal. A Bayesian arbitration mechanism adaptively blends MF and MB estimates based on predicted reliability. Simulation results show that the hybrid approach accelerates learning, improves operational safety, and reduces navigation in high-uncertainty regions compared to standard RL baselines. Pavlovian conditioning promotes safer exploration and faster convergence, while arbitration enables a smooth transition from exploration to efficient, plan-driven exploitation. Overall, the results highlight the benefits of biologically inspired modularity for robust and adaptive autonomous systems under uncertainty.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑