arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.03485cs.AI
收藏

基于探索性规划的行为模型自主学习

Self-directed Learning of Action Models using Exploratory Planning

Parallax Advanced Research(视差高级研究院);Knexus Research Corporation(奈克瑟斯研究公司);Lehigh University(利哈伊大学);Naval Research Laboratory(海军研究实验室)

Dustin Dannenhauer, Matthew Molineaux, Michael W. Floyd, Noah Reifsnyder, David W. Aha

摘要:

复杂的、真实世界的域可能无法为代理完全建模,特别是如果代理以前从未在该域中操作过。智能体在这样一个域中有效地计划和行动的能力受到其何时可以执行特定动作以及这些动作的效果的知识的影响。我们描述了一种新的探索性规划代理,能够学习行动的先决条件和影响,没有专家的痕迹或给定的目标。代理的架构允许它执行探索性动作以及目标导向的动作,这为探索性规划和目标规划应该如何控制以及代理的行为应该如何向它可能拥有的任何队友解释开辟了重要的考虑因素。这项工作的贡献包括一个新的上下文表示称为提升链接子句,一个新的探索行动选择方法使用这些条款,一个探索计划,使用提升链接子句作为目标,以达到新的状态,以及在一个以探索为中心的视频游戏场景中的实证评估,表明解除链接的子句可以改善探索和动作模型学习,规划基线代理。

英文摘要:

Complex, real-world domains may not be fully modeled for an agent, especially if the agent has never operated in the domain before. The agent's ability to effectively plan and act in such a domain is influenced by its knowledge of when it can perform specific actions and the effects of those actions. We describe a novel exploratory planning agent that is capable of learning action preconditions and effects without expert traces or a given goal. The agent's architecture allows it to perform both exploratory actions as well as goal-directed actions, which opens up important considerations for how exploratory planning and goal planning should be controlled, as well as how the agent's behavior should be explained to any teammates it may have. The contributions of this work include a new representation for contexts called Lifted Linked Clauses, a novel exploration action selection approach using these clauses, an exploration planner that uses lifted linked clauses as goals in order to reach new states, and an empirical evaluation in a scenario from an exploration-focused video game demonstrating that lifted linked clauses improve exploration and action model learning against non-planning baseline agents.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑