将动作绑定到世界模型中的对象
Binding Actions to Objects in World Models
摘要:
我们研究的问题,绑定行动的对象因素化的世界模型中使用的行动注意力机制。我们提出了两个注意力机制绑定行动的对象,软注意力和硬注意力,我们评估的背景下,结构化的世界模型的五个环境。我们的实验表明,硬注意力有助于对比训练的结构化世界模型学习在基于对象的网格世界环境中分离单个对象。此外,我们表明,软注意力提高性能的因素化世界模型训练的机器人操作任务。所学习的动作注意力权重可以用于将因子化的世界模型解释为注意力集中在环境中的被操纵对象上。
英文摘要:
We study the problem of binding actions to objects in object-factored world models using action-attention mechanisms. We propose two attention mechanisms for binding actions to objects, soft attention and hard attention, which we evaluate in the context of structured world models for five environments. Our experiments show that hard attention helps contrastively-trained structured world models to learn to separate individual objects in an object-based grid-world environment. Further, we show that soft attention increases performance of factored world models trained on a robotic manipulation task. The learned action attention weights can be used to interpret the factored world model as the attention focuses on the manipulated object in the environment.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。