利用期望模型计算实现三维场景图上的常识可供性估计
Leveraging Computation of Expectation Models for Commonsense Affordance Estimation on 3D Scene Graphs
AI总结:
本文提出基于相关信息(CECI)模型和图卷积网络的方法,通过分析三维场景图上下文关系实现常识性物体可供性估计,并在真实室内环境中验证其接近人类常识水平。
摘要:
本文研究常识性物体可供性概念,旨在使城市环境中的具身机器人智能体能够实现接近人类的 任务规划与任务优化。物体可供性的重点在于推理如何在任务执行过程中有效识别物体的内在效用,本文通过分析三维场景图稀疏信息的上下文关系来实现这一目标。所提出的框架构建了一个相关信 息(CECI)模型,利用图卷积网络学习概率分布,从而能够为语义类别中的各个成员提取常识可供性。整个框架在真实室内环境中进行了实验验证,展示了该方法达到人类常识水平的能力。有关本文展示实验演示的视频,请参阅以下链接:https://youtu.be/BDCMVx2GiQE
英文摘要:
This article studies the commonsense object affordance concept for enabling close-to-human task planning and task optimization of embodied robotic agents in urban environments. The focus of the object affordance is on reasoning how to effectively identify object's inherent utility during the task execution, which in this work is enabled through the analysis of contextual relations of sparse information of 3D scene graphs. The proposed framework develops a Correlation Information (CECI) model to learn probability distributions using a Graph Convolutional Network, allowing to extract the commonsense affordance for individual members of a semantic class. The overall framework was experimentally validated in a real-world indoor environment, showcasing the ability of the method to level with human commonsense. For a video of the article, showcasing the experimental demonstration, please refer to the following link: https://youtu.be/BDCMVx2GiQE
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。