STAIR:语义目标主动隐式重建
STAIR: Semantic-Targeted Active Implicit Reconstruction
AI总结:
针对自主机器人主动重建语义目标的需求,提出基于隐式神经表示与语义渲染的规划框架,提升重建质量并优于显式地图方法。
摘要:
许多自主机器人应用在部署时需要对象级理解。主动重建感兴趣的对象,即具有特定语义含义的对象,对于机器人在初始未知环境中执行下游任务至关重要。在这项工作中,我们提出了一种新颖的语义目标主动重建框架,以带姿态的RGB-D测量和2D语义标签作为输入。我们框架的关键组件是语义隐式神经表示和基于语义渲染与不确定性估计的兼容规划效用函数,从而实现针对感兴趣对象的自适应视角规划。与不考虑语义进行视角规划的隐式重建基线相比,我们的规划方法在网格和新视角渲染质量方面取得了更好的重建性能。我们的框架进一步优于基于显式地图的最先进的语义目标主动重建流程,证明了我们利用隐式神经表示解决语义目标主动重建问题的选择是合理的。
英文摘要:
Many autonomous robotic applications require object-level understanding when deployed. Actively reconstructing objects of interest, i.e. objects with specific semantic meanings, is therefore relevant for a robot to perform downstream tasks in an initially unknown environment. In this work, we propose a novel framework for semantic-targeted active reconstruction using posed RGB-D measurements and 2D semantic labels as input. The key components of our framework are a semantic implicit neural representation and a compatible planning utility function based on semantic rendering and uncertainty estimation, enabling adaptive view planning to target objects of interest. Our planning approach achieves better reconstruction performance in terms of mesh and novel view rendering quality compared to implicit reconstruction baselines that do not consider semantics for view planning. Our framework further outperforms a state-of-the-art semantic-targeted active reconstruction pipeline based on explicit maps, justifying our choice of utilising implicit neural representations to tackle semantic-targeted active reconstruction problems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。