arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.08134cs.RO
收藏

S3M:面向搭载RGB-D相机的无人机的语义分割稀疏建图

S3M: Semantic Segmentation Sparse Mapping for UAVs with RGB-D Camera

University of Engineering and Technology, Vietnam National University Hanoi(越南国立大学河内工程技术大学);Hanoi University of Industry(河内工业大学);Japan Advanced Institute of Science and Technology(日本北陆先端科学技术大学院大学)

Thanh Nguyen Canh, Van-Truong Nguyen, Xiem HoangVan, Armagan Elibol, Nak Young Chong

AI总结:

本文提出S3M系统,将视觉SLAM、目标分割与OctoMap稀疏建图融合,利用语义信息提升无人机在室内环境中的位姿估计与导航能力,并通过Gazebo仿真和Jetson Xavier AGX部署验证其有效性。

摘要:

无人机(UAV)在搜索与救援等关键应用中具有巨大潜力,在这些应用中,对室内环境的准确感知至关重要。然而,定位、三维重建和语义分割的同时融合带来了显著挑战,尤其是在配备有限功率和计算资源的无人机背景下。本文提出了一种新方法,以应对无人机操作中语义信息提取与利用方面的挑战。我们的系统集成了最先进的视觉SLAM以估计全面的六自由度位姿,并在后端采用先进的目标分割方法。为了提高框架的计算和存储效率,我们采用了一种精简的基于体素的三维地图表示——OctoMap来构建可运行系统。此外,还引入了融合算法,从前端SLAM任务中获取每一帧的语义信息以及对应点。通过利用语义信息,我们的框架增强了无人机感知和导航室内空间的能力,解决了位姿估计精度和不确定性降低方面的挑战。通过Gazebo仿真,我们验证了所提系统的有效性,并成功将我们的方法部署到Jetson Xavier AGX单元上用于实际应用。

英文摘要:

Unmanned Aerial Vehicles (UAVs) hold immense potential for critical applications, such as search and rescue operations, where accurate perception of indoor environments is paramount. However, the concurrent amalgamation of localization, 3D reconstruction, and semantic segmentation presents a notable hurdle, especially in the context of UAVs equipped with constrained power and computational resources. This paper presents a novel approach to address challenges in semantic information extraction and utilization within UAV operations. Our system integrates state-of-the-art visual SLAM to estimate a comprehensive 6-DoF pose and advanced object segmentation methods at the back end. To improve the computational and storage efficiency of the framework, we adopt a streamlined voxel-based 3D map representation - OctoMap to build a working system. Furthermore, the fusion algorithm is incorporated to obtain the semantic information of each frame from the front-end SLAM task, and the corresponding point. By leveraging semantic information, our framework enhances the UAV's ability to perceive and navigate through indoor spaces, addressing challenges in pose estimation accuracy and uncertainty reduction. Through Gazebo simulations, we validate the efficacy of our proposed system and successfully embed our approach into a Jetson Xavier AGX unit for real-world applications.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑