arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.15067cs.CV
收藏

VoxDepth:边缘设备上深度图像的校正

VoxDepth: Rectification of Depth Images on Edge Devices

Yashashwee Chakrabarty, Smruti Ranjan Sarangi

AI总结:

VoxDepth提出一种基于三维点云构建与融合的深度图像校正方案,在边缘设备上实现快速准确修复,较最先进方法质量提升31%,帧率达27 FPS。

摘要:

自主移动机器人,如自主飞行无人机和工业机器人,严重依赖深度图像来执行三维重建和视觉SLAM等任务。然而,这些深度图像中存在的不准确性会极大地阻碍这些应用的有效性,导致次优的结果。商用相机产生的深度图像经常表现出噪声,表现为闪烁的像素和错误的补丁。基于机器学习的方法来校正这些图像不适用于计算资源非常有限的边缘设备。非机器学习方法速度更快,但准确性有限,特别是在校正由遮挡和相机移动引起的错误方面。我们提出了一种名为VoxDepth的方案,它快速、准确,并且在边缘设备上运行良好。它依赖于一系列新颖的技术:三维点云构建与融合,并利用它创建模板来修复错误的深度图像。VoxDepth在合成和真实世界数据集上都显示出优越的结果。我们展示了在真实世界深度数据集上,与最先进的方法相比,质量提高了31%,同时保持了27 FPS(每秒帧数)的竞争性帧率。

英文摘要:

Autonomous mobile robots like self-flying drones and industrial robots heavily depend on depth images to perform tasks such as 3D reconstruction and visual SLAM. However, the presence of inaccuracies in these depth images can greatly hinder the effectiveness of these applications, resulting in sub-optimal results. Depth images produced by commercially available cameras frequently exhibit noise, which manifests as flickering pixels and erroneous patches. ML-based methods to rectify these images are unsuitable for edge devices that have very limited computational resources. Non-ML methods are much faster but have limited accuracy, especially for correcting errors that are a result of occlusion and camera movement. We propose a scheme called VoxDepth that is fast, accurate, and runs very well on edge devices. It relies on a host of novel techniques: 3D point cloud construction and fusion, and using it to create a template that can fix erroneous depth images. VoxDepth shows superior results on both synthetic and real-world datasets. We demonstrate a 31% improvement in quality as compared to state-of-the-art methods on real-world depth datasets, while maintaining a competitive framerate of 27 FPS (frames per second).

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑