BuFF:用于光约束三维重建的突发特征提取
BuFF: Burst Feature Finder for Light-Constrained 3D Reconstruction
摘要:
使用传统视觉相机在夜间操作的机器人由于噪声受限的图像而面临重建的重大挑战。以前的工作已经证明,突发成像技术可以用来部分克服这个问题。在本文中,我们开发了一种新的特征检测器,直接对图像突发进行操作,从而在极低光照条件下增强基于视觉的重建。我们的方法发现关键点定义明确的规模和明显的运动在每个突发联合搜索在一个多尺度和多运动空间。由于我们在图像具有较高信噪比的阶段描述这些特征,因此检测到的特征在传统的噪声图像和突发合并图像上比现有技术更准确,并且表现出高精度,召回率和匹配性能。我们展示了改进的特征性能和相机姿态估计,并在具有挑战性的光约束场景中使用我们的特征检测器展示了改进的运动结构性能。我们的功能查找器为机器人在低光场景和包括夜间操作在内的应用中操作迈出了重要的一步。
英文摘要:
Robots operating at night using conventional vision cameras face significant challenges in reconstruction due to noise-limited images. Previous work has demonstrated that burst-imaging techniques can be used to partially overcome this issue. In this paper, we develop a novel feature detector that operates directly on image bursts that enhances vision-based reconstruction under extremely low-light conditions. Our approach finds keypoints with well-defined scale and apparent motion within each burst by jointly searching in a multi-scale and multi-motion space. Because we describe these features at a stage where the images have higher signal-to-noise ratio, the detected features are more accurate than the state-of-the-art on conventional noisy images and burst-merged images and exhibit high precision, recall, and matching performance. We show improved feature performance and camera pose estimates and demonstrate improved structure-from-motion performance using our feature detector in challenging light-constrained scenes. Our feature finder provides a significant step towards robots operating in low-light scenarios and applications including night-time operations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。