arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2003.10176cs.CVcs.LG
收藏

用于无标记体积传感器对准的深度软Procrustes

Deep Soft Procrustes for Markerless Volumetric Sensor Alignment

Centre for Research and Technology Hellas(希腊研究与技术中心);Information Technologies Institute(信息技术研究所);Visual Computing Lab(视觉计算实验室)

Vladimiros Sterzentsenko, Alexandros Doumanoglou, Spyridon Thermos, Nikolaos Zioulis, Dimitrios Zarpalas, Petros Daras

摘要:

随着消费级深度传感器的出现,低成本的体积捕获系统更容易部署。然而,它们的广泛采用取决于它们的可用性,并扩展到空间对齐多个传感器的实用性。大多数现有的对准方法采用视觉图案,例如棋盘或标记,并且需要高的用户参与和技术知识。更用户友好和更易于使用的方法依赖于利用物理结构的几何图案的无标记方法。然而,目前的SoA方法受到传感器的放置和数量的限制。在这项工作中,我们改进了无标记数据驱动的对应估计,以实现更强大和灵活的多传感器空间对齐。特别是,我们将几何约束以端到端的方式纳入一个典型的基于分割的模型,并将中间密集分类任务与目标姿态估计任务连接起来。这是通过一个软的,可区分的procrustes分析,规范化的分割,并实现更高的外在校准性能,在扩展的传感器放置配置,而不受限制的体积捕获系统的传感器的数量。实验表明,我们的模型实现了类似的结果与基于标记的方法和优于无标记的,同时也是强大的姿态变化的校准结构。代码和预训练模型可在https://vcl3d.github.io/StructureNet/上获取。

英文摘要:

With the advent of consumer grade depth sensors, low-cost volumetric capture systems are easier to deploy. Their wider adoption though depends on their usability and by extension on the practicality of spatially aligning multiple sensors. Most existing alignment approaches employ visual patterns, e.g. checkerboards, or markers and require high user involvement and technical knowledge. More user-friendly and easier-to-use approaches rely on markerless methods that exploit geometric patterns of a physical structure. However, current SoA approaches are bounded by restrictions in the placement and the number of sensors. In this work, we improve markerless data-driven correspondence estimation to achieve more robust and flexible multi-sensor spatial alignment. In particular, we incorporate geometric constraints in an end-to-end manner into a typical segmentation based model and bridge the intermediate dense classification task with the targeted pose estimation one. This is accomplished by a soft, differentiable procrustes analysis that regularizes the segmentation and achieves higher extrinsic calibration performance in expanded sensor placement configurations, while being unrestricted by the number of sensors of the volumetric capture system. Our model is experimentally shown to achieve similar results with marker-based methods and outperform the markerless ones, while also being robust to the pose variations of the calibration structure. Code and pretrained models are available at https://vcl3d.github.io/StructureNet/.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑