E-Calib: A Fast, Robust and Accurate Calibration Toolbox for Event Cameras
Advanced Research and Innovation Center (ARIC)(先进研究与创新中心(ARIC));Khalifa University(哈利法大学);Khalifa University Center for Autonomous Robotic Systems (KUCARS)(哈利法大学自主机器人系统中心(KUCARS));University of Zurich(苏黎世大学);Strata Manufacturing PJSC (a Mubadala company)(斯特拉塔制造公司(穆巴达拉旗下企业))
Mohammed Salah, Abdulla Ayyad, Muhammad Humais, Daniel Gehrig, Abdelqader Abusafieh, Lakmal Seneviratne, Davide Scaramuzza, Yahya Zweiri
备注:
IEEE Transactions on Image Processing
发表信息:
in IEEE Transactions on Image Processing, vol. 33, pp. 3977-3990, 2024
Event cameras triggered a paradigm shift in the computer vision community delineated by their asynchronous nature, low latency, and high dynamic range. Calibration of event cameras is always essential to account for the sensor intrinsic parameters and for 3D perception. However, conventional image-based calibration techniques are not applicable due to the asynchronous, binary output of the sensor. The current standard for calibrating event cameras relies on either blinking patterns or event-based image reconstruction algorithms. These approaches are difficult to deploy in factory settings and are affected by noise and artifacts degrading the calibration performance. To bridge these limitations, we present E-Calib, a novel, fast, robust, and accurate calibration toolbox for event cameras utilizing the asymmetric circle grid, for its robustness to out-of-focus scenes. The proposed method is tested in a variety of rigorous experiments for different event camera models, on circle grids with different geometric properties, and under challenging illumination conditions. The results show that our approach outperforms the state-of-the-art in detection success rate, reprojection error, and estimation accuracy of extrinsic parameters.
CalibNet: Geometrically Supervised Extrinsic Calibration using 3D Spatial Transformer Networks
International Institute of Information Technology, Hyderabad(海得拉巴国际信息技术学院);Mila(米拉研究所);Université de Montréal(蒙特利尔大学)
3D LiDAR和2D相机越来越多地在传感器设备中同时使用,以执行感知任务。然而,在这些传感器可以用于收集有意义的数据之前,它们的外部(和内部)需要被精确校准,因为传感器装置的性能对这些校准参数非常敏感。绝大多数现有的校准技术需要大量的数据和/或校准目标和人力,严重影响了它们在大规模生产系统中的适用性。我们通过CalibNet解决了这一差距:一个自监督的深度网络,能够实时自动估计3D LiDAR和2D相机之间的6自由度刚体变换。CalibNet减少了对校准目标的需求,从而大大节省了校准工作。在训练过程中,网络仅将LiDAR点云、相应的单目图像和相机校准矩阵K作为输入。在训练时,我们不进行直接监督(即,例如,我们不直接回归到校准参数)。相反,我们训练网络来预测校准参数,以最大限度地提高输入图像和点云的几何和光度一致性。CalibNet学习迭代解决潜在的几何问题,并准确预测各种错误校准的外部校准参数,而无需重新训练或领域自适应。该项目的页面位于https://epiception.github.io/CalibNet
High-precision visual navigation device calibration method based on collimator
College of Aerospace Science and Engineering, National University of Defense Technology(国防科技大学航天科学与工程学院);North Navigation Control Technology Co., Ltd(北方导航控制技术股份有限公司)