arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2312.14697cs.CV
收藏

Pola4All:偏振应用综述及用于分析偏振的开源工具包

Pola4All: survey of polarimetric applications and an open-source toolkit to analyze polarization

Université de Lorraine(洛林大学);CNRS(法国国家科学研究中心);Inria(法国国家信息与自动化研究所);LORIA(洛林计算机科学及其应用实验室);Université de Bourgogne(勃艮第大学);ImViA UR 7535(图像与视觉人工智能实验室);ICB(勃艮第大学跨学科化学实验室)

Joaquin Rodriguez, Lew-Fock-Chong Lew-Yan-Voon, Renato Martins, Olivier Morel

AI总结:

本文综述了偏振成像在视觉与机器人感知任务中的最新应用进展,并推出了一款开源软件工具包Pola4All,为微网格偏振相机提供通信标准与图像处理算法。

摘要:

光的偏振信息可以为计算机视觉和场景理解任务(如物体的材质类型、位姿和形状)提供丰富的线索。随着新型且廉价的偏振传感器的出现,这种成像方式正变得可供更广泛的公众使用,以解决诸如位姿估计、3D重建、水下导航和深度估计等问题。然而,我们观察到这种传感方式的使用存在若干局限性,并且缺乏用于分析偏振图像的标准和公开可用的工具。此外,尽管偏振相机制造商通常提供与相机交互的采集工具,但他们很少包含利用偏振信息的处理算法。在本文中,我们回顾了涉及偏振成像应用的最新进展,包括对视觉和机器人感知任务的偏振技术最新进展的全面调查。我们还引入了一个完整的软件工具包,该工具包提供了通用标准,用于与市场上大多数现有的微网格偏振相机进行通信并处理其信息。该工具包还实现了适用于该模态的多种图像处理算法,并已在GitHub上公开:https://github.com/vibot-lab/Pola4all_JEI_2023。

英文摘要:

Polarization information of the light can provide rich cues for computer vision and scene understanding tasks, such as the type of material, pose, and shape of the objects. With the advent of new and cheap polarimetric sensors, this imaging modality is becoming accessible to a wider public for solving problems such as pose estimation, 3D reconstruction, underwater navigation, and depth estimation. However, we observe several limitations regarding the usage of this sensorial modality, as well as a lack of standards and publicly available tools to analyze polarization images. Furthermore, although polarization camera manufacturers usually provide acquisition tools to interface with their cameras, they rarely include processing algorithms that make use of the polarization information. In this paper, we review recent advances in applications that involve polarization imaging, including a comprehensive survey of recent advances on polarization for vision and robotics perception tasks. We also introduce a complete software toolkit that provides common standards to communicate with and process information from most of the existing micro-grid polarization cameras on the market. The toolkit also implements several image processing algorithms for this modality, and it is publicly available on GitHub: https://github.com/vibot-lab/Pola4all_JEI_2023.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑