arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2503.18705cs.CVcs.GR
收藏

偏振图像连拍超分辨率基准测试:噪声数据集与分析

Benchmarking Burst Super-Resolution for Polarization Images: Noise Dataset and Analysis

KAIST(韩国科学技术院)

Inseung Hwang, Kiseok Choi, Hyunho Ha, Min H. Kim

AI总结:

针对偏振成像连拍超分辨率缺乏定制数据集与噪声统计基准的问题,本研究提出PolarNS噪声统计数据集与PolarBurstSR基准数据集,构建噪声传播分析模型,验证了偏振定制训练的超分方法优于RGB方法,为该领域建立了基准。

摘要:

快照偏振成像通过线偏振子图像计算偏振态。为实现这一目标,偏振相机采用双拜耳图案传感器同时捕获颜色和偏振信息。该类相机光效率低且空间分辨率不足,会导致噪声增加、偏振测量结果受损。尽管连拍超分辨率可有效降低噪声并提升空间分辨率,但由于缺乏定制数据集和可靠的真实噪声统计数据,将其应用于偏振成像仍面临挑战。\n为解决这些问题,我们提出了PolarNS和PolarBurstSR两个专为偏振成像开发的创新数据集。PolarNS可表征偏振噪声统计特性,助力深入分析;PolarBurstSR则作为偏振图像连拍超分辨率的基准。这些数据集在多种真实场景下采集,可支持全面评估。此外,我们提出了一种偏振噪声分析模型用于量化噪声传播,并在暗室环境下采集的大规模数据集上完成了测试。在应用部分,我们对比了最新的连拍超分辨率模型,凸显了偏振定制训练相较于基于RGB的方法的优势。本工作建立了偏振连拍超分辨率基准,提供了关于噪声传播的关键见解,从而助力提升偏振图像重建效果。

英文摘要:

Snapshot polarization imaging calculates polarization states from linearly polarized subimages. To achieve this, a polarization camera employs a double Bayer-patterned sensor to capture both color and polarization. It demonstrates low light efficiency and low spatial resolution, resulting in increased noise and compromised polarization measurements. Although burst super-resolution effectively reduces noise and enhances spatial resolution, applying it to polarization imaging poses challenges due to the lack of tailored datasets and reliable ground truth noise statistics. To address these issues, we introduce PolarNS and PolarBurstSR, two innovative datasets developed specifically for polarization imaging. PolarNS provides characterization of polarization noise statistics, facilitating thorough analysis, while PolarBurstSR functions as a benchmark for burst super-resolution in polarization images. These datasets, collected under various real-world conditions, enable comprehensive evaluation. Additionally, we present a model for analyzing polarization noise to quantify noise propagation, tested on a large dataset captured in a darkroom environment. As part of our application, we compare the latest burst super-resolution models, highlighting the advantages of training tailored to polarization compared to RGB-based methods. This work establishes a benchmark for polarization burst super-resolution and offers critical insights into noise propagation, thereby enhancing polarization image reconstruction.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑