基于三次曝光四拜耳传感器的HDR视频重建
HDR Video Reconstruction with Tri-Exposure Quad-Bayer Sensors
摘要：
我们提出了一种新的高动态范围（HDR）的视频重建方法与新的三曝光四层传感器。由于大量曝光集及其在帧上的空间均匀部署，它们比先前的空间变化曝光（SVE）HDR视频方法对噪声和空间伪影更鲁棒。尽管如此，来自较长曝光的运动模糊、来自短曝光的噪声以及SVE方法的固有空间伪影仍然是巨大的障碍。此外，时间相干性必须考虑到视频重建的稳定性。为了应对这些挑战，我们引入了一种新颖的网络架构，分而治之，克服这些问题。为了更好地使网络适应大动态范围，我们还提出了LDR重建损失，该损失来自HDR帧的高亮和阴影像素的相等贡献。通过一系列的比较和消融研究，我们表明，我们的解决方案的三曝光四倍体是更好的捕捉比以前的重建方法，特别是对于具有较大的动态范围和运动的对象的场景。
英文摘要：
We propose a novel high dynamic range (HDR) video reconstruction method with new tri-exposure quad-bayer sensors. Thanks to the larger number of exposure sets and their spatially uniform deployment over a frame, they are more robust to noise and spatial artifacts than previous spatially varying exposure (SVE) HDR video methods. Nonetheless, the motion blur from longer exposures, the noise from short exposures, and inherent spatial artifacts of the SVE methods remain huge obstacles. Additionally, temporal coherence must be taken into account for the stability of video reconstruction. To tackle these challenges, we introduce a novel network architecture that divides-and-conquers these problems. In order to better adapt the network to the large dynamic range, we also propose LDR-reconstruction loss that takes equal contributions from both the highlighted and the shaded pixels of HDR frames. Through a series of comparisons and ablation studies, we show that the tri-exposure quad-bayer with our solution is more optimal to capture than previous reconstruction methods, particularly for the scenes with larger dynamic range and objects with motion.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
