无校准孔径衍射的紧凑型快照光谱成像
Compact Snapshot Spectral Imaging with Calibration-Free Aperture Diffraction
- Nanjing University(南京大学)
机构由 AI 辅助整理,请以论文原文为准。
AI总结:
该研究针对快照光谱成像系统复杂、需重复校准的问题,提出无校准的ADIS方法,结合ODAUVST框架实现紧凑型全分辨率光谱成像,验证了其性能优势。
AI中文摘要:
快照光谱成像(Snapshot Spectral Imaging, SSI)可提供高维时空-光谱观测,以揭示内在物理特性。然而,其复杂的系统和重复的校准需求阻碍了边缘应用。在此,我们提出一种紧凑型、高性价比、无校准的SSI方法——孔径衍射成像光谱仪(Aperture Diffraction Imaging Spectrometer, ADIS),它仅由带二元掩模的衍射透镜和拜耳滤镜传感器组成,与标准RGB相机相比无需额外物理空间。ADIS对波长进行色散和复用,将能量映射到传感器的不同位置,可从超像素级编码中恢复全分辨率图像。ADIS直接利用理论计算的点扩散函数(PSF)实现无校准光谱重建,同时容忍不同光学配置下依赖透镜的变化,弥合了模拟与现实之间的差距。为通过求解稀疏约束逆问题实现SSI,我们引入正交衍射感知展开框架(Orthogonal Diffraction-Aware Unfolding Framework, ODAUF),搭配体素移位转换器(Voxel Shift Transformer, VST)以提升正交衍射感知能力。将VST集成到ODAUF中形成高效的正交衍射感知展开体素移位转换器(Orthogonal Diffraction-Aware Unfolding Voxel Shift Transformer, ODAUVST),实现出色的恢复效果并减少参数数量。通过理论阐述、系统全面的对比以及展示真实SSI结果,我们验证了ADIS的优越性,可在商用相机的尺寸范围内实现无校准全分辨率SSI。
英文摘要:
Snapshot Spectral Imaging (SSI) provides high-dimensional temporal-spatial-spectral observation to uncover intrinsic physical characteristics. However, its complex system and repetitive calibration requirements hinder edge applications. Here, we propose a compact, cost-effective, calibration-free SSI method, Aperture Diffraction Imaging Spectrometer (ADIS), which consists only of a diffractive lens with a binary mask and a Bayer-filtered sensor, requiring no additional physical footprint compared to standard RGB cameras. ADIS disperses and multiplexes wavelengths, mapping energy to distinct sensor locations, enabling full-resolution recovery from superpixel-level encodings. ADIS directly leverages theoretically computed PSFs to enable calibration-free spectral reconstruction, while tolerating lens-dependent variations across different optical configurations and bridging the gap between simulation and reality. To achieve SSI by solving a sparsely-constrained inverse problem, we introduce the Orthogonal Diffraction-Aware Unfolding Framework (ODAUF) with Voxel Shift Transformer (VST) for improved orthogonal diffraction perception. Integrating VST into ODAUF forms the efficient Orthogonal Diffraction-Aware Unfolding Voxel Shift Transformer (ODAUVST), delivering excellent recovery and reduced parameters. By elaborating on theory, systematic and comprehensive comparing, and demonstrating real SSI results, we validate the superiority of ADIS, achieving calibration-free full-resolution SSI within a commercial camera footprint.