用于太像素图像处理的集成光子编码器
Integrated Photonic Encoder for Terapixel Image Processing
AI总结:
本文提出基于硅光子前端与无源无序结构的模拟光子编码器,通过核型随机投影实现低功耗高速图像压缩,并由神经网络以超过90%结构相似度重建图像。
摘要:
现代镜头设计能够解析超过100亿像素,而相机帧率和高光谱成像的进展已使太像素/秒数据采集成为现实可能。阻碍此类高数据速率系统的主要瓶颈是功耗和数据存储。在本工作中,我们表明模拟光子编码器可以应对这一挑战,能够以比数字电子设备低几个数量级的功耗实现高速图像压缩。我们的方法依赖硅光子前端来压缩原始图像数据,避免耗能的图像预处理并降低数据存储需求。该压缩方案使用无源无序光子结构,以极低功耗和低延迟对原始图像数据执行核型随机投影。随后,后端神经网络可以重建原始图像,结构相似度超过90%。该方案有潜力以低于100飞焦/像素的能耗处理太像素/秒数据流,为超高分辨率数据和图像采集系统提供一条路径。
英文摘要:
Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process Terapixel/s data streams using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。