arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.04554physics.opticseess.IV
收藏

用于太像素图像处理的集成光子编码器

Integrated Photonic Encoder for Terapixel Image Processing

Xiao Wang, Brandon Redding, Nicholas Karl, Christopher Long, Zheyuan Zhu, Shuo Pang, David Brady, Raktim Sarma

AI总结:

本文提出基于硅光子前端与无源无序结构的模拟光子编码器,通过核型随机投影实现低功耗高速图像压缩,并由神经网络以超过90%结构相似度重建图像。

摘要:

现代镜头设计能够解析超过100亿像素,而相机帧率和高光谱成像的进展已使太像素/秒数据采集成为现实可能。阻碍此类高数据速率系统的主要瓶颈是功耗和数据存储。在本工作中,我们表明模拟光子编码器可以应对这一挑战,能够以比数字电子设备低几个数量级的功耗实现高速图像压缩。我们的方法依赖硅光子前端来压缩原始图像数据,避免耗能的图像预处理并降低数据存储需求。该压缩方案使用无源无序光子结构,以极低功耗和低延迟对原始图像数据执行核型随机投影。随后,后端神经网络可以重建原始图像,结构相似度超过90%。该方案有潜力以低于100飞焦/像素的能耗处理太像素/秒数据流,为超高分辨率数据和图像采集系统提供一条路径。

英文摘要:

Modern lens designs are capable of resolving >10 gigapixels, while advances in camera frame-rate and hyperspectral imaging have made Terapixel/s data acquisition a real possibility. The main bottlenecks preventing such high data-rate systems are power consumption and data storage. In this work, we show that analog photonic encoders could address this challenge, enabling high-speed image compression using orders-of-magnitude lower power than digital electronics. Our approach relies on a silicon-photonics front-end to compress raw image data, foregoing energy-intensive image conditioning and reducing data storage requirements. The compression scheme uses a passive disordered photonic structure to perform kernel-type random projections of the raw image data with minimal power consumption and low latency. A back-end neural network can then reconstruct the original images with structural similarity exceeding 90%. This scheme has the potential to process Terapixel/s data streams using less than 100 fJ/pixel, providing a path to ultra-high-resolution data and image acquisition systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑