Lightator:一种支持压缩采集、可实现多功能图像处理的光学近传感器加速器
Lightator: An Optical Near-Sensor Accelerator with Compressive Acquisition Enabling Versatile Image Processing
AI总结:
本研究提出光学近传感器加速器Lightator,通过创新压缩采集与细粒度卷积实现边缘低功耗图像处理,仿真显示其能效达84.4千帧每秒每瓦,功耗较现有光子加速器和GPU分别低约24倍、73倍。
摘要:
本文提出了一种面向视觉应用的高性能、高能效光学近传感器加速器,名为Lightator。借助光子器件的可观效率优势,Lightator首次实现了创新的输入帧压缩采集与细粒度卷积运算,可在边缘端完成低功耗、多功能的图像处理。这将大幅降低现有以云为中心的架构以及近期设计的边缘加速器中转换、传输与处理环节的能耗与延迟。我们的器件到架构仿真结果表明,在精度表现良好的情况下,Lightator达到84.4千帧每秒每瓦(Kilo FPS/W)的能效,与现有光子加速器和GPU基线相比,平均功耗分别降低约24倍和73倍。
英文摘要:
This paper proposes a high-performance and energy-efficient optical near-sensor accelerator for vision applications, called Lightator. Harnessing the promising efficiency offered by photonic devices, Lightator features innovative compressive acquisition of input frames and fine-grained convolution operations for low-power and versatile image processing at the edge for the first time. This will substantially diminish the energy consumption and latency of conversion, transmission, and processing within the established cloud-centric architecture as well as recently designed edge accelerators. Our device-to-architecture simulation results show that with favorable accuracy, Lightator achieves 84.4 Kilo FPS/W and reduces power consumption by a factor of ~24x and 73x on average compared with existing photonic accelerators and GPU baseline.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。