面向字节大小整数通用矩阵乘法(GEMM)内核的模拟光子加速器扩展
Scaling Analog Photonic Accelerators for Byte-Size, Integer General Matrix Multiply (GEMM) Kernels
AI总结:
本文提出可扩展光子GEMM加速器SPOGA,通过零差光信号模拟求和与换能中位置加权等技术,突破4位操作数限制,支持字节大小整数GEMM内核,在吞吐量、能效和面积效率上显著超越现有光子方案。
摘要:
深度神经网络(DNNs)主要依赖通用矩阵乘法(GEMM)内核,这些内核通常使用专用硬件架构进行加速。近年来,模拟光子GEMM加速器已成为一种有前景的替代方案,与传统电子加速器相比,其速度和能效具有极大优势。然而,由于模拟动态范围与并行性之间的固有权衡,这些光子加速器无法支持超过4位宽度的整数操作数。这对于DNN训练通常是不够的,因为至少需要8位宽的操作数才能防止显著的精度下降。为了解决这些局限性,我们提出了一种可扩展的光子GEMM加速器,名为SPOGA。SPOGA利用了增强特性,例如零差光信号的模拟求和以及操作数的换能中位置加权。通过采用一种扩展的光学-模拟数据流,最大限度地减少与位切片整数算术相关的开销,SPOGA支持字节大小的整数GEMM内核,在吞吐量、延迟和能效方面实现了显著提升。具体而言,与现有最先进的光子解决方案相比,SPOGA在每秒帧数(FPS)、FPS/Watt和FPS/Watt/mm²方面分别实现了高达14.4倍、2倍和28.5倍的改进。
英文摘要:
Deep Neural Networks (DNNs) predominantly rely on General Matrix Multiply (GEMM) kernels, which are often accelerated using specialized hardware architectures. Recently, analog photonic GEMM accelerators have emerged as a promising alternative, offering vastly superior speed and energy efficiency compared to traditional electronic accelerators. However, these photonic cannot support wider than 4-bit integer operands due to their inherent trade-offs between analog dynamic range and parallelism. This is often inadequate for DNN training as at least 8-bit wide operands are deemed necessary to prevent significant accuracy drops. To address these limitations, we introduce a scalable photonic GEMM accelerator named SPOGA. SPOGA utilizes enhanced features such as analog summation of homodyne optical signals and in-transduction positional weighting of operands. By employing an extended optical-analog dataflow that minimizes overheads associated with bit-sliced integer arithmetic, SPOGA supports byte-size integer GEMM kernels, achieving significant improvements in throughput, latency, and energy efficiency. Specifically, SPOGA demonstrates up to 14.4$\times$, 2$\times$, and 28.5$\times$ improvements in frames-per-second (FPS), FPS/Watt, and FPS/Watt/mm$^2$ respectively, compared to existing state-of-the-art photonic solutions.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。