arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2402.07393cs.ETcs.AIcs.LG
收藏

TeMPO:面向边缘AI的时分复用动态光子张量核心,采用紧凑型慢光电光调制器

TeMPO: Efficient Time-Multiplexed Dynamic Photonic Tensor Core for Edge AI with Compact Slow-Light Electro-Optic Modulator

Rensselaer Polytechnic Institute(伦斯勒理工学院);Arizona State University(亚利桑那州立大学)

Meng Zhang, Dennis Yin, Nicholas Gangi, Amir Begović, Alexander Chen, Zhaoran Rena Huang, Jiaqi Gu

AI总结:

提出跨层定制的时分复用动态光子张量加速器TeMPO,通过慢光调制器等器件和电路优化,在边缘AI任务中实现368.6 TOPS峰值性能与22.3 TOPS/W能效,推动边缘AI硬件前沿。

摘要:

电子-光子计算系统在能效型人工智能(AI)加速任务中具有巨大潜力,这得益于光学在计算速度和效率上的优势,尤其是在资源受限的边缘平台上进行实时、低能耗的深度神经网络(DNN)推理任务。然而,基于代工厂可用器件和传统系统架构的当前光学神经网络加速器,与高度定制的电子同类产品相比,仍面临性能差距。为了弥合因缺乏领域专用化导致的性能差距,我们提出了一种时分复用动态光子张量加速器,名为TeMPO,具备跨层器件/电路/架构定制。在器件层面,我们提出了代工厂兼容的定制光子器件,包括经实验演示的慢光电光调制器、光分束器和相移器,显著减小了输入编码和点积计算的占用面积和功耗。在电路层面,通过并行光电流聚合、轻量级电容时间积分和顺序数字求和,分层累加部分积,极大缓解了模数转换瓶颈。我们还采用多切片、多核架构来最大化硬件共享以提高效率。在多样化的边缘AI工作负载中,TeMPO提供了与数字计算相当的 task accuracy,并具有卓越的量化/噪声容忍度。我们实现了368.6 TOPS的峰值性能、22.3 TOPS/W的能效和1.2 TOPS/mm$^2$的计算密度,推动了边缘AI硬件的帕累托前沿。这项工作彰显了跨层协同设计和领域专用定制的力量,为未来具备更高性能和效率的电子-光子加速器铺平了道路。

英文摘要:

Electronic-photonic computing systems offer immense potential in energy-efficient artificial intelligence (AI) acceleration tasks due to the superior computing speed and efficiency of optics, especially for real-time, low-energy deep neural network (DNN) inference tasks on resource-restricted edge platforms. However, current optical neural accelerators based on foundry-available devices and conventional system architecture still encounter a performance gap compared to highly customized electronic counterparts. To bridge the performance gap due to lack of domain specialization, we present a time-multiplexed dynamic photonic tensor accelerator, dubbed TeMPO, with cross-layer device/circuit/architecture customization. At the device level, we present foundry-compatible, customized photonic devices, including a slow-light electro-optic modulator with experimental demonstration, optical splitters, and phase shifters that significantly reduce the footprint and power in input encoding and dot-product calculation. At the circuit level, partial products are hierarchically accumulated via parallel photocurrent aggregation, lightweight capacitive temporal integration, and sequential digital summation, considerably relieving the analog-to-digital conversion bottleneck. We also employ a multi-tile, multi-core architecture to maximize hardware sharing for higher efficiency. Across diverse edge AI workloads, TeMPO delivers digital-comparable task accuracy with superior quantization/noise tolerance. We achieve a 368.6 TOPS peak performance, 22.3 TOPS/W energy efficiency, and 1.2 TOPS/mm$^2$ compute density, pushing the Pareto frontier in edge AI hardware. This work signifies the power of cross-layer co-design and domain-specific customization, paving the way for future electronic-photonic accelerators with even greater performance and efficiency.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑