arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2304.03320cs.AR
收藏

CamJ:实现传感器内视觉计算的系统级能量建模与架构探索

CamJ: Enabling System-Level Energy Modeling and Architectural Exploration for In-Sensor Visual Computing

Tianrui Ma, Yu Feng, Xuan Zhang, Yuhao Zhu

AI总结:

本文提出CamJ能量建模框架,为计算型CMOS图像传感器提供组件级能量分解,并利用该框架探索了CIS内外计算、2D与3D堆叠及模数处理等架构权衡。

摘要:

CMOS图像传感器(CIS)是新兴视觉计算应用的基础。传统CIS纯粹是用于捕捉图像的成像设备,而CIS日益集成如深度神经网络(DNN)等处理能力。计算型CIS扩展了架构设计空间,但迄今为止尚无综合能量模型。本文提出CamJ,这是一个详细的能量建模框架,可为计算型CIS提供组件级能量分解,并已通过9款近期CIS芯片验证。我们利用CamJ演示了三个探索架构权衡的用例,包括CIS内计算与CIS外计算、2D与3D堆叠CIS设计,以及CIS内模拟与数字处理。CamJ代码可在:https://github.com/horizon-research/CamJ获取。

英文摘要:

CMOS Image Sensors (CIS) are fundamental to emerging visual computing applications. While conventional CIS are purely imaging devices for capturing images, increasingly CIS integrate processing capabilities such as Deep Neural Network (DNN). Computational CIS expand the architecture design space, but to date no comprehensive energy model exists. This paper proposes CamJ, a detailed energy modeling framework that provides a component-level energy breakdown for computational CIS and is validated against nine recent CIS chips. We use CamJ to demonstrate three use-cases that explore architectural trade-offs including computing in vs. off CIS, 2D vs. 3D-stacked CIS design, and analog vs. digital processing inside CIS. The code of CamJ is available at: https://github.com/horizon-research/CamJ

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑