稀疏脉动张量阵列的错误检查
Error Checking for Sparse Systolic Tensor Arrays
AI总结:
本文针对安全关键系统中稀疏脉动张量阵列的随机硬件故障问题,提出一种基于算法容错的低成本在线错误检查架构,在保持硬件高利用率的同时实现了最小硬件开销和可靠的错误检测。
摘要:
结构化稀疏是一种有效的方法,用于降低现代机器学习(ML)应用的复杂性,并简化硬件中稀疏数据的处理。在这种情况下,结构化稀疏ML模型的加速由稀疏脉动张量阵列处理。ML在安全关键系统中的日益普及要求增强稀疏张量阵列的在线错误检测能力,以管理随机硬件故障。基于算法的容错已被提出作为一种低成本机制,用于在线检查计算结果是否存在随机硬件故障。在这项工作中,我们解决了结构化稀疏张量阵列的一个关键架构挑战:如何在保持硬件高利用率的同时,为一系列结构化稀疏级别提供在线错误检查。实验结果突出了所提出的检查逻辑产生的最小硬件开销,及其在执行ResNet50 CNN层的稀疏张量阵列上注入随机硬件故障后的错误检测特性。
英文摘要:
Structured sparsity is an efficient way to prune the complexity of modern Machine Learning (ML) applications and to simplify the handling of sparse data in hardware. In such cases, the acceleration of structured-sparse ML models is handled by sparse systolic tensor arrays. The increasing prevalence of ML in safety-critical systems requires enhancing the sparse tensor arrays with online error detection for managing random hardware failures. Algorithm-based fault tolerance has been proposed as a low-cost mechanism to check online the result of computations against random hardware failures. In this work, we address a key architectural challenge with structured-sparse tensor arrays: how to provide online error checking for a range of structured sparsity levels while maintaining high utilization of the hardware. Experimental results highlight the minimum hardware overhead incurred by the proposed checking logic and its error detection properties after injecting random hardware faults on sparse tensor arrays that execute layers of ResNet50 CNN.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。