arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.04562cs.AR
收藏

用于深度神经网络加速器的简化Softmax单元

Reduced Softmax Unit for Deep Neural Network Accelerators

Raghuram S

摘要:

Softmax激活层是处理多类预测问题时非常流行的深度神经网络(DNN)组件。然而,在DNN加速器实现中,由于需要计算其每个输入的指数,它会产生额外的复杂性。在这个简短的,我们提出了一个简化版本的激活单元的加速器,其中只有一个比较器单元产生的分类结果,通过选择最大的输入。由于激活函数的性质,我们证明了这个结果总是与Softmax层产生的分类相同。

英文摘要:

The Softmax activation layer is a very popular Deep Neural Network (DNN) component when dealing with multi-class prediction problems. However, in DNN accelerator implementations it creates additional complexities due to the need for computation of the exponential for each of its inputs. In this brief we propose a simplified version of the activation unit for accelerators, where only a comparator unit produces the classification result, by choosing the maximum among its inputs. Due to the nature of the activation function, we show that this result is always identical to the classification produced by the Softmax layer.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑