arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2205.12781cs.LGeess.SP
收藏

超紧凑二进制神经网络在RISC-V处理器上的人体活动识别

Ultra-compact Binary Neural Networks for Human Activity Recognition on RISC-V Processors

Politecnico di Torino(都灵理工大学);University of Bologna(博洛尼亚大学);STMicroelectronics(意法半导体)

Francesco Daghero, Chen Xie, Daniele Jahier Pagliari, Alessio Burrello, Marco Castellano, Luca Gandolfi, Andrea Calimera, Enrico Macii, Massimo Poncino

摘要:

人类活动识别(HAR)是许多移动应用中的相关推理任务。最先进的边缘HAR通常通过决策树和随机森林(RF)等轻量级机器学习模型来实现,而深度学习由于其高计算复杂性而不太常见。在这项工作中,我们提出了一种基于深度神经网络的HAR的新实现,并且精确地基于二进制神经网络(BNN),目标是具有RISC-V指令集的低功耗通用处理器。BNN产生非常小的内存占用和低推理复杂度,这要归功于用逐位运算代替算术运算。然而,通用处理器上的现有BNN实现强加了针对复杂计算机视觉任务定制的约束,这导致针对HAR等简单问题的过度参数化模型。因此,我们还引入了一个新的BNN推理库,它明确针对超紧凑模型。通过在单核RISC-V处理器上的实验,我们表明,与基于RF的最先进基线相比,在两个HAR数据集上训练的BNN获得了更高的分类精度。此外,我们的BNN达到了与RF相同的精度,并且根据RF提取的特征的复杂性,具有更少的内存(高达91%)或更高的能效(高达70%)。

英文摘要:

Human Activity Recognition (HAR) is a relevant inference task in many mobile applications. State-of-the-art HAR at the edge is typically achieved with lightweight machine learning models such as decision trees and Random Forests (RFs), whereas deep learning is less common due to its high computational complexity. In this work, we propose a novel implementation of HAR based on deep neural networks, and precisely on Binary Neural Networks (BNNs), targeting low-power general purpose processors with a RISC-V instruction set. BNNs yield very small memory footprints and low inference complexity, thanks to the replacement of arithmetic operations with bit-wise ones. However, existing BNN implementations on general purpose processors impose constraints tailored to complex computer vision tasks, which result in over-parametrized models for simpler problems like HAR. Therefore, we also introduce a new BNN inference library, which targets ultra-compact models explicitly. With experiments on a single-core RISC-V processor, we show that BNNs trained on two HAR datasets obtain higher classification accuracy compared to a state-of-the-art baseline based on RFs. Furthermore, our BNN reaches the same accuracy of a RF with either less memory (up to 91%) or more energy-efficiency (up to 70%), depending on the complexity of the features extracted by the RF.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑