arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2301.05748eess.SP
收藏

在可穿戴资源受限设备上探索本地自动健身房锻炼识别

Exploring Automatic Gym Workouts Recognition Locally On Wearable Resource-Constrained Devices

Sizhen Bian, Xiaying Wang, Tommaso Polonelli, Michele Magno

摘要:

在能源和资源受限的可穿戴设备上自动识别健身活动,消除了在激烈的健身课程中的人机交互要求-如轻触和滑动。这项工作提出了一个微小而高度精确的残差卷积神经网络,它在毫瓦微控制器中运行,用于自动训练分类。我们在三种资源受限的设备上评估了量化深度模型的推理性能:两个来自ST Microelectronics的ARM-Cortex M4和M7内核的微控制器,以及一个来自GreenWaves Technologies的开源多核RISC-V计算平台GAP 8片上系统。实验结果表明,在全精度推理的情况下,对11个训练项目的识别准确率高达90.4%。本文还提出了权衡性能的资源受限的系统。在保持识别准确率(88.1%)的同时,损失最小,每个推理在GAP 8上仅需3.2 ms,受益于8个RISC-V集群核心。我们测量到它的执行时间比Cortex-M4和Cortex-M7内核快18.9倍和6.5倍,这表明基于所描述的数据集以20 Hz采样率进行实时板载训练识别的可行性。GAP 8上每个推理消耗的能量为0.41 mJ,而Cortex-M4上为5.17 mJ,Cortex-M7上为8.07 mJ。当系统由电池供电时,它可以延长电池寿命。我们还介绍了一个开放的数据集,由50个会议的11个健身房锻炼收集的10个主题是公开的。

英文摘要:

Automatic gym activity recognition on energy- and resource-constrained wearable devices removes the human-interaction requirement during intense gym sessions - like soft-touch tapping and swiping. This work presents a tiny and highly accurate residual convolutional neural network that runs in milliwatt microcontrollers for automatic workouts classification. We evaluated the inference performance of the deep model with quantization on three resource-constrained devices: two microcontrollers with ARM-Cortex M4 and M7 core from ST Microelectronics, and a GAP8 system on chip, which is an open-sourced, multi-core RISC-V computing platform from GreenWaves Technologies. Experimental results show an accuracy of up to 90.4% for eleven workouts recognition with full precision inference. The paper also presents the trade-off performance of the resource-constrained system. While keeping the recognition accuracy (88.1%) with minimal loss, each inference takes only 3.2 ms on GAP8, benefiting from the 8 RISC-V cluster cores. We measured that it features an execution time that is 18.9x and 6.5x faster than the Cortex-M4 and Cortex-M7 cores, showing the feasibility of real-time on-board workouts recognition based on the described data set with 20 Hz sampling rate. The energy consumed for each inference on GAP8 is 0.41 mJ compared to 5.17 mJ on Cortex-M4 and 8.07 mJ on Cortex-M7 with the maximum clock. It can lead to longer battery life when the system is battery-operated. We also introduced an open data set composed of fifty sessions of eleven gym workouts collected from ten subjects that is publicly available.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑