arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2203.12932eess.SPcs.LG
收藏

Bioformers:嵌入Transformers实现超低功耗sEMG-based手势识别

Bioformers: Embedding Transformers for Ultra-Low Power sEMG-based Gesture Recognition

Università di Bologna(博洛尼亚大学);Politecnico di Torino(都灵理工大学);ETH Zurich(苏黎世联邦理工学院);University of Modena and Reggio Emilia(摩德纳-雷焦艾米利亚大学)

Alessio Burrello, Francesco Bianco Morghet, Moritz Scherer, Simone Benatti, Luca Benini, Enrico Macii, Massimo Poncino, Daniele Jahier Pagliari

摘要:

人机交互在康复任务中越来越受到关注,例如控制假肢或机器人手臂。利用表面肌电信号(sEMG)信号进行手势识别是最有前途的方法之一,因为sEMG信号采集是无创的并且与肌肉收缩直接相关。然而,这些信号的分析仍然存在许多挑战,因为相似的手势会导致相似的肌肉收缩。因此,得到的信号形状几乎相同,导致低分类精度。为了应对这一挑战,采用了复杂的神经网络,这需要大量的内存,消耗相对较高的能量,并限制了用于分类的设备的最大电池寿命。这项工作解决了这个问题,引入了生物成形剂。这一新的超小型注意力架构系列接近最先进的性能,同时减少了4.9倍的参数和操作数量。此外,通过引入新的受试者间预训练,我们将我们最好的Bioformer的准确性提高了3.39%,与最先进的准确性相匹配,而无需任何额外的推理成本。在并行超低功耗(PULP)微控制器单元(MCU)GreenWaves GAP 8上部署我们性能最好的Bioformer,我们实现了推理延迟和能量分别为2.72 ms和0.14 mJ,比之前最先进的神经网络低8.0倍,同时仅占用94.2 kB内存。

英文摘要:

Human-machine interaction is gaining traction in rehabilitation tasks, such as controlling prosthetic hands or robotic arms. Gesture recognition exploiting surface electromyographic (sEMG) signals is one of the most promising approaches, given that sEMG signal acquisition is non-invasive and is directly related to muscle contraction. However, the analysis of these signals still presents many challenges since similar gestures result in similar muscle contractions. Thus the resulting signal shapes are almost identical, leading to low classification accuracy. To tackle this challenge, complex neural networks are employed, which require large memory footprints, consume relatively high energy and limit the maximum battery life of devices used for classification. This work addresses this problem with the introduction of the Bioformers. This new family of ultra-small attention-based architectures approaches state-of-the-art performance while reducing the number of parameters and operations of 4.9X. Additionally, by introducing a new inter-subjects pre-training, we improve the accuracy of our best Bioformer by 3.39%, matching state-of-the-art accuracy without any additional inference cost. Deploying our best performing Bioformer on a Parallel, Ultra-Low Power (PULP) microcontroller unit (MCU), the GreenWaves GAP8, we achieve an inference latency and energy of 2.72 ms and 0.14 mJ, respectively, 8.0X lower than the previous state-of-the-art neural network, while occupying just 94.2 kB of memory.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑