arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2409.06341eess.SP
收藏

用于实时厨房活动识别的可穿戴多模态边缘计算系统

A Wearable Multi-Modal Edge-Computing System for Real-Time Kitchen Activity Recognition

Mengxi Liu, Sungho Suh, Juan Felipe Vargas, Bo Zhou, Agnes Grünerbl, Paul Lukowicz

AI总结:

本文设计集成六类传感器与双微控制器的可穿戴多模态边缘系统,在本地端到端实时识别厨房活动,并以184.5 kB模型实现87.83%准确率和25.26 ms推理。

摘要:

在人类活动识别研究领域,以往研究主要集中于在公共数据集上利用先进算法提升识别性能,而很少关注在节能、高性价比的边缘设备上执行实时厨房活动识别。此外,将数据采集与情境提取分离到不同设备上的普遍做法会增加功耗、延迟和用户隐私风险,阻碍其广泛应用。本工作提出了一种用于实时人类活动识别的多模态可穿戴边缘计算系统。该系统集成了从惯性测量单元(IMU)到热成像相机的六种不同传感器以及两种不同微控制器,在本地实现了从数据捕获到情境提取的端到端活动识别。在未经改造的真实厨房中进行的评估验证了其识别包括空类在内的十五种活动的有效性。采用184.5千字节的紧凑机器学习模型,平均准确率达到87.83%,模型推理在微控制器上仅需25.26毫秒。与其他微控制器的对比分析展示了功耗和推理速度性能,证明了所提系统的可行性。

英文摘要:

In the human activity recognition research area, prior studies predominantly concentrate on leveraging advanced algorithms on public datasets to enhance recognition performance, little attention has been paid to executing real-time kitchen activity recognition on energy-efficient, cost-effective edge devices. Besides, the prevalent approach of segregating data collection and context extraction across different devices escalates power usage, latency, and user privacy risks, impeding widespread adoption. This work presents a multi-modal wearable edge computing system for human activity recognition in real-time. Integrating six different sensors, ranging from inertial measurement units (IMUs) to thermal cameras, and two different microcontrollers, this system achieves end-to-end activity recognition, from data capture to context extraction, locally. Evaluation in an unmodified realistic kitchen validates its efficacy in recognizing fifteen activities, including a null class. Employing a compact machine learning model (184.5 kbytes) yields an average accuracy of 87.83 \%, with model inference completed in 25.26 ms on the microcontroller. Comparative analysis with alternative microcontrollers showcases power consumption and inference speed performance, demonstrating the proposed system's viability.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑