arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2308.03514cs.LGeess.SP
收藏

利用近体电场进行制造流水线中的工人活动识别

Worker Activity Recognition in Manufacturing Line Using Near-body Electric Field

German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心);RPTU Kaiserslautern-Landau(凯泽斯劳滕-兰道莱茵兰-普法尔茨工业大学);Jožef Stefan International Postgraduate School(约热夫·斯特凡国际研究生院)

Sungho Suh, Vitor Fortes Rey, Sizhen Bian, Yu-Chi Huang, Jože M. Rožanec, Hooman Tavakoli Ghinani, Bo Zhou, Paul Lukowicz

AI总结:

本文提出融合IMU与人体电容传感的可穿戴原型,结合多通道时序CNN和深度卷积LSTM及多模态融合方法,实现制造流水线工人活动识别,实验显示其性能优于基线方法。

摘要:

制造业力求通过部署先进的传感与控制系统来提高生产效率和产品质量。可穿戴传感器正成为实现这一目标的有前景的解决方案,因为它们能够对制造流水线中工人的活动进行连续且不引人注目的监测。本文提出了一种新型可穿戴传感原型,该原型结合了IMU和人体电容传感模块,用于识别制造流水线中的工人活动。为了处理这些多模态传感器数据,我们针对多通道时间序列卷积神经网络和深度卷积LSTM,提出并比较了早期和晚期传感器数据融合方法。我们通过在制造流水线测试平台上使用所提出的传感原型和Apple Watch收集并标注传感器数据,对所提出的硬件和神经网络模型进行了评估。实验结果表明,与基线方法相比,我们所提出的方法取得了更优的性能,表明该方法在制造业实际应用中具有潜力。此外,带有体电容传感器和特征融合方法的所提传感原型性能提升了6.35%,其宏观F1分数分别比不带体电容传感器的所提传感原型和Apple Watch数据高出9.38%。

英文摘要:

Manufacturing industries strive to improve production efficiency and product quality by deploying advanced sensing and control systems. Wearable sensors are emerging as a promising solution for achieving this goal, as they can provide continuous and unobtrusive monitoring of workers' activities in the manufacturing line. This paper presents a novel wearable sensing prototype that combines IMU and body capacitance sensing modules to recognize worker activities in the manufacturing line. To handle these multimodal sensor data, we propose and compare early, and late sensor data fusion approaches for multi-channel time-series convolutional neural networks and deep convolutional LSTM. We evaluate the proposed hardware and neural network model by collecting and annotating sensor data using the proposed sensing prototype and Apple Watches in the testbed of the manufacturing line. Experimental results demonstrate that our proposed methods achieve superior performance compared to the baseline methods, indicating the potential of the proposed approach for real-world applications in manufacturing industries. Furthermore, the proposed sensing prototype with a body capacitive sensor and feature fusion method improves by 6.35%, yielding a 9.38% higher macro F1 score than the proposed sensing prototype without a body capacitive sensor and Apple Watch data, respectively.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑