基于MoIL的工业领域复杂工作活动识别中SSL的初步研究
Preliminary Investigation of SSL for Complex Work Activity Recognition in Industrial Domain via MoIL
AI总结:
本研究提出基序识别学习(MoIL)自监督方法,利用传感器数据基序预训练神经网络,在有限标签下实现工业复杂工作活动的高精度识别。
摘要:
在本研究中,我们探讨了一种新的自监督学习(SSL)方法,用于利用可穿戴传感器进行复杂工作活动识别。由于标记传感器数据采集的成本,有效利用未标记数据进行预训练的人类活动识别(HAR)的SSL方法已引起关注。然而,将先前的SSL应用于复杂工作活动(如包装工作)具有挑战性,因为观测数据会因情况而异,例如在包装工作中,待包装物品的数量和物品的尺寸等。在本研究中,我们聚焦于特定活动中特征性和必要动作对应的传感器数据(传感器数据基序),例如在组装箱子活动中的拉伸包装胶带动作,并尝试以自监督学习方式训练神经网络,使其识别特征性动作的发生,即基序识别学习(MoIL)。网络中的特征提取器用于下游任务,即工作活动识别,从而在有限的标记训练数据下实现包含特征性动作的精确活动识别。MoIL方法在真实世界的工作活动数据上进行了评估,在有限的训练标签下取得了最先进的性能。
英文摘要:
In this study, we investigate a new self-supervised learning (SSL) approach for complex work activity recognition using wearable sensors. Owing to the cost of labeled sensor data collection, SSL methods for human activity recognition (HAR) that effectively use unlabeled data for pretraining have attracted attention. However, applying prior SSL to complex work activities such as packaging works is challenging because the observed data vary considerably depending on situations such as the number of items to pack and the size of the items in the case of packaging works. In this study, we focus on sensor data corresponding to characteristic and necessary actions (sensor data motifs) in a specific activity such as a stretching packing tape action in an assembling a box activity, and \textcolor{black}{try} to train a neural network in self-supervised learning so that it identifies occurrences of the characteristic actions, i.e., Motif Identification Learning (MoIL). The feature extractor in the network is used in the downstream task, i.e., work activity recognition, enabling precise activity recognition containing characteristic actions with limited labeled training data. The MoIL approach was evaluated on real-world work activity data and it achieved state-of-the-art performance under limited training labels.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。