arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2202.12938eess.SPcs.LG
收藏

使用可穿戴设备评估自我监督人类活动识别的状态

Assessing the State of Self-Supervised Human Activity Recognition using Wearables

Georgia Institute of Technology(佐治亚理工学院)

Harish Haresamudram, Irfan Essa, Thomas Plötz

摘要:

自监督学习在基于可穿戴设备的人类活动识别(HAR)领域的出现为解决该领域最紧迫的挑战提供了机会,即利用未标记的数据来获得可靠的识别系统,以适应只能收集少量标记训练样本的情况。因此,自我监督,即,“预训练-然后微调”的范例有可能成为主要的端到端训练方法的强有力的替代方案,更不用说用于经典活动识别链的手工制作的特征了。最近,许多将自监督学习引入HAR领域的贡献,包括多任务自监督,Masked Reconstruction,CPC和Simplified,仅举几例。随着这些方法的初步成功,现在已经到了对该领域潜在的自我监督学习进行系统盘点和分析的时候了。这份文件提供的正是这一点。我们通过引入一个框架来评估自监督HAR研究的进展,该框架对模型性能进行了多方面的探索。我们将框架组织成三个维度,每个维度包含三个组成标准,每个维度都可以捕获性能的特定方面,包括对不同源和目标条件的鲁棒性,数据集特征的影响以及特征空间特征。我们利用这个框架来评估HAR的七种最先进的自监督方法,从而形成对这些技术属性的见解,并建立它们对不同场景的学习表示的价值。

英文摘要:

The emergence of self-supervised learning in the field of wearables-based human activity recognition (HAR) has opened up opportunities to tackle the most pressing challenges in the field, namely to exploit unlabeled data to derive reliable recognition systems for scenarios where only small amounts of labeled training samples can be collected. As such, self-supervision, i.e., the paradigm of 'pretrain-then-finetune' has the potential to become a strong alternative to the predominant end-to-end training approaches, let alone hand-crafted features for the classic activity recognition chain. Recently a number of contributions have been made that introduced self-supervised learning into the field of HAR, including, Multi-task self-supervision, Masked Reconstruction, CPC, and SimCLR, to name but a few. With the initial success of these methods, the time has come for a systematic inventory and analysis of the potential self-supervised learning has for the field. This paper provides exactly that. We assess the progress of self-supervised HAR research by introducing a framework that performs a multi-faceted exploration of model performance. We organize the framework into three dimensions, each containing three constituent criteria, such that each dimension captures specific aspects of performance, including the robustness to differing source and target conditions, the influence of dataset characteristics, and the feature space characteristics. We utilize this framework to assess seven state-of-the-art self-supervised methods for HAR, leading to the formulation of insights into the properties of these techniques and to establish their value towards learning representations for diverse scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑