arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2206.04855cs.LGeess.SP
收藏

超越欧几里德空间之门:时间分辨融合与基于注意力的图神经网络人体活动识别

Beyond the Gates of Euclidean Space: Temporal-Discrimination-Fusions and Attention-based Graph Neural Network for Human Activity Recognition

The Chinese University of Hong Kong(香港中文大学)

Nafees Ahmad, Savio Ho-Chit Chow, Ho-fung Leung

摘要:

通过可穿戴设备的人类活动识别(HAR)由于其在健身跟踪、健康筛查和支持性生活中的众多应用而引起了人们的极大兴趣。因此,我们看到在这一领域开展了大量工作。传统的深度学习(DL)已经为HAR领域提供了最先进的性能。但是,它忽略了数据的结构和连续时间戳之间的关联。为了解决这个问题,我们提供了一种基于图神经网络(GNNs)的方法来构建输入表示并利用样本之间的关系。然而,即使使用简单的图卷积网络来消除这种不足,仍然存在几个限制因素,例如类间活动问题,倾斜的类分布以及缺乏对传感器数据优先级的考虑,所有这些都损害了HAR模型的性能。为了提高目前的HAR模型的性能,我们研究了新的可能性的框架内的图结构,以实现高度歧视和丰富的活动功能。我们提出了一个模型:(1)时间序列图模块,将HAR数据集的原始数据转换为图形;(2)图卷积神经网络(GCN),以发现相邻节点之间的局部依赖关系和相关性;(3)自注意GNN编码器,以识别传感器交互和数据优先级。据我们所知,这是HAR的第一项工作,它引入了一种基于GNN的方法,该方法结合了GCN和注意力机制。通过采用统一的评价方法,我们的框架显着提高了性能的医院病人的活动数据集相比,考虑其他国家的最先进的基线方法。

英文摘要:

Human activity recognition (HAR) through wearable devices has received much interest due to its numerous applications in fitness tracking, wellness screening, and supported living. As a result, we have seen a great deal of work in this field. Traditional deep learning (DL) has set a state of the art performance for HAR domain. However, it ignores the data's structure and the association between consecutive time stamps. To address this constraint, we offer an approach based on Graph Neural Networks (GNNs) for structuring the input representation and exploiting the relations among the samples. However, even when using a simple graph convolution network to eliminate this shortage, there are still several limiting factors, such as inter-class activities issues, skewed class distribution, and a lack of consideration for sensor data priority, all of which harm the HAR model's performance. To improve the current HAR model's performance, we investigate novel possibilities within the framework of graph structure to achieve highly discriminated and rich activity features. We propose a model for (1) time-series-graph module that converts raw data from HAR dataset into graphs; (2) Graph Convolutional Neural Networks (GCNs) to discover local dependencies and correlations between neighboring nodes; and (3) self-attention GNN encoder to identify sensors interactions and data priorities. To the best of our knowledge, this is the first work for HAR, which introduces a GNN-based approach that incorporates both the GCN and the attention mechanism. By employing a uniform evaluation method, our framework significantly improves the performance on hospital patient's activities dataset comparatively considered other state of the art baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑