arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.16442cs.CVcs.AIcs.RO
收藏

通过图卷积网络和Transformer架构中的优化参数集成特征以识别人类活动

Integrating Features for Recognizing Human Activities through Optimized Parameters in Graph Convolutional Networks and Transformer Architectures

Khalifa University(哈利法大学);Abu Dhabi University(阿布扎比大学)

Mohammad Belal, Taimur Hassan, Abdelfatah Hassan, Nael Alsheikh, Noureldin Elhendawi, Irfan Hussain

AI总结:

本研究提出一种特征融合技术,将Transformer与参数优化的图卷积网络(PO-GCN)的最终层特征集成输入分类器,在四个公开数据集上验证了该方法显著提升了人类活动识别的准确率与F1分数。

摘要:

人类活动识别是一个重要的研究领域,它采用计算机视觉、机器视觉和深度学习技术对人类动作进行分类。深度学习领域取得了重大进展,其架构在捕捉人类动态方面极为有效。本研究强调了特征融合对活动识别准确率的影响。该技术解决了传统模型的局限性,传统模型由于理解时空特征的能力有限,在识别活动时面临困难。该技术采用了来自四个公开数据集的传感数据:HuGaDB、PKU-MMD、LARa和TUG。使用这些数据集评估了两个深度学习模型的准确率和F1分数,具体为Transformer模型和参数优化的图卷积网络(PO-GCN)。特征融合技术整合了两个模型的最终层特征,并将其输入到分类器中。实证证据表明,PO-GCN在活动识别中优于标准模型。HuGaDB的准确率提高了2.3%,F1分数提高了2.2%。TUG的准确率提高了5%,F1分数提高了0.5%。另一方面,LARa和PKU-MMD分别取得了64%和69%的较低准确率。这表明特征集成增强了Transformer模型和PO-GCN两者的性能。

英文摘要:

Human activity recognition is a major field of study that employs computer vision, machine vision, and deep learning techniques to categorize human actions. The field of deep learning has made significant progress, with architectures that are extremely effective at capturing human dynamics. This study emphasizes the influence of feature fusion on the accuracy of activity recognition. This technique addresses the limitation of conventional models, which face difficulties in identifying activities because of their limited capacity to understand spatial and temporal features. The technique employs sensory data obtained from four publicly available datasets: HuGaDB, PKU-MMD, LARa, and TUG. The accuracy and F1-score of two deep learning models, specifically a Transformer model and a Parameter-Optimized Graph Convolutional Network (PO-GCN), were evaluated using these datasets. The feature fusion technique integrated the final layer features from both models and inputted them into a classifier. Empirical evidence demonstrates that PO-GCN outperforms standard models in activity recognition. HuGaDB demonstrated a 2.3% improvement in accuracy and a 2.2% increase in F1-score. TUG showed a 5% increase in accuracy and a 0.5% rise in F1-score. On the other hand, LARa and PKU-MMD achieved lower accuracies of 64% and 69% respectively. This indicates that the integration of features enhanced the performance of both the Transformer model and PO-GCN.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑