面向边缘计算赋能的元宇宙的基于压缩感知的轻量级人体姿态估计方法
A Lightweight Human Pose Estimation Approach for Edge Computing-Enabled Metaverse with Compressive Sensing
AI总结:
本文针对边缘计算元宇宙中IMU信号无线传输的冗余和噪声问题,提出基于随机高斯矩阵压缩感知的轻量级传输方法,并在接收端用深度生成模型恢复信号,仅用82%测量值即可高精度重建三维人体姿态,速度比Lasso快一个数量级。
摘要:
在边缘计算赋能的网络(如5G/6G网络)上估计用户三维运动的能力,是扩展现实(XR)和元宇宙应用新时代的关键使能技术。深度学习的最新进展表明,在给定来自传感器信号(即附着在XR设备上的惯性测量单元(IMU)传感器)的稀疏测量值时,其在估计三维人体姿态方面优于优化技术。然而,现有工作缺乏对无线系统的适用性,因为在有噪声的无线网络上传输IMU信号带来了重大挑战。此外,IMU信号的潜在冗余尚未被考虑,导致传输高度冗余。在这项工作中,我们提出了一种在有噪声无线环境中去除冗余和轻量级传输IMU信号的新方法。我们的方法利用随机高斯矩阵将原始信号变换到低维空间。通过利用压缩感知理论,我们证明了所设计的高斯矩阵能够将信号投影到低维空间,并在功率传输约束下保持集合受限特征值条件。此外,我们在接收端开发了一个深度生成模型,从有噪声的压缩数据中恢复原始IMU信号,从而能够在接收端为XR和元宇宙应用创建三维人体运动。在真实世界IMU数据集上的仿真结果表明,我们的框架仅使用原始信号82%的测量值即可实现用户的高精度三维人体姿态。这与基于优化的方法(即Lasso)相当,但速度快一个数量级。
英文摘要:
The ability to estimate 3D movements of users over edge computing-enabled networks, such as 5G/6G networks, is a key enabler for the new era of extended reality (XR) and Metaverse applications. Recent advancements in deep learning have shown advantages over optimization techniques for estimating 3D human poses given spare measurements from sensor signals, i.e., inertial measurement unit (IMU) sensors attached to the XR devices. However, the existing works lack applicability to wireless systems, where transmitting the IMU signals over noisy wireless networks poses significant challenges. Furthermore, the potential redundancy of the IMU signals has not been considered, resulting in highly redundant transmissions. In this work, we propose a novel approach for redundancy removal and lightweight transmission of IMU signals over noisy wireless environments. Our approach utilizes a random Gaussian matrix to transform the original signal into a lower-dimensional space. By leveraging the compressive sensing theory, we have proved that the designed Gaussian matrix can project the signal into a lower-dimensional space and preserve the Set-Restricted Eigenvalue condition, subject to a power transmission constraint. Furthermore, we develop a deep generative model at the receiver to recover the original IMU signals from noisy compressed data, thus enabling the creation of 3D human body movements at the receiver for XR and Metaverse applications. Simulation results on a real-world IMU dataset show that our framework can achieve highly accurate 3D human poses of the user using only $82\%$ of the measurements from the original signals. This is comparable to an optimization-based approach, i.e., Lasso, but is an order of magnitude faster.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。