毫米姿态:使用mmWave雷达和CNN的实时人体姿态估计
mm-Pose: Real-Time Human Skeletal Posture Estimation using mmWave Radars and CNNs
摘要:
在本文中,毫米姿态,一种新的方法来检测和跟踪人体骨架实时使用毫米波雷达,提出。据作者所知,这是第一种使用毫米波雷达反射信号检测>15个不同骨骼关节的方法。所提出的方法将在交通监控系统、自动驾驶汽车、病人监护系统和国防部队中找到几个应用,以检测和跟踪人体骨骼,从而实时做出有效和预防性的决策。雷达的使用使该系统在操作上对场景照明和不利天气条件具有鲁棒性。该方法首先对距离、方位和仰角方向的雷达反射点云进行分辨,并将其投影到距离-方位和距离-仰角平面上。还提出了一种新的低尺寸高分辨率雷达到图像的表示,克服了传统点云数据的稀疏性,并提供了显着减少后续的机器学习架构。RGB通道被分配有每个点的反射信号的范围、仰角/方位角和功率水平的归一化值。一个分叉的CNN架构被用来预测在3-D空间中的骨骼关节的真实世界的位置,使用雷达到图像表示。所提出的方法进行了测试,一个单一的人类场景的四个主要运动,(i)行走,(ii)摆动左臂,(iii)摆动右臂,(iv)摆动双臂,以验证准确的预测范围,方位角和仰角的运动。详细的方法,实施,挑战和验证结果。
英文摘要:
In this paper, mm-Pose, a novel approach to detect and track human skeletons in real-time using an mmWave radar, is proposed. To the best of the authors' knowledge, this is the first method to detect >15 distinct skeletal joints using mmWave radar reflection signals. The proposed method would find several applications in traffic monitoring systems, autonomous vehicles, patient monitoring systems and defense forces to detect and track human skeleton for effective and preventive decision making in real-time. The use of radar makes the system operationally robust to scene lighting and adverse weather conditions. The reflected radar point cloud in range, azimuth and elevation are first resolved and projected in Range-Azimuth and Range-Elevation planes. A novel low-size high-resolution radar-to-image representation is also presented, that overcomes the sparsity in traditional point cloud data and offers significant reduction in the subsequent machine learning architecture. The RGB channels were assigned with the normalized values of range, elevation/azimuth and the power level of the reflection signals for each of the points. A forked CNN architecture was used to predict the real-world position of the skeletal joints in 3-D space, using the radar-to-image representation. The proposed method was tested for a single human scenario for four primary motions, (i) Walking, (ii) Swinging left arm, (iii) Swinging right arm, and (iv) Swinging both arms to validate accurate predictions for motion in range, azimuth and elevation. The detailed methodology, implementation, challenges, and validation results are presented.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。