PresSim:一种基于物理的3D模拟从单目视频生成动态地面压力分布的端到端框架
PresSim: An End-to-end Framework for Dynamic Ground Pressure Profile Generation from Monocular Videos Using Physics-based 3D Simulation
AI总结:
为降低HAR压力数据收集成本,提出PresSim端到端框架,通过三阶段流程从单目视频合成地面压力数据,经九人瑜伽实验验证有效。
摘要:
人体施加的地面压力是非侵入式普适感知中人体活动识别(HAR)的宝贵信息来源。虽然从压力传感器收集数据以开发HAR解决方案需要大量资源和精力,但我们提出了一种新颖的端到端框架PresSim,可从人类活动视频中合成传感器数据,从而大幅减少此类工作量。PresSim采用三阶段流程:首先,利用计算机视觉架构从视频中提取3D活动信息;然后,基于3D活动信息和含重力的物理模拟,对地板网格变形分布进行模拟;最后,利用深度学习模型生成模拟的压力传感器数据。我们探索了两种获取3D活动信息的方法:带网格重定向的逆运动学,以及体积姿态与形状估计。我们通过一个实验装置验证了PresSim:该装置使用单目相机提供输入,使用一块压力感应健身垫(空间分辨率为80×28)提供传感器真值,九名参与者完成了一组预定义的瑜伽序列。
英文摘要:
Ground pressure exerted by the human body is a valuable source of information for human activity recognition (HAR) in unobtrusive pervasive sensing. While data collection from pressure sensors to develop HAR solutions requires significant resources and effort, we present a novel end-to-end framework, PresSim, to synthesize sensor data from videos of human activities to reduce such effort significantly. PresSim adopts a 3-stage process: first, extract the 3D activity information from videos with computer vision architectures; then simulate the floor mesh deformation profiles based on the 3D activity information and gravity-included physics simulation; lastly, generate the simulated pressure sensor data with deep learning models. We explored two approaches for the 3D activity information: inverse kinematics with mesh re-targeting, and volumetric pose and shape estimation. We validated PresSim with an experimental setup with a monocular camera to provide input and a pressure-sensing fitness mat (80x28 spatial resolution) to provide the sensor ground truth, where nine participants performed a set of predefined yoga sequences.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。