WixUp:用于人体追踪的无线感知通用数据增强框架
WixUp: A General Data Augmentation Framework for Wireless Perception in Tracking of Humans
AI总结:
针对无线感知中深度学习面临的训练数据需求大和泛化差的问题,提出通用数据增强框架WixUp,利用高斯混合和概率技巧将稀疏点云转换为密集距离剖面,并结合自训练实现无监督域适应,显著提升了多场景下的人体追踪性能。
摘要:
近期,包括mmWave、WiFi和声学在内的无线感知技术的进步,扩展了其在人体运动追踪和健康监测中的应用。由于其在各种条件或遮挡下的有效性以及增强的隐私性,它们是传统基于摄像头的感知系统的理想替代方案。然而,深度学习在该领域的整合引入了新的挑战,例如需要大量训练数据和模型泛化能力差,尤其是在稀疏且有噪声的无线点云情况下。作为一种补救措施,数据增强是其他深度学习领域中充分探索的解决方案,但它们不能直接应用于无线信号的独特特性。这促使我们提出一个专为无线感知定制的定制数据增强框架WixUp。此外,我们旨在使其成为一个支持各种数据集、模型架构、感知模态和任务的通用框架;而以前的无线数据增强或生成模拟不具备这种泛化能力,仅限于某些用例。更具体地说,WixUp可以使用高斯混合和概率技巧将有损坐标逆变换为密集距离剖面,使其能够进行深入的数据多样性增强;其基于混合的方法通过自训练实现无监督域适应,允许在实践中训练没有来自新用户或环境标签的模型。总之,我们广泛的评估实验表明,WixUp在各种场景中提供一致的性能提升,并优于基线。
英文摘要:
Recent advancements in wireless perception technologies, including mmWave, WiFi, and acoustics, have expanded their application in human motion tracking and health monitoring. They are promising alternatives to traditional camera-based perception systems, thanks to their efficacy under diverse conditions or occlusions, and enhanced privacy. However, the integration of deep learning within this field introduces new challenges such as the need for extensive training data and poor model generalization, especially with sparse and noisy wireless point clouds. As a remedy, data augmentation is one solution well-explored in other deep learning fields, but they are not directly applicable to the unique characteristics of wireless signals. This motivates us to propose a custom data augmentation framework, WixUp, tailored for wireless perception. Moreover, we aim to make it a general framework supporting various datasets, model architectures, sensing modalities, and tasks; while previous wireless data augmentation or generative simulations do not exhibit this generalizability, only limited to certain use cases. More specifically, WixUp can reverse-transform lossy coordinates into dense range profiles using Gaussian mixture and probability tricks, making it capable of in-depth data diversity enhancement; and its mixing-based method enables unsupervised domain adaptation via self-training, allowing training of the model with no labels from new users or environments in practice. In summary, our extensive evaluation experiments show that WixUp provides consistent performance improvement across various scenarios and outperforms the baselines.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。