发表机构
Technical University of Darmstadt; Hessian Center for AI (hessian.AI); Technische Universiteit Delft(达姆施塔特工业大学; 黑森人工智能中心; 代尔夫特理工大学)
机构由 AI 辅助整理,请以论文原文为准。AI 中文总结
该研究提出基于WiFi信道状态信息(CSI)的WiFlow光流估计器,含预处理器评估与三种权衡精度复杂度的模型,创建首个CSI光流数据集,为相关设计提供见解。
AI 中文摘要
了解场景内物体的位置和移动速度在多个领域都十分重要。通常,人们使用相机来获取完成该任务所需的数据,但添加相机往往会引发隐私问题,且捕获帧的质量受光照条件影响很大。在本研究中,我们探索使用WiFi信道状态信息(CSI)替代相机帧来进行光流估计。我们提出了WiFlow,这是一种基于CSI的光流估计器,包含一个CSI预处理器评估模块,以及三种在精度与复杂度之间提供不同权衡的模型架构。此外,我们创建了首个用于训练和评估基于CSI的光流估计器的数据集,实验结果为该任务的关键设计要素提供了见解。代码和数据可在该https网址获取。
英文摘要
Knowing where and how fast objects are moving within a scene is important across various domains. Usually, cameras are used to capture the data necessary for this task, but adding cameras often raises privacy concerns, and the quality of captured frames is heavily influenced by lighting conditions. In this work, we explore using WiFi channel state information (CSI) instead of camera frames for optical flow estimation. We propose WiFlow, a CSI based flow estimator, a preprocessor evaluation for CSI, and three model architectures that offer different trade-offs between accuracy and complexity. Further, we create the first dataset for training and evaluating CSI-based optical flow estimators, and our experiments provide insights into key design elements for this task. Code and data are available at https://visinf.github.io/wiflow.