arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.15652eess.SP
收藏

用户识别:多用户视觉辅助通信的关键使能技术

User Identification: A Key Enabler for Multi-User Vision-Aided Communications

Gouranga Charan, Ahmed Alkhateeb

AI总结:

本文提出用户识别任务作为多用户视觉辅助通信的关键使能技术,开发基于单帧或帧序列视觉与无线数据的机器学习模型,并在DeepSense 6G真实数据集上实现超过97%的识别准确率。

摘要:

视觉辅助无线通信正引起越来越多的关注,并在各种无线通信应用中不断找到新的用例。这些视觉辅助通信框架利用由安装在基础设施或移动设备上的摄像头等捕获的视觉数据,通过深度学习以及计算机视觉和视觉场景理解的进展来构建对通信环境的某种感知。先前的工作已经研究了各种问题,例如毫米波(mmWave)系统中的视觉辅助波束、阻塞和切换预测,以及大规模MIMO系统中的视觉辅助协方差预测。然而,这些先前的工作主要关注摄像头前只有单个对象(用户)的场景。在本文中,我们将“用户识别”任务定义为现实视觉辅助通信系统的关键使能技术,使这些系统能够在拥挤场景中运行并支持多用户应用。用户识别任务的目标是从视觉场景中的其他候选对象(干扰项)中识别出目标通信用户。我们开发了机器学习模型,这些模型处理单帧或帧序列的视觉和无线数据,以高效地在视觉/通信环境中识别目标用户。利用基于真实世界测量的大规模多模态感知与通信数据集DeepSense 6G,我们表明所开发的方法能够在现实设置中以超过97%的准确率成功识别目标用户。这为将视觉辅助无线通信应用扩展到现实场景和实际部署铺平了道路。

英文摘要:

Vision-aided wireless communication is attracting increasing interest and finding new use cases in various wireless communication applications. These vision-aided communication frameworks leverage visual data captured, for example, by cameras installed at the infrastructure or mobile devices to construct some perception about the communication environment through the use of deep learning and advances in computer vision and visual scene understanding. Prior work has investigated various problems such as vision-aided beam, blockage, and hand-off prediction in millimeter wave (mmWave) systems and vision-aided covariance prediction in massive MIMO systems. This prior work, however, has focused on scenarios with a single object (user) in front of the camera. In this paper, we define the \textit{user identification} task as a key enabler for realistic vision-aided communication systems that can operate in crowded scenarios and support multi-user applications. The objective of the user identification task is to identify the target communication user from the other candidate objects (distractors) in the visual scene. We develop machine learning models that process either one frame or a sequence of frames of visual and wireless data to efficiently identify the target user in the visual/communication environment. Using the large-scale multi-modal sense and communication dataset, DeepSense 6G, which is based on real-world measurements, we show that the developed approaches can successfully identify the target users with more than 97$\%$ accuracy in realistic settings. This paves the way for scaling the vision-aided wireless communication applications to real-world scenarios and practical deployments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑