arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2111.02887cs.NIcs.LG
收藏

用于6G感知的自监督无线电视觉表示学习

Self-Supervised Radio-Visual Representation Learning for 6G Sensing

Bell Labs(贝尔实验室);UCLA(加州大学洛杉矶分校)

Mohammed Alloulah, Akash Deep Singh, Maximilian Arnold

摘要:

在未来的6G蜂窝网络中,联合通信和传感协议将允许网络感知环境,为统一通信感知基础设施上的许多新应用打开大门。然而,解释稀疏无线电表示的传感场景是具有挑战性的,这阻碍了这些新兴系统的潜力。我们建议将无线电和视觉相结合,以最少的人为干预自动学习仅无线电传感模型。我们希望建立一个无线电传感模型,可以以数百万个未经管理的数据点为基础。为此,我们利用自监督学习的最新进展,并制定了一个新的无标签的无线电视觉协同学习计划,通过跨模态的互信息的视觉训练无线电。我们实施和评估我们的计划,根据共同的线性分类基准,并报告定性和定量的性能指标。在我们的评估中,通过无线电视觉自我监督学习的表示对于下游传感演示器效果良好,并且在使用较少标记数据时优于其完全监督的对应物。这表明,自监督学习可能是未来可扩展的无线电传感系统的重要推动者。

英文摘要:

In future 6G cellular networks, a joint communication and sensing protocol will allow the network to perceive the environment, opening the door for many new applications atop a unified communication-perception infrastructure. However, interpreting the sparse radio representation of sensing scenes is challenging, which hinders the potential of these emergent systems. We propose to combine radio and vision to automatically learn a radio-only sensing model with minimal human intervention. We want to build a radio sensing model that can feed on millions of uncurated data points. To this end, we leverage recent advances in self-supervised learning and formulate a new label-free radio-visual co-learning scheme, whereby vision trains radio via cross-modal mutual information. We implement and evaluate our scheme according to the common linear classification benchmark, and report qualitative and quantitative performance metrics. In our evaluation, the representation learnt by radio-visual self-supervision works well for a downstream sensing demonstrator, and outperforms its fully-supervised counterpart when less labelled data is used. This indicates that self-supervised learning could be an important enabler for future scalable radio sensing systems.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑