arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2210.02899cs.NIcs.AIcs.LGeess.SP
收藏

用于无线频谱活动聚类的自监督学习

Self-supervised Learning for Clustering of Wireless Spectrum Activity

Jozef Stefan Institute(约热夫·斯泰凡研究所);Jozef Stefan International Postgraduate School(约热夫·斯泰凡国际研究生学院)

Ljupcho Milosheski, Gregor Cerar, Blaž Bertalanič, Carolina Fortuna, Mihael Mohorčič

AI总结:

本文研究使用自监督学习(SSL)探索真实世界无标签无线频谱数据,通过对比基于DeepCluster的适配模型与K-means基线,证明SSL模型在大幅降低特征向量大小和模型复杂度的同时,显著提升了聚类性能。

摘要:

近年来,在处理涉及认知无线电网络领域相关问题的无线频谱数据方面,已有大量基于机器学习技术的工作,例如异常检测、调制分类、技术分类和设备指纹识别。大多数解决方案基于受控方式创建的标注数据,并采用监督学习方法进行处理。然而,在真实世界环境中测量的频谱数据具有高度不确定性,使得数据标注成为一个费时且昂贵的过程,需要领域专业知识,因此这也是在该领域使用监督学习方法的主要缺点之一。在本文中,我们研究了使用自监督学习(SSL)来探索真实世界无标签数据中的频谱活动。具体而言,我们比较了两种SSL模型的性能,其中一种基于参考的DeepCluster架构,另一种针对频谱活动识别和聚类进行了适配,同时还比较了一种基于K-means聚类算法的基线模型。我们表明,SSL模型在提取特征质量和聚类性能方面均取得了更优的表现。通过SSL模型,我们将特征向量的大小减小了两个数量级,同时在各项评估指标上将性能提升了2到2.5倍,并得到了可视化评估的支持。此外我们还表明,将参考SSL架构适配于该领域数据,可将模型复杂度降低一个数量级,同时保持甚至提升聚类性能。

英文摘要:

In recent years, much work has been done on processing of wireless spectrum data involving machine learning techniques in domain-related problems for cognitive radio networks, such as anomaly detection, modulation classification, technology classification and device fingerprinting. Most of the solutions are based on labeled data, created in a controlled manner and processed with supervised learning approaches. However, spectrum data measured in real-world environment is highly nondeterministic, making its labeling a laborious and expensive process, requiring domain expertise, thus being one of the main drawbacks of using supervised learning approaches in this domain. In this paper, we investigate the use of self-supervised learning (SSL) for exploring spectrum activities in a real-world unlabeled data. In particular, we compare the performance of two SSL models, one based on a reference DeepCluster architecture and one adapted for spectrum activity identification and clustering, and a baseline model based on K-means clustering algorithm. We show that SSL models achieve superior performance regarding the quality of extracted features and clustering performance. With SSL models we achieve reduction of the feature vectors size by two orders of magnitude, while improving the performance by a factor of 2 to 2.5 across the evaluation metrics, supported by visual assessment. Additionally we show that adaptation of the reference SSL architecture to the domain data provides reduction of model complexity by one order of magnitude, while preserving or even improving the clustering performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑