arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.02137cs.LG
收藏

FedSpectral +:使用联邦学习的谱聚类

FedSpectral+: Spectral Clustering using Federated Learning

IIT Gandhinagar(印度理工学院甘地讷格尔分校)

Janvi Thakkar, Devvrat Joshi

摘要:

图中的聚类一直是一个众所周知的研究问题,特别是因为大多数互联网和社交网络数据都是图的形式。组织广泛使用谱聚类算法来发现图数据集中的聚类。然而,由于计算开销,将谱聚类应用于大型数据集是具有挑战性的。分布式谱聚类算法存在数据隐私和客户端之间通信开销增加的问题。因此,在本文中,我们提出了一个谱聚类算法,使用联邦学习(FL),以克服这些问题。FL是一种隐私保护算法,它从每个本地学习器中积累模型参数,而不是收集用户的原始数据,从而提供可扩展性和数据隐私。我们开发了两种方法:FedSpectral和FedSpectral+。FedSpectral是一种基线方法,它使用局部谱聚类标签通过创建相似性图来聚合全局谱聚类。FedSpectral+是一种最先进的方法,它使用幂迭代方法通过合并整个图数据来学习全局谱嵌入,而无需访问分布在客户端之间的原始信息。我们进一步设计了我们自己的相似性度量来检查原始/非FL聚类的分布式方法的聚类质量。所提出的方法FedSpectral+获得了98.85%和99.8%的相似性,与ego-Facebook和email-Eu-core数据集上的全局聚类相似。

英文摘要:

Clustering in graphs has been a well-known research problem, particularly because most Internet and social network data is in the form of graphs. Organizations widely use spectral clustering algorithms to find clustering in graph datasets. However, applying spectral clustering to a large dataset is challenging due to computational overhead. While the distributed spectral clustering algorithm exists, they face the problem of data privacy and increased communication costs between the clients. Thus, in this paper, we propose a spectral clustering algorithm using federated learning (FL) to overcome these issues. FL is a privacy-protecting algorithm that accumulates model parameters from each local learner rather than collecting users' raw data, thus providing both scalability and data privacy. We developed two approaches: FedSpectral and FedSpectral+. FedSpectral is a baseline approach that uses local spectral clustering labels to aggregate the global spectral clustering by creating a similarity graph. FedSpectral+, a state-of-the-art approach, uses the power iteration method to learn the global spectral embedding by incorporating the entire graph data without access to the raw information distributed among the clients. We further designed our own similarity metric to check the clustering quality of the distributed approach to that of the original/non-FL clustering. The proposed approach FedSpectral+ obtained a similarity of 98.85% and 99.8%, comparable to that of global clustering on the ego-Facebook and email-Eu-core dataset.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑