arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.09484cs.LG
收藏

弥合差距:异构混合视图下的联邦多视图聚类

Bridging Gaps: Federated Multi-View Clustering in Heterogeneous Hybrid Views

School of Computer Science and Engineering, University of Electronic Science and Technology of China(电子科技大学计算机科学与工程学院)

Xinyue Chen, Yazhou Ren, Jie Xu, Fangfei Lin, Xiaorong Pu, Yang Yang

AI总结:

针对异构混合视图场景下的联邦多视图聚类问题,提出一种同时解决客户端差距与视图差距的新框架,通过局部协同对比学习和全局特定加权聚合相互增强,有效缓解异构性并优于现有方法。

摘要:

近年来,联邦多视图聚类(FedMVC)应运而生,旨在探索分布在多个客户端上的多视图数据中的聚类结构。现有方法通常假设客户端是同构的,并且所有客户端要么属于单视图客户端,要么属于多视图客户端。尽管取得了成功,但在处理涉及异构混合视图的实际 FedMVC 场景时,这些方法也存在局限性,其中单视图和多视图客户端的混合表现出不同程度的异构性。在本文中,我们提出了一种新颖的 FedMVC 框架,该框架同时解决了与异构混合视图相关的两个挑战,即客户端差距和视图差距。为了解决客户端差距,我们设计了一种局部协同对比学习方法,帮助单视图客户端和多视图客户端实现一致性,以减轻所有客户端之间的异构性。为了解决视图差距,我们开发了一种全局特定加权聚合方法,鼓励全局模型从混合视图中学习互补特征。局部协同对比学习和全局特定加权聚合之间的相互作用相互增强了分布在多个客户端上的数据聚类结构的探索。理论分析和大量实验表明,我们的方法能够处理 FedMVC 中的异构混合视图,并优于最先进的方法。代码可在 https://github.com/5Martina5/FMCSC 获取。

英文摘要:

Recently, federated multi-view clustering (FedMVC) has emerged to explore cluster structures in multi-view data distributed on multiple clients. Existing approaches often assume that clients are isomorphic and all of them belong to either single-view clients or multi-view clients. Despite their success, these methods also present limitations when dealing with practical FedMVC scenarios involving heterogeneous hybrid views, where a mixture of both single-view and multi-view clients exhibit varying degrees of heterogeneity. In this paper, we propose a novel FedMVC framework, which concurrently addresses two challenges associated with heterogeneous hybrid views, i.e., client gap and view gap. To address the client gap, we design a local-synergistic contrastive learning approach that helps single-view clients and multi-view clients achieve consistency for mitigating heterogeneity among all clients. To address the view gap, we develop a global-specific weighting aggregation method, which encourages global models to learn complementary features from hybrid views. The interplay between local-synergistic contrastive learning and global-specific weighting aggregation mutually enhances the exploration of the data cluster structures distributed on multiple clients. Theoretical analysis and extensive experiments demonstrate that our method can handle the heterogeneous hybrid views in FedMVC and outperforms state-of-the-art methods. The code is available at \url{https://github.com/5Martina5/FMCSC}.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑