In large-scale distributed scenarios, increasingly complex tasks demand more intelligent collaboration across networks, requiring the joint extraction of structural representations from data samples. However, conventional task-specific approaches often result in nonstructural embeddings, leading to collapsed variability among data samples within the same class, particularly in classification tasks. To address this issue and fully leverage the intrinsic structure of data for downstream applications, we propose a novel distributed learning framework that ensures both diverse and discriminative representations. For independent and identically distributed (i.i.d.) data, we reformulate and decouple the global optimization function by introducing constraints on representation variance. The update rules are then derived and simplified using a primal-dual approach. For non-i.i.d. data distributions, we tackle the problem by clustering and virtually replicating nodes, allowing model updates within each cluster using block coordinate descent. In both cases, the resulting optimal solutions are theoretically proven to maintain discriminative and diverse properties, with a guaranteed convergence for i.i.d. conditions. Additionally, semantic information from representations is shared among nodes, reducing the need for common neural network architectures. Finally, extensive simulations on MNIST, CIFAR-10 and CIFAR-100 confirm the effectiveness of the proposed algorithms in capturing global structural representations.
A Distributed Approach towards Discriminative Distance Metric Learning
University of Technology, Sydney(悉尼科技大学);Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences(中国科学院深圳先进技术研究院);IBM;Microsoft Research Asia(微软亚洲研究院)
Masked Face Recognition with Generative-to-Discriminative Representations
Institute of Information Engineering, Chinese Academy of Sciences(中国科学院信息工程研究所);School of Cyber Security at University of Chinese Academy of Sciences(中国科学院大学网络空间安全学院);Cloud Music Inc.(网易云音乐);Department of Communication Engineering, Shanghai University(上海大学通信工程系)
Discriminative feature generation for classification of imbalanced data
Korea Institute of Science and Technology Europe Forschungsgesellschaft mbH(韩国科学技术院欧洲研究所);TU Kaiserslautern(凯泽斯劳滕工业大学);German Research Center for Artificial Intelligence (DFKI)(德国人工智能研究中心)
Post-Training Quantization of Generative and Discriminative LSTM Text Classifiers: A Study of Calibration, Class Balance, and Robustness
School of Mathematical and Data Sciences(数学与数据科学学院);West Virginia University(西弗吉尼亚大学);Department of Industrial and Management Systems Engineering(工业与管理系统工程系)
DIDI: Diffusion-Guided Diversity for Offline Behavioral Generation
School of Engineering, Westlake University(西湖大学工程学院);Zhejiang University(浙江大学);Institute of Advanced Technology, Westlake Institute for Advanced Study(西湖高等研究院先进技术研究所)
Behavioral Anomaly Detection in Distributed Systems via Federated Contrastive Learning
Northeastern University(东北大学);Illinois Institute of Technology(伊利诺伊理工学院);Rochester Institute of Technology(罗切斯特理工学院);University of California, San Diego(加利福尼亚大学圣地亚哥分校);University of Southern California(南加利福尼亚大学);University of Michigan(密歇根大学)
Physics-informed network paradigm with data generation and background noise removal for diverse distributed acoustic sensing applications
State Key Laboratory of Advanced Optical Communication Systems and Networks, Department of Electronic Engineering, Shanghai Jiao Tong University(先进光通信系统与网络国家重点实验室,电子工程学院,上海交通大学)