Federated Learning enables visual models to be trained on-device, bringing advantages for user privacy (data need never leave the device), but challenges in terms of data diversity and quality. Whilst typical models in the datacenter are trained using data that are independent and identically distributed (IID), data at source are typically far from IID. Furthermore, differing quantities of data are typically available at each device (imbalance). In this work, we characterize the effect these real-world data distributions have on distributed learning, using as a benchmark the standard Federated Averaging (FedAvg) algorithm. To do so, we introduce two new large-scale datasets for species and landmark classification, with realistic per-user data splits that simulate real-world edge learning scenarios. We also develop two new algorithms (FedVC, FedIR) that intelligently resample and reweight over the client pool, bringing large improvements in accuracy and stability in training. The datasets are made available online.
FedVision: An Online Visual Object Detection Platform Powered by Federated Learning
WeBank(微众银行);Hong Kong University of Science and Technology(香港科技大学);Extreme Vision Ltd(极视角有限公司);Nanyang Technological University(南洋理工大学);Joint NTU-WeBank Research Centre on FinTech(南大-微众金融科技联合研究中心)
FedUKD: Federated UNet Model with Knowledge Distillation for Land Use Classification from Satellite and Street Views
Institute of High Performance Computing, A*STAR(新加坡科技研究局高性能计算研究所);Vellore Institute of Technology(韦洛尔理工学院);College of Engineering, Anna University(安娜大学工程学院);Measi Academy Of Architecture(米西建筑学院)
Label-shift robust federated feature screening for high-dimensional classification
Center for Applied Statistics and School of Statistics Renmin University of China(应用统计中心和中国人民大学统计学院);School of Mathematics and Statistics Xi’an Jiaotong University(西安交通大学数学与统计学院);Department of Mathematics and Fundamental Research Peng Cheng Laboratory School of Mathematics and Statistics Xi’an Jiaotong University(数学与基础研究部鹏城实验室数学与统计学院)
FedCL-Ensemble Learning: A Framework of Federated Continual Learning with Ensemble Transfer Learning Enhanced for Alzheimer's MRI Classifications while Preserving Privacy
Memory-aware curriculum federated learning for breast cancer classification
Universitat Pompeu Fabra(庞培法布拉大学);IT University of Copenhagen(哥本哈根信息技术大学);ICREA(加泰罗尼亚研究与高级研究院);Ecole Centrale de Nantes(南特中央理工学院);Hera-MI SAS(Hera-MI公司)
Online federated learning framework for classification
School of Mathematics, Statistics and Actuarial Science, University of Essex(埃塞克斯大学数学、统计与精算科学学院);Yunnan University(云南大学);Department of Mathematical and Statistical Sciences, University of Alberta(阿尔伯塔大学数学与统计科学系);School of Mathematics, Statistics and Physics, Newcastle University(纽卡斯尔大学数学、统计与物理学院)
Task Diversity in Bayesian Federated Learning: Simultaneous Processing of Classification and Regression
School of Statistics, Renmin University of China(中国人民大学统计学院);School of Statistics and Data Science, Southeast University(东南大学统计与数据科学学院);Beijing Advanced Innovation Center for Future Blockchain and Privacy Computing(未来区块链与隐私计算北京高精尖创新中心)
Exploiting Test-Time Augmentation in Federated Learning for Brain Tumor MRI Classification
Institute of Exact and Technological Sciences, Federal University of Viçosa - UFV, Rio Paranaíba-MG, Brazil(精确与技术科学研究所,弗拉维亚联邦大学-UFV,里奥帕拉纳伊巴-MG,巴西);Department of Computing, Federal University of São Carlos, São Carlos-SP, Brazil(计算系,萨o卡洛斯联邦大学,萨o卡洛斯-SP,巴西)
Federated Semi-Supervised Classification of Multimedia Flows for 3D Networks
University of Pisa(比萨大学);CNR, Institute of Informatics and Telematics(意大利国家研究委员会信息学与电信研究所);CNR, Institute of Information Science and Technologies(意大利国家研究委员会信息科学与技术研究所)
Label Granularity Skew in Federated Learning with Hierarchical Image Classification
School of Computer Science and Engineering, Soongsil University(崇实大学计算机科学与工程学院);School of Computing and Augmented Intelligence, Arizona State University(亚利桑那州立大学计算与增强智能学院)
Visual Prompt Based Personalized Federated Learning
National University of Defense Technology(国防科技大学);The University of Sydney(悉尼大学);JD Explore Academy(京东探索研究院);The Chinese University of Hong Kong, Shenzhen(香港中文大学(深圳))
FedTR: Federated Learning Framework with Transfer Learning for Industrial Visual Inspection
HP-NTU Digital Manufacturing Corporate Lab, Nanyang Technological University(惠普-南洋理工大学数字制造联合实验室,南洋理工大学);School of Computer Science and Engineering, Nanyang Technological University(南洋理工大学计算机科学与工程学院);Department of Computer Science, Norwegian University of Science and Technology(挪威科技大学计算机科学系);HP Inc.(惠普公司);HP Singapore(惠普新加坡公司)
Cooperative Pseudo Labeling for Unsupervised Federated Classification
University of Science and Technology of China(中国科学技术大学);NLPR & MAIS, Institute of Automation, Chinese Academy of Sciences(中国科学院自动化研究所);School of Artificial Intelligence, University of Chinese Academy of Sciences(中国科学院大学人工智能学院)
From Isolation to Collaboration: Federated Class-Heterogeneous Learning for Chest X-Ray Classification
University of Maryland School of Medicine(马里兰大学医学院);University of Maryland Institute for Health Computing(马里兰大学健康计算研究所);St. Jude Children’s Research Hospital(圣犹大儿童研究医院)
FTA-FTL: A Fine-Tuned Aggregation Federated Transfer Learning Scheme for Lithology Microscopic Image Classification
School of Computing, Macquarie University(麦考瑞大学计算学院);Institute of Computational Systems Biology, University of Hamburg(汉堡大学计算系统生物学研究所);Sahand University of Technology(萨汉德工业大学);Yasouj University(亚苏季大学);School of Computer, Data and Mathematical Sciences, Western Sydney University(西悉尼大学计算机、数据与数学学院)
Federated Transfer Learning for EEG Signal Classification
WeBank Co., Ltd.(微众银行);Hong Kong University of Science and Technology(香港科技大学);Southern University of Science and Technology(南方科技大学);Nanyang Technological University(南洋理工大学)