While scene text recognition techniques have been widely used in commercial applications, data privacy has rarely been taken into account by this research community. Most existing algorithms have assumed a set of shared or centralized training data. However, in practice, data may be distributed on different local devices that can not be centralized to share due to the privacy restrictions. In this paper, we study how to make use of decentralized datasets for training a robust scene text recognizer while keeping them stay on local devices. To the best of our knowledge, we propose the first framework leveraging federated learning for scene text recognition, which is trained with decentralized datasets collaboratively. Hence we name it FedOCR. To make FedCOR fairly suitable to be deployed on end devices, we make two improvements including using lightweight models and hashing techniques. We argue that both are crucial for FedOCR in terms of the communication efficiency of federated learning. The simulations on decentralized datasets show that the proposed FedOCR achieves competitive results to the models that are trained with centralized data, with fewer communication costs and higher-level privacy-preserving.
Benchmarking Federated Learning for Semantic Datasets: Federated Scene Graph Generation
Graduate School of Artificial Intelligence, Ulsan National Institute of Science and Technology（人工智能研究生院，乌山国立科学技术研究所）；Department of Electrical Engineering, Ulsan National Institute of Science and Technology（电气工程系，乌山国立科学技术研究所）；Electronics and Telecommunications Research Institute (ETRI)（电子电信研究院（ETRI））
School of Automation Science and Enginnering, South China University of Technology（华南理工大学自动化科学与工程学院）；State Key Laboratory of Robotics, Shenyang Institute of Automation, Chinese Academy of Sciences（中国科学院沈阳自动化研究所机器人重点实验室）；Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences（中国科学院机器人与智能制造研究院）
Federated 3D Gaussian Splatting for Large-Scale Scene Reconstruction at Wireless Edge
The Chinese University of Hong Kong (Shenzhen)（香港中文大学（深圳））；Shenzhen Future Network of Intelligence Institute（深圳未来智能网络研究院）；Guangdong Provincial Key Laboratory of Future Networks of Intelligence（广东省未来智能网络重点实验室）；University of Liverpool（利物浦大学）；University of Science and Technology of China（中国科学技术大学）；Beijing Institute of Technology（北京理工大学）
Beijing University of Posts and Telecommunications（北京邮电大学）
With increasing appealing to privacy issues in face recognition, federated learning has emerged as one of the most prevalent approaches to study the unconstrained face recognition problem with private decentralized data. However, conventional decentralized federated algorithm sharing whole parameters of networks among clients suffers from privacy leakage in face recognition scene. In this work, we introduce a framework, FedGC, to tackle federated learning for face recognition and guarantees higher privacy. We explore a novel idea of correcting gradients from the perspective of backward propaga…
FedRSClip: Federated Learning for Remote Sensing Scene Classification Using Vision-Language Models
China Academy of Electronics and Information Technology（中国电子科技集团公司电子科学研究院）；Aerospace Information Research Institute, Chinese Academy of Sciences（中国科学院空天信息创新研究院）；University of Chinese Academy of Sciences（中国科学院大学）；New York University Abu Dhabi（纽约大学阿布扎比分校）
FedX: Explanation-Guided Pruning for Communication-Efficient Federated Learning in Remote Sensing
Faculty of Electrical Engineering and Computer Science, Technische Universität Berlin（电气工程与计算机科学学院，柏林技术大学）；BIFOLD - Berlin Institute for the Foundations of Learning and Data（柏林学习与数据基础研究所）
Shandong University（山东大学）；University of Queensland（昆士兰大学）；Shandong Jianzhu University（山东建筑大学）
Despite the great success achieved, existing video moment retrieval (VMR) methods are developed under the assumption that data are centralizedly stored. However, in real-world applications, due to the inherent nature of data generation and privacy concerns, data are often distributed on different silos, bringing huge challenges to effective large-scale training. In this work, we try to overcome above limitation by leveraging the recent success of federated learning. As the first that is explored in VMR field, the new task is defined as video moment retrieval with distributed data. Then, a nove…
Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections
National Center for Tumor Diseases (NCT)（国家肿瘤中心）；Translational Surgical Oncology（转化外科肿瘤学）；Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology（医学系和图林根大学技术大学卡尔·古斯塔夫·卡尔医院）；DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology（德累斯顿大学技术大学医学系和德累斯顿癌症研究中心）；Helmholtz-Zentrum Dresden-Rossendorf (HZDR)（德累斯顿-罗斯多夫亥姆霍兹中心）；Centre for Tactile Internet with Human-in-the-Loop (CeTI), TU Dresden（具有人类在环的触觉互联网中心，德累斯顿技术大学）；Visceral, Thoracic and Vascular Surgery, Faculty of Medicine and University Hospital Carl Gustav Carus, TU Dresden（visceral、胸外科和血管外科，医学系和图林根大学技术大学卡尔·古斯塔夫·卡尔医院）；Weldon School of Biomedical Engineering, Purdue University（生物医学工程韦尔登学校，普渡大学）；Medical Oncology, NCT, University Hospital Heidelberg, Germany（医学肿瘤学，国家肿瘤中心，海德堡大学医院，德国）；Medicine I, Faculty of Medicine and University Hospital Carl Gustav Carus, TU Dresden（医学I，医学系和图林根大学技术大学卡尔·古斯塔夫·卡尔医院）
Shenzhen Institute of Artificial Intelligence and Robotics for Society (AIRS)（深圳人工智能与机器人学会）；Institute of High Performance Computing (IHPC), A*STAR（高性能计算研究所 (IHPC)，A*STAR）
This work studies training generative adversarial networks under the federated learning setting. Generative adversarial networks (GANs) have achieved advancement in various real-world applications, such as image editing, style transfer, scene generations, etc. However, like other deep learning models, GANs are also suffering from data limitation problems in real cases. To boost the performance of GANs in target tasks, collecting images as many as possible from different sources becomes not only important but also essential. For example, to build a robust and accurate bio-metric verification sy…
