FedCVU: Federated Learning for Cross-View Video Understanding
Software College, Northeastern University, Shenyang, China(东北大学软件学院);University of Science and Technology of China, Hefei, China(中国科学技术大学);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学);Zhejiang University, Hangzhou, China(浙江大学)
Shenghan Zhang, Run Ling, Ke Cao, Ao Ma, Zhanjie Zhang
Federated learning (FL) has emerged as a promising paradigm for privacy-preserving multi-camera video understanding. However, applying FL to cross-view scenarios faces three major challenges: (i) heterogeneous viewpoints and backgrounds lead to highly non-IID client distributions and overfitting to view-specific patterns, (ii) local distribution biases cause misaligned representations that hinder consistent cross-view semantics, and (iii) large video architectures incur prohibitive communication overhead. To address these issues, we propose FedCVU, a federated framework with three components: VS-Norm, which preserves normalization parameters to handle view-specific statistics; CV-Align, a lightweight contrastive regularization module to improve cross-view representation alignment; and SLA, a selective layer aggregation strategy that reduces communication without sacrificing accuracy. Extensive experiments on action understanding and person re-identification tasks under a cross-view protocol demonstrate that FedCVU consistently boosts unseen-view accuracy while maintaining strong seen-view performance, outperforming state-of-the-art FL baselines and showing robustness to domain heterogeneity and communication constraints.
Privacy-Preserving Federated Action Recognition via Differentially Private Selective Tuning and Efficient Communication
School of Computing Science, University of Glasgow(格拉斯哥大学计算科学学院);Infocomm Technology Cluster, Singapore Institute of Technology(新加坡理工学院信息通信技术集群);The Edward S. Rogers Sr. Dept. of Electrical and Computer Engineering, University of Toronto(多伦多大学埃德华·S·罗杰斯Sr.电子与计算机工程系)
SurgFed: Language-guided Multi-Task Federated Learning for Surgical Video Understanding
National University of Singapore(国立新加坡大学);The Hong Kong University of Science and Technology (Guangzhou)(香港科学与技术大学(广州));Zhejiang University(浙江大学);Nanyang Technological University(南洋理工大学)
Federated EndoViT: Pretraining Vision Transformers via Federated Learning on Endoscopic Image Collections
National Center for Tumor Diseases (NCT)(国家肿瘤中心);Translational Surgical Oncology(转化外科肿瘤学);Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(医学系和图林根大学技术大学卡尔·古斯塔夫·卡尔医院);DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(德累斯顿大学技术大学医学系和德累斯顿癌症研究中心);Helmholtz-Zentrum Dresden-Rossendorf (HZDR)(德累斯顿-罗斯多夫亥姆霍兹中心);Centre for Tactile Internet with Human-in-the-Loop (CeTI), TU Dresden(具有人类在环的触觉互联网中心,德累斯顿技术大学);Visceral, Thoracic and Vascular Surgery, Faculty of Medicine and University Hospital Carl Gustav Carus, TU Dresden(visceral、胸外科和血管外科,医学系和图林根大学技术大学卡尔·古斯塔夫·卡尔医院);Weldon School of Biomedical Engineering, Purdue University(生物医学工程韦尔登学校,普渡大学);Medical Oncology, NCT, University Hospital Heidelberg, Germany(医学肿瘤学,国家肿瘤中心,海德堡大学医院,德国);Medicine I, Faculty of Medicine and University Hospital Carl Gustav Carus, TU Dresden(医学I,医学系和图林根大学技术大学卡尔·古斯塔夫·卡尔医院)
FedVision: An Online Visual Object Detection Platform Powered by Federated Learning
WeBank(微众银行);Hong Kong University of Science and Technology(香港科技大学);Extreme Vision Ltd(极视角有限公司);Nanyang Technological University(南洋理工大学);Joint NTU-WeBank Research Centre on FinTech(南大-微众金融科技联合研究中心)
Personalized Federated Learning for Egocentric Video Gaze Estimation with Comprehensive Parameter Frezzing
Hokkaido University(北海道大学);Graduate School of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术研究院);Faculty of Information Science and Technology, Hokkaido University(北海道大学信息科学与技术学院)
Communication-Efficient Multimodal Federated Learning: Joint Modality and Client Selection
School of Electrical and Computer Engineering, Purdue University(普渡大学电气与计算机工程学院);Department of Computer Science and Engineering, Yonsei University(延世大学计算机科学与工程系);School of Electrical and Computer Engineering, Princeton University(普林斯顿大学电气与计算机工程学院);Saab Inc.(Saab公司)
Multi-Layer Personalized Federated Learning for Mitigating Biases in Student Predictive Analytics
Elmore Family School of Electrical and Computer Engineering, Purdue University(普渡大学埃尔莫尔家族电气与计算机工程学院);University at Buffalo (SUNY)(纽约州立大学布法罗分校);University of Florida(佛罗里达大学);School of Engineering Education, Purdue University(普渡大学工程教育学院);Manning College of Information and Computer Sciences, University of Massachusetts Amherst(马萨诸塞大学阿默斯特分校曼宁信息与计算机科学学院)
Federated Learning for Surgical Vision in Appendicitis Classification: Results of the FedSurg EndoVis 2024 Challenge
Department of Translational Surgical Oncology, National Center for Tumor Diseases (NCT), NCT/UCC Dresden, a partnership between DKFZ, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(转化外科肿瘤学部,肿瘤疾病国家中心(NCT),NCT/UCC德累斯顿,DKFZ、医学院和卡尔·戈斯瓦尔德·卡尔医院之间的合作);Centre for Tactile Internet with Human-in-the-Loop (CeTI), TUD Dresden University of Technology(人机协同触觉互联网中心(CeTI),德累斯顿技术大学);Department of Medicine I, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(医学部I,医学院和卡尔·戈斯瓦尔德·卡尔医院,德累斯顿技术大学);Medical Oncology, National Center for Tumor Diseases (NCT), University Hospital Heidelberg(肿瘤医学部,肿瘤疾病国家中心(NCT),海德堡大学医院);Weldon School of Biomedical Engineering, Purdue University(生物医学工程学院,普渡大学);Else Kroener Fresenius Center for Digital Health, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(Else Kroener Fresenius数字健康中心,医学院和卡尔·戈斯瓦尔德·卡尔医院,德累斯顿技术大学);IHU Strasbourg, Institute of Image-Guided Surgery(斯特拉斯堡IHU,影像引导手术研究所);University of Strasbourg, CNRS, INSERM, ICube, UMR7357(斯特拉斯堡大学,CNRS,INSERM,ICube,UMR7357);Dr. NTR University of Health Sciences(Dr. NTR健康科学大学);Department of Visceral, Thoracic and Vascular Surgery, Faculty of Medicine and University Hospital Carl Gustav Carus, TUD Dresden University of Technology(visceral、胸腔和血管外科部,医学院和卡尔·戈斯瓦尔德·卡尔医院,德累斯顿技术大学);Digital Technologies, Medtronic(数字技术,美敦力);UCL Hawkes Institute and Department of Computer Science, University College London(UCL Hawkes研究所和计算机科学系,伦敦大学学院);German Cancer Research Center (DKFZ) Heidelberg, Division of Intelligent Medical Systems(德国癌症研究中心(DKFZ)海德堡,智能医学系统部);German Cancer Research Center (DKFZ) Heidelberg, Helmholtz Imaging(德国癌症研究中心(DKFZ)海德堡,海德堡成像);National Center for Tumor Diseases (NCT) Heidelberg, a partnership between DKFZ and Heidelberg University Hospital(肿瘤疾病国家中心(NCT)海德堡,DKFZ和海德堡大学医院之间的合作);Faculty of Mathematics and Computer Science, Heidelberg University(数学和计算机科学学院,海德堡大学);Helmholtz Information and Data Science School for Health(海德堡信息与数据科学健康学院);Heidelberg University Hospital, Surgical Clinic, Surgical AI Research Group(海德堡大学医院,外科诊所,外科AI研究组);Krankenhaus St. Joseph-Stift Dresden GmbH(德累斯顿圣约瑟夫修道院医院)
Spatio-Temporal Representation Decoupling and Enhancement for Federated Instrument Segmentation in Surgical Videos
Department of Electrical and Computer Engineering, NUS, Singapore(新加坡国立大学电子与计算机工程系);Department of Biomedical Engineering, NUS, Singapore(新加坡国立大学生物医学工程系);Institute of High Performance Computing, A*STAR, Singapore(新加坡A*STAR高性能计算研究所);Department of Computer Science and Engineering, The Chinese University of Hong Kong, HKSAR, China(香港中文大学(深圳)计算机科学与工程系);Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China(中国科学院深圳先进技术研究所)