arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2603.21647cs.CVcs.LG
收藏

FedCVU: 联邦学习用于跨视图视频理解

FedCVU: Federated Learning for Cross-View Video Understanding

Software College, Northeastern University, Shenyang, China(东北大学软件学院);University of Science and Technology of China, Hefei, China(中国科学技术大学);University of Chinese Academy of Sciences, Beijing, China(中国科学院大学);Zhejiang University, Hangzhou, China(浙江大学)

Shenghan Zhang, Run Ling, Ke Cao, Ao Ma, Zhanjie Zhang

AI总结:

FedCVU通过VS-Norm、CV-Align和SLA解决联邦学习在跨视图视频理解中的异质视角、分布偏差和通信开销问题,提升未见视角性能。

摘要:

联邦学习(FL)已成为保护隐私的多摄像机视频理解有前景的范式。然而,将其应用于跨视图场景面临三大挑战:(i)异质视角和背景导致高度非iid客户端分布和过度拟合视图特定模式;(ii)局部分布偏差导致表示不一致,阻碍跨视图语义一致性;(iii)大型视频架构导致通信开销巨大。为此,我们提出FedCVU框架,包含三个组件:VS-Norm保留归一化参数以处理视图特定统计;CV-Align是轻量级对比正则化模块以提升跨视图表示对齐;SLA是选择性层聚合策略以减少通信开销而不牺牲准确性。在跨视图协议下的动作理解和人物重识别任务中,FedCVU的大量实验表明,其在未见视角准确率上持续提升,同时保持强的已见视角性能,优于现有FL基线,显示出对领域异质性和通信约束的鲁棒性。

英文摘要:

Federated learning (FL) has emerged as a promising paradigm for privacy-preserving multi-camera video understanding. However, applying FL to cross-view scenarios faces three major challenges: (i) heterogeneous viewpoints and backgrounds lead to highly non-IID client distributions and overfitting to view-specific patterns, (ii) local distribution biases cause misaligned representations that hinder consistent cross-view semantics, and (iii) large video architectures incur prohibitive communication overhead. To address these issues, we propose FedCVU, a federated framework with three components: VS-Norm, which preserves normalization parameters to handle view-specific statistics; CV-Align, a lightweight contrastive regularization module to improve cross-view representation alignment; and SLA, a selective layer aggregation strategy that reduces communication without sacrificing accuracy. Extensive experiments on action understanding and person re-identification tasks under a cross-view protocol demonstrate that FedCVU consistently boosts unseen-view accuracy while maintaining strong seen-view performance, outperforming state-of-the-art FL baselines and showing robustness to domain heterogeneity and communication constraints.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑