We consider the consensus problem in a decentralized network, focusing on a compact submanifold that acts as a nonconvex constraint set. By leveraging the proximal smoothness of the compact submanifold, which encompasses the local singleton property and the local Lipschitz continuity of the projection operator on the manifold, and establishing the connection between the projection operator and general retraction, we show that the Riemannian gradient descent with a unit step size has locally linear convergence if the network has a satisfactory level of connectivity. Moreover, based on the geometry of the compact submanifold, we prove that a convexity-like regularity condition, referred to as the restricted secant inequality, always holds in an explicitly characterized neighborhood around the solution set of the nonconvex consensus problem. By leveraging this restricted secant inequality and imposing a weaker connectivity requirement on the decentralized network, we present a comprehensive analysis of the linear convergence of the Riemannian gradient descent, taking into consideration appropriate initialization and step size. Furthermore, if the network is well connected, we demonstrate that the local Lipschitz continuity endowed by proximal smoothness is a sufficient condition for the restricted secant inequality, thus contributing to the local error bound. We believe that our established results will find more application in the consensus problems over a more general proximally smooth set. Numerical experiments are conducted to validate our theoretical findings.
FedBC: Calibrating Global and Local Models via Federated Learning Beyond Consensus
University of Maryland, College Park（马里兰大学帕克分校）；University of British Columbia（不列颠哥伦比亚大学）；JP Morgan Chase AI Research（摩根大通人工智能研究院）；Amazon（亚马逊）；DEVCOM Army Research Laboratory（美国陆军作战能力发展司令部陆军研究实验室）
Decentralized Optimization on Compact Submanifolds by Quantized Riemannian Gradient Tracking
National Special Education Resource Center for Children with Autism, Zhejiang Normal University（浙江师范大学生自闭症教育资源中心）；School of Computer Science and Technology, Zhejiang Normal University（浙江师范大学计算机科学与技术学院）；China Mobile Research Institute（中国移动研究院）；Institute of Cyber-Systems and Control, Zhejiang University（浙江大学控制系统研究所）；SGIT AI Lab, State Grid Corporation of China（国网SGIT人工智能实验室）；Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University（浙江智能教育技术与应用重点实验室）；School of Information Engineering, Huzhou University（湖州大学信息工程学院）；Centre for Frontier Artificial Intelligence Research, A*STAR（A*STAR前沿人工智能研究中心）
