The paper develops a technique for solving a linear equation $Ax=b$ with a square and nonsingular matrix $A$, using a decentralized gradient algorithm. In the language of control theory, there are $n$ agents, each storing at time $t$ an $n$-vector, call it $x_i(t)$, and a graphical structure associating with each agent a vertex of a fixed, undirected and connected but otherwise arbitrary graph $\mathcal G$ with vertex set and edge set $\mathcal V$ and $\mathcal E$ respectively. We provide differential equation update laws for the $x_i$ with the property that each $x_i$ converges to the solution of the linear equation exponentially fast. The equation for $x_i$ includes additive terms weighting those $x_j$ for which vertices in $\mathcal G$ corresponding to the $i$-th and $j$-th agents are adjacent. The results are extended to the case where $A$ is not square but has full row rank, and bounds are given on the convergence rate.
Decentralized Riemannian Conjugate Gradient Method on the Stiefel Manifold
Zhejiang University(浙江大学);SGIT AI Lab, State Grid Corporation of China(国网公司SGIT人工智能实验室);CFAR and IHPC, Agency for Science, Technology and Research(新加坡科技研究局CFAR与IHPC);SCSE, NTU(南洋理工大学计算机科学与工程学院)
Provably Accelerated Decentralized Gradient Method Over Unbalanced Directed Graphs
Shanghai Center for Mathematical Sciences, Fudan University(复旦大学上海数学中心);School of Mathematical Sciences, Fudan University(复旦大学数学科学学院);Shanghai Key Laboratory for Contemporary Applied Mathematics(上海现代应用数学重点实验室);Shanghai Artificial Intelligence Laboratory(上海人工智能实验室);School of Data Science, The Chinese University of Hong Kong, Shenzhen (CUHK-Shenzhen)(香港中文大学(深圳)数据科学学院);Shenzhen Research Institute of Big Data(深圳大数据研究院)
A Variance-Reduced Stochastic Gradient Tracking Algorithm for Decentralized Optimization with Orthogonality Constraints
State Key Laboratory of Scientific and Engineering Computing, Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院科学与工程计算国家重点实验室);University of Chinese Academy of Sciences(中国科学院大学)
Decentralized Optimization on Compact Submanifolds by Quantized Riemannian Gradient Tracking
National Special Education Resource Center for Children with Autism, Zhejiang Normal University(浙江师范大学生自闭症教育资源中心);School of Computer Science and Technology, Zhejiang Normal University(浙江师范大学计算机科学与技术学院);China Mobile Research Institute(中国移动研究院);Institute of Cyber-Systems and Control, Zhejiang University(浙江大学控制系统研究所);SGIT AI Lab, State Grid Corporation of China(国网SGIT人工智能实验室);Zhejiang Key Laboratory of Intelligent Education Technology and Application, Zhejiang Normal University(浙江智能教育技术与应用重点实验室);School of Information Engineering, Huzhou University(湖州大学信息工程学院);Centre for Frontier Artificial Intelligence Research, A*STAR(A*STAR前沿人工智能研究中心)