The paper studies the problem of distributed parameter estimation in multi-agent networks with exponential family observation statistics. A certainty-equivalence type distributed estimator of the consensus + innovations form is proposed in which, at each each observation sampling epoch agents update their local parameter estimates by appropriately combining the data received from their neighbors and the locally sensed new information (innovation). Under global observability of the networked sensing model, i.e., the ability to distinguish between different instances of the parameter value based on the joint observation statistics, and mean connectivity of the inter-agent communication network, the proposed estimator is shown to yield consistent parameter estimates at each network agent. Further, it is shown that the distributed estimator is asymptotically efficient, in that, the asymptotic covariances of the agent estimates coincide with that of the optimal centralized estimator, i.e., the inverse of the centralized Fisher information rate. From a technical viewpoint, the proposed distributed estimator leads to non-Markovian mixed timescale stochastic recursions and the analytical methods developed in the paper contribute to the general theory of distributed stochastic approximation.
A note on exponential inequalities for the distribution tails of canonical von Mises' statistics of dependent observations
对于满足φ-混合条件的平稳随机变量序列的样本,得到了任意阶标准von Mises统计量分布尾的Hoeffding型指数不等式.本文削弱了Borisov和Volodko(2009)的论文“Exponential inequalities for the distributions of canonical U- and V-statistics of dependent observations”中对系数φ()的限制。同时,对文中的相应证明进行了修正.
Exact exponential tail estimation for sums of independent centered random variables, under natural norming, with applications to the theory of U-statistics
本文利用 GLS 理论推导自然规范化独立中心化随机变量之和的精确指数尾部,并给出 U 统计量中的精细尾部估计。