arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1709.00467math.PR
收藏

具有随机步长的随机逼近和具有有限均值随机替换矩阵的Urn模型

Stochastic Approximation with Random Step Sizes and Urn Models with Random Replacement Matrices Having Finite Mean

Ujan Gangopadhyay, Krishanu Maulik

摘要:

随机逼近算法是概率论和统计学中一种长期以来得到成功开发的实用技术。在随机逼近中使用的步长通常被认为是确定性的,对于漂移也是如此。然而,具体的应用与随机替换矩阵的瓮模型促使我们考虑随机逼近的设置,其中的步长和漂移是随机的,但序列是一致有界的。当误差的可忽略性条件仅在概率上成立时,问题变得有趣。我们首先证明了一个关于随机逼近的结果,这在文献中是新的。然后,作为应用,我们研究了具有随机替换矩阵的瓮模型。在瓮模型中,替换矩阵既不需要是独立的,也不需要是同分布的。我们假设替换矩阵仅与在整个过去条件下的同一轮中绘制的颜色无关。我们放宽了文献中关于替换矩阵的二阶矩假设,只要求一阶矩是有限的。我们要求给定过去的替换矩阵的条件期望在适当的意义下接近不可约矩阵。我们不要求任何矩阵是平衡的或非随机的。我们证明了收敛的比例向量,组成向量和计数向量在$L^1$,因此在概率。值得注意的是,相关的微分方程是Lotka-Volterra型的,可以直接分析。

英文摘要:

Stochastic approximation algorithm is a useful technique which has been exploited successfully in probability theory and statistics for a long time. The step sizes used in stochastic approximation are generally taken to be deterministic and same is true for the drift. However, the specific application of urn models with random replacement matrices motivates us to consider stochastic approximation in a setup where both the step sizes and the drift are random, but the sequence is uniformly bounded. The problem becomes interesting when the negligibility conditions on the errors hold only in probability. We first prove a result on stochastic approximation in this setup, which is new in the literature. Then, as an application, we study urn models with random replacement matrices. In the urn model, the replacement matrices need neither be independent, nor identically distributed. We assume that the replacement matrices are only independent of the color drawn in the same round conditioned on the entire past. We relax the usual second moment assumption on the replacement matrices in the literature and require only first moment to be finite. We require the conditional expectation of the replacement matrix given the past to be close to an irreducible matrix, in an appropriate sense. We do not require any of the matrices to be balanced or nonrandom. We prove convergence of the proportion vector, the composition vector and the count vector in $L^1$, and hence in probability. It is to be noted that the related differential equation is of Lotka-Volterra type and can be analyzed directly.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑