arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1602.03014stat.MLcs.LG
收藏

具有混沌边缘动力学的羊群行为学习系统

Herding as a Learning System with Edge-of-Chaos Dynamics

Google DeepMind(谷歌DeepMind);University of Amsterdam(阿姆斯特丹大学)

Yutian Chen, Max Welling

摘要:

羊群效应定义了一个处于混沌边缘的确定性动力系统。它通过将参数扰动与状态最大化交替来生成模型状态和参数的序列,其中状态的序列可以被解释为来自相关联的MRF模型的“样本”。羊群效应与极大似然估计的不同之处在于参数序列不会收敛到固定点,与MCMC后验采样方法的不同之处在于状态序列是确定性生成的。羊群效应可以被解释为一种“扰动和映射”方法,其中参数扰动是使用确定性非线性动力系统而不是从Gumbel分布随机生成的。本章研究了羊群算法的显著统计特性,并指出控制矩的快速收敛可能归因于混沌动力学的边缘。羊群算法也可以推广到具有潜在变量的模型和判别学习设置。感知器循环定理确保快速矩匹配属性在更一般的框架中被保留。

英文摘要:

Herding defines a deterministic dynamical system at the edge of chaos. It generates a sequence of model states and parameters by alternating parameter perturbations with state maximizations, where the sequence of states can be interpreted as "samples" from an associated MRF model. Herding differs from maximum likelihood estimation in that the sequence of parameters does not converge to a fixed point and differs from an MCMC posterior sampling approach in that the sequence of states is generated deterministically. Herding may be interpreted as a"perturb and map" method where the parameter perturbations are generated using a deterministic nonlinear dynamical system rather than randomly from a Gumbel distribution. This chapter studies the distinct statistical characteristics of the herding algorithm and shows that the fast convergence rate of the controlled moments may be attributed to edge of chaos dynamics. The herding algorithm can also be generalized to models with latent variables and to a discriminative learning setting. The perceptron cycling theorem ensures that the fast moment matching property is preserved in the more general framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑