面向多流最快变化检测的混合专家(MoE)框架
A Mixture-of-Experts Framework for Multi-Stream Quickest Change Detection
AI总结:
本文提出混合专家(MoE)框架用于多流最快变化检测(QCD),该框架生成的算法性能优于现有最优的秩加权和(RWS)方案,经仿真实验在两类数据集上得到验证。
摘要:
本文提出一种混合专家(Mixture-of-Experts, MoE)框架用于最快变化检测(Quickest Change Detection, QCD),该框架包含多个专家,每个专家生成用于变化检测的统计量序列;当这些统计量的加权和超过阈值时,即判定发生变化。将该框架应用于多流QCD问题,得到一组性能优异的算法,其表现优于文献中已知的最优算法。在多流QCD问题中,决策者观测多组观测流,在变化点处,未知子集的观测流分布会发生改变;基于广义似然比的最优算法计算成本极高,而文献中计算成本与性能效率最高的算法之一是基于Shiryaev-Roberts统计量的秩加权和(Rank-Weighted Sum, RWS)方案。本文通过对实值高斯均值偏移数据及高斯-伯努利受限玻尔兹曼机(Gaussian-Bernoulli Restricted Boltzmann Machines, GB-RBMs)生成的高维数据进行仿真实验,验证了基于MoE的多流QCD算法的性能优于RWS方案。
英文摘要:
A Mixture-of-Experts (MoE) framework is proposed for quickest change detection (QCD) where there are multiple experts, and each expert produces a sequence of statistics for change detection. A change is declared when a weighted sum of these statistics crosses a threshold. This framework is then applied to the problem of multi-stream QCD to obtain a family of powerful algorithms that outperform the best known algorithms in the literature. In the multi-stream QCD problem, a decision-maker observes multiple streams of observations. At the change point, the distribution of an unknown subset of the streams changes. The optimal algorithm based on a generalized likelihood ratio is computationally expensive. One of the most computationally and performance-efficient algorithms in the literature is the rank-weighted sum (RWS) scheme based on Shiryaev-Roberts statistics. It is shown in the paper that the MoE-based QCD algorithm for multi-stream data outperforms the RWS scheme. This is demonstrated through simulation results on real-valued Gaussian mean shift data and high-dimensional data from Gaussian--Bernoulli Restricted Boltzmann Machines (GB-RBMs).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。