使用固定份额在隐马尔可夫模型之间切换
Switching between Hidden Markov Models using Fixed Share
摘要:
在专家建议的预测中,目标是设计在线预测算法,与参考方案相比,实现较小的遗憾(整个数据的额外损失)。在最简单的这种方案中,人们可以将其比作事后失去了最好的专家。一个更雄心勃勃的目标是将数据划分为多个部分,并与每个部分的最佳专家进行比较。这是适当的,如果数据的性质变化之间的部分。标准的固定份额算法是快速和实现小的遗憾相比,这种方案。固定份额将专家视为黑箱:没有关于他们如何产生预测的假设。但是,如果专家正在学习,那么就会出现以下问题:专家应该从所有数据中学习,还是只从自己所在领域的数据中学习?原始算法自然解决了第一种情况。在这里,我们考虑第二种选择,这是更合适的时候,数据的性质变化段之间。一般来说,将固定份额扩展到第二种情况将使其在T结果上的T因子减慢。然而,我们表明,没有这样的减速是必要的,如果专家是隐马尔可夫模型。
英文摘要:
In prediction with expert advice the goal is to design online prediction algorithms that achieve small regret (additional loss on the whole data) compared to a reference scheme. In the simplest such scheme one compares to the loss of the best expert in hindsight. A more ambitious goal is to split the data into segments and compare to the best expert on each segment. This is appropriate if the nature of the data changes between segments. The standard fixed-share algorithm is fast and achieves small regret compared to this scheme. Fixed share treats the experts as black boxes: there are no assumptions about how they generate their predictions. But if the experts are learning, the following question arises: should the experts learn from all data or only from data in their own segment? The original algorithm naturally addresses the first case. Here we consider the second option, which is more appropriate exactly when the nature of the data changes between segments. In general extending fixed share to this second case will slow it down by a factor of T on T outcomes. We show, however, that no such slowdown is necessary if the experts are hidden Markov models.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。