从强盗到专家:统治与独立的故事
From Bandits to Experts: A Tale of Domination and Independence
摘要:
我们考虑部分可观性模型的多武装土匪,介绍了Mannor和Shamir。我们的主要结果是在有向可观测性模型中的可观测图的支配数和独立数的遗憾的一个特征。我们还表明,在无向的情况下,学习者可以实现最佳的遗憾,甚至没有访问的可观察性图之前,选择一个动作。这两个结果都显示使用Exp3算法的变体上的可观测性图在一个时间有效的方式。
英文摘要:
We consider the partial observability model for multi-armed bandits, introduced by Mannor and Shamir. Our main result is a characterization of regret in the directed observability model in terms of the dominating and independence numbers of the observability graph. We also show that in the undirected case, the learner can achieve optimal regret without even accessing the observability graph before selecting an action. Both results are shown using variants of the Exp3 algorithm operating on the observability graph in a time-efficient manner.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。