Woodroofe的独臂强盗问题
Woodroofe's one-armed bandit problem revisited
摘要:
我们考虑Woodroofe [J. Amer. Statistist. Assoc.74(1979)799- 806],它涉及从两个群体中进行序贯抽样:一个群体的特征是已知的,另一个群体依赖于未知参数并包含协变量。目标是最大化累积期望奖励。我们研究这个问题在一个极大极小的设置,并制定利率最优的政策,涉及适当的修改近视规则。结果表明,遗憾,以及从劣势人口的抽样率,可以是有限的或增长在不同的速度与时间范围的问题,这取决于“本地”的协变量分布的属性。证明依赖于鞅方法和信息论论证。
英文摘要:
We consider the one-armed bandit problem of Woodroofe [J. Amer. Statist. Assoc. 74 (1979) 799--806], which involves sequential sampling from two populations: one whose characteristics are known, and one which depends on an unknown parameter and incorporates a covariate. The goal is to maximize cumulative expected reward. We study this problem in a minimax setting, and develop rate-optimal polices that involve suitable modifications of the myopic rule. It is shown that the regret, as well as the rate of sampling from the inferior population, can be finite or grow at various rates with the time horizon of the problem, depending on "local" properties of the covariate distribution. Proofs rely on martingale methods and information theoretic arguments.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。