Stay With Me:Lifetime Maximization Through Heteroscedastic Linear Bandits With Reneging(与我在一起:通过异方差线性Bandits实现寿命最大化)
Stay With Me: Lifetime Maximization Through Heteroscedastic Linear Bandits With Reneging
摘要:
生命周期最大化的序贯决策问题在许多实际应用中是一个关键问题,如医疗和投资组合选择。在这些应用程序中,“食言”的现象,即参与者可能会脱离未来的互动后,观察到一个不满意的结果,是相当普遍的。为了解决上述问题,本文提出了一个异方差线性土匪与食言,它允许每个参与者有一个独特的“满意度水平”,与任何互动结果低于该水平导致该参与者食言模型。此外,它允许结果的差异是依赖于上下文的。在此模型的基础上,我们提出了一个UCB型策略,即HR-UCB,并证明了它实现了$\mathcal{O}\big(\sqrt{{T}(\log({T}))^{3}}\big)$后悔。最后,我们通过仿真验证了HR-UCB的性能。
英文摘要:
Sequential decision making for lifetime maximization is a critical problem in many real-world applications, such as medical treatment and portfolio selection. In these applications, a "reneging" phenomenon, where participants may disengage from future interactions after observing an unsatisfiable outcome, is rather prevalent. To address the above issue, this paper proposes a model of heteroscedastic linear bandits with reneging, which allows each participant to have a distinct "satisfaction level," with any interaction outcome falling short of that level resulting in that participant reneging. Moreover, it allows the variance of the outcome to be context-dependent. Based on this model, we develop a UCB-type policy, namely HR-UCB, and prove that it achieves $\mathcal{O}\big(\sqrt{{T}(\log({T}))^{3}}\big)$ regret. Finally, we validate the performance of HR-UCB via simulations.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。