arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2010.15835cs.LGstat.APstat.ML
收藏

长期成果目标

Targeting for long-term outcomes

Harvard Business School(哈佛商学院);Massachusetts Institute of Technology(麻省理工学院);University of Michigan(密歇根大学)

Jeremy Yang, Dean Eckles, Paramveer Dhillon, Sinan Aral

摘要:

决策者往往希望有针对性地采取干预措施,以便最大限度地实现只有在长期内才能观察到的结果。这通常需要推迟决策,直到观察到结果,或者依赖于简单的短期代理来获得长期结果。在这里,我们建立在统计代理和策略学习文献的基础上,估算缺失的长期结果,然后通过双重稳健的方法来近似估算结果的最优目标政策。我们首先表明,平均治疗效果估计的有效性与插补结果的条件也足以有效的政策评估和优化,此外,这些条件可以稍微放宽政策优化。我们在《波士顿环球报》的两个大规模主动流失管理实验中应用了我们的方法,通过为数字用户提供最佳折扣,以最大限度地提高长期收入。使用第一个实验,我们评估这种方法的经验,通过比较使用估算结果的政策学习与政策的地面真相,长期的结果。这两种政策的表现在统计上是无法区分的,我们排除了依赖代理人的巨大损失。我们的方法也优于一个政策学习短期代理的长期结果。在第二个现场实验中,我们实施了额外的随机探索,这使我们能够更新未来的用户的最佳策略的最佳目标策略。在三年的时间里,与现状相比,我们的方法产生了400万至500万美元的净收入影响。

英文摘要:

Decision makers often want to target interventions so as to maximize an outcome that is observed only in the long-term. This typically requires delaying decisions until the outcome is observed or relying on simple short-term proxies for the long-term outcome. Here we build on the statistical surrogacy and policy learning literatures to impute the missing long-term outcomes and then approximate the optimal targeting policy on the imputed outcomes via a doubly-robust approach. We first show that conditions for the validity of average treatment effect estimation with imputed outcomes are also sufficient for valid policy evaluation and optimization; furthermore, these conditions can be somewhat relaxed for policy optimization. We apply our approach in two large-scale proactive churn management experiments at The Boston Globe by targeting optimal discounts to its digital subscribers with the aim of maximizing long-term revenue. Using the first experiment, we evaluate this approach empirically by comparing the policy learned using imputed outcomes with a policy learned on the ground-truth, long-term outcomes. The performance of these two policies is statistically indistinguishable, and we rule out large losses from relying on surrogates. Our approach also outperforms a policy learned on short-term proxies for the long-term outcome. In a second field experiment, we implement the optimal targeting policy with additional randomized exploration, which allows us to update the optimal policy for future subscribers. Over three years, our approach had a net-positive revenue impact in the range of $4-5 million compared to the status quo.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑