arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2310.08672econ.EMcs.LGstat.MEstat.ML
收藏

机器学习决定向谁助推:学生助学金续期实地实验中的因果与预测性定向干预

Machine Learning Who to Nudge: Causal vs Predictive Targeting in a Field Experiment on Student Financial Aid Renewal

Stanford University(斯坦福大学);Innovations for Poverty Action(扶贫行动创新组织)

Susan Athey, Niall Keleher, Jann Spiess

AI总结:

在超5万名学生助学金续期实验中,比较因果森林与预测性定向干预,提出结合两者优势的混合方法,发现针对中等基线结果定向干预最有效,仅干预半数学生即可获得全员干预约75%的收益。

摘要:

在许多情境中,干预措施对某些个体可能比对其他个体更有效,因此定向干预可能是有益的。我们在一项涉及超过53,000名大学生的大规模实地实验背景下分析了定向干预的价值,该实验的目标是使用“助推(nudges)”来鼓励学生在非约束性截止日期前续期其助学金申请。我们首先从基准定向干预方法开始。第一种方法基于因果森林进行定向干预,该模型估计异质性处理效应,然后根据估计具有最高处理效应的学生将其分配到处理组。接下来,我们评估了两种替代的定向干预策略,一种针对在没有处理情况下续期助学金预测概率较低的学生,另一种针对预测概率较高的学生。预测的基线结果并非定向干预的理想标准,且先验上也不清楚是应优先考虑低、高还是中等预测概率。尽管如此,在实践中基于低基线结果进行定向干预很常见,例如因为个体特征与处理效应之间的关系通常难以或无法用历史数据估计。我们提出了结合预测方法(准确估计)和因果方法(正确标准)两者优势的混合方法;我们表明,在我们的具体应用中,针对中等基线结果进行定向干预最为有效,而基于低基线结果的定向干预则是有害的。在实验的一年中,助推所有学生使早期提交率在37%的基线平均提交率基础上平均提高了6.4个百分点,我们估计使用我们偏好的策略对一半学生进行定向干预可获得约75%的此收益。

英文摘要:

In many settings, interventions may be more effective for some individuals than others, so that targeting interventions may be beneficial. We analyze the value of targeting in the context of a large-scale field experiment with over 53,000 college students, where the goal was to use "nudges" to encourage students to renew their financial-aid applications before a non-binding deadline. We begin with baseline approaches to targeting. First, we target based on a causal forest that estimates heterogeneous treatment effects and then assigns students to treatment according to those estimated to have the highest treatment effects. Next, we evaluate two alternative targeting policies, one targeting students with low predicted probability of renewing financial aid in the absence of the treatment, the other targeting those with high probability. The predicted baseline outcome is not the ideal criterion for targeting, nor is it a priori clear whether to prioritize low, high, or intermediate predicted probability. Nonetheless, targeting on low baseline outcomes is common in practice, for example because the relationship between individual characteristics and treatment effects is often difficult or impossible to estimate with historical data. We propose hybrid approaches that incorporate the strengths of both predictive approaches (accurate estimation) and causal approaches (correct criterion); we show that targeting intermediate baseline outcomes is most effective in our specific application, while targeting based on low baseline outcomes is detrimental. In one year of the experiment, nudging all students improved early filing by an average of 6.4 percentage points over a baseline average of 37% filing, and we estimate that targeting half of the students using our preferred policy attains around 75% of this benefit.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑