arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2106.04304stat.ME
收藏

在同时发生的政策背景下估计政策效果的方法考虑

Methodological considerations for estimating policy effects in the context of co-occurring policies

Beth Ann Griffin, Megan S. Schuler, Joseph Pane, Stephen W. Patrick, Rosanna Smart, Bradley D. Stein, Geoffrey Grimm, Elizabeth A. Stuart

摘要:

了解如何最好地估计州一级的政策效果是很重要的,还有几个悬而未决的问题,特别是关于统计模型的能力,以解开同时颁布的政策的影响。在实践中,许多政策评估研究并不试图控制的影响,同时发生的政策,这个问题还没有得到广泛的关注,在方法学文献的日期。在这项研究中,我们利用蒙特卡罗模拟,以评估共同发生的政策的影响,在国家政策评估中常用的统计模型的性能。模拟条件不同的影响大小的共同发生的政策和政策颁布日期之间的时间长度,以及其他因素。结果数据(每100,000人的年度特定州阿片类药物死亡率)来自1999-2016年国家生命统计系统(NVSS)多死因死亡率文件,从而产生来自50个州的18年纵向年度州级数据。当忽略同时出现的策略时(即,我们的研究结果表明,高相对偏差(>85%)的出现,特别是当政策颁布迅速连续。此外,正如预期的那样,控制所有共同发生的政策将有效地减轻混淆偏差的威胁;然而,效果估计可能相对不精确(即,(2)当政策连续颁布时,差异较大。我们的研究结果突出了阿片类药物政策研究背景下关于共发政策的几个关键方法论问题,但也更广泛地推广到其他国家级政策的评估,例如与枪支或COVID-19相关的政策,表明需要批判性地思考在指定分析模型时可能影响结果的共发政策。

英文摘要:

Understanding how best to estimate state-level policy effects is important, and several unanswered questions remain, particularly about the ability of statistical models to disentangle the effects of concurrently enacted policies. In practice, many policy evaluation studies do not attempt to control for effects of co-occurring policies, and this issue has not received extensive attention in the methodological literature to date. In this study, we utilized Monte Carlo simulations to assess the impact of co-occurring policies on the performance of commonly-used statistical models in state policy evaluations. Simulation conditions varied effect sizes of the co-occurring policies and length of time between policy enactment dates, among other factors. Outcome data (annual state-specific opioid mortality rate per 100,000) were obtained from 1999-2016 National Vital Statistics System (NVSS) Multiple Cause of Death mortality files, thus yielding longitudinal annual state-level data over 18 years from 50 states. When co-occurring policies are ignored (i.e., omitted from the analytic model), our results demonstrated that high relative bias (>85%) arises, particularly when policies are enacted in rapid succession. Moreover, as expected, controlling for all co-occurring policies will effectively mitigate the threat of confounding bias; however, effect estimates may be relatively imprecise (i.e., larger variance) when policies are enacted in near succession. Our findings highlight several key methodological issues regarding co-occurring policies in the context of opioid-policy research yet also generalize more broadly to evaluation of other state-level policies, such as policies related to firearms or COVID-19, showcasing the need to think critically about co-occurring policies that are likely to influence the outcome when specifying analytic models.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑