arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2002.03277stat.MEstat.AP
收藏

一种新的异质性处理效应在线测试框架

A New Framework for Online Testing of Heterogeneous Treatment Effect

Miao Yu, Wenbin Lu, Rui Song

摘要:

我们提出了一个新的框架,在线测试异质性处理效应。所提出的测试,命名为序贯得分测试(SST),能够控制第一类错误的连续监测和检测多维异质性处理效应。我们为SST提供了一个在线p值计算,使其便于连续监测,并通过控制错误发现率将我们的测试扩展到在线多重检验设置。我们研究的实证性能的测试,并将它们与一个国家的最先进的在线测试,命名为mSPRT使用模拟和真实数据。结果表明,我们提出的测试控制第一类错误在任何时候,有较高的检测能力,并允许快速推断在线A/B测试。

英文摘要:

We propose a new framework for online testing of heterogeneous treatment effects. The proposed test, named sequential score test (SST), is able to control type I error under continuous monitoring and detect multi-dimensional heterogeneous treatment effects. We provide an online p-value calculation for SST, making it convenient for continuous monitoring, and extend our tests to online multiple testing settings by controlling the false discovery rate. We examine the empirical performance of the proposed tests and compare them with a state-of-art online test, named mSPRT using simulations and a real data. The results show that our proposed test controls type I error at any time, has higher detection power and allows quick inference on online A/B testing.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑