arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2008.06476stat.ME
收藏

具有协变量和网络连接的A/B测试局部最优设计

Locally Optimal Design for A/B Testing in the Presence of Covariates and Network Connection

Clemson University(克莱姆森大学);Illinois Institute of Technology(伊利诺伊理工学院)

Qiong Zhang, Lulu Kang

AI总结:

本文提出一种考虑协变量和网络连接的A/B测试局部最优设计方法,通过条件自回归模型衡量治疗效应估计方差,并利用混合优化方法实现最优分配。

摘要:

A/B测试是一种简单的控制实验,用于比较两种处理对受试者的影响。本文假设用户在无向网络中连接,两个连接用户响应相关。我们将在条件自回归模型中包含处理分配、协变量特征和网络连接,并提出一个度量治疗效应估计方差的设计标准,通过最小化该标准来分配处理设置。由于设计标准依赖于未知的网络相关参数,我们采用局部最优设计方法并开发混合优化方法来获得最优设计。通过合成和真实社交网络示例,我们展示了在设计A/B实验中包含网络依赖性的价值,并验证了所提出的局部最优设计对参数选择具有鲁棒性。

英文摘要:

A/B test, a simple type of controlled experiment, refers to the statistical procedure of experimenting to compare two treatments applied to test subjects. For example, many IT companies frequently conduct A/B tests on their users who are connected and form social networks. Often, the users' responses could be related to the network connection. In this paper, we assume that the users, or the test subjects of the experiments, are connected on an undirected network, and the responses of two connected users are correlated. We include the treatment assignment, covariate features, and network connection in a conditional autoregressive model. Based on this model, we propose a design criterion that measures the variance of the estimated treatment effect and allocate the treatment settings to the test subjects by minimizing the criterion. Since the design criterion depends on an unknown network correlation parameter, we adopt the locally optimal design method and develop a hybrid optimization approach to obtain the optimal design. Through synthetic and real social network examples, we demonstrate the value of including network dependence in designing A/B experiments and validate that the proposed locally optimal design is robust to the choices of parameters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑