A/B testing refers to the statistical procedure of conducting an experiment to compare two treatments, A and B, applied to different testing subjects. It is widely used by technology companies such as Facebook, LinkedIn, and Netflix, to compare different algorithms, web-designs, and other online products and services. The subjects participating these online A/B testing experiments are users who are connected in different scales of social networks. Two connected subjects are similar in terms of their social behaviors, education and financial background, and other demographic aspects. Hence, it is only natural to assume that their reactions to the online products and services are related to their network adjacency. In this paper, we propose to use the conditional auto-regressive model to present the network structure and include the network effects in the estimation and inference of the treatment effect. A D-optimal design criterion is developed based on the proposed model. Mixed integer programming formulations are developed to obtain the D-optimal designs. The effectiveness of the proposed method is shown through numerical results with synthetic networks and real social networks.
Single and multi-objective optimal designs for group testing experiments with a focus on screening for an infectious disease
Georgia State University(佐治亚州立大学);McGill University(麦吉尔大学);University of Waterloo(滑铁卢大学);Department of Biostatistics, University of California, Los Angeles(加州大学洛杉矶分校生物统计系);University of Victoria(维多利亚大学)
Design-Driven Inference for Online Experiments: Jointly Optimal Evidence Collection, Testing, and Estimation
School of Mathematics and Statistics, Beijing Institute of Technology(北京理工大学数学与统计学院);School of Science, China University of Mining and Technology-Beijing(中国矿业大学(北京)理学院);Department of Statistics, Beijing Normal University at Zhuhai(北京师范大学珠海校区统计学系)