Randomized experiments are the gold standard for causal inference but face significant challenges in business applications, including limited traffic allocation, the need for heterogeneous treatment effect estimation, and the complexity of managing overlapping experiments. These factors lead to high variability in treatment effect estimates, making data-driven policy roll out difficult. To address these issues, we introduce the data pooling treatment roll-out (DPTR) framework, which enhances policy roll-out by pooling data across experiments rather than focusing narrowly on individual ones. DPTR can effectively accommodate both overlapping and non-overlapping traffic scenarios, regardless of linear or nonlinear model specifications. We demonstrate the framework's robustness through a three-pronged validation: (a) theoretical analysis shows that DPTR surpasses the traditional difference-in-mean and ordinary least squares methods under non-overlapping experiments, particularly when the number of experiments is large; (b) synthetic simulations confirm its adaptability in complex scenarios with overlapping traffic, rich covariates and nonlinear specifications; and (c) empirical applications to two experimental datasets from real world platforms, demonstrating its effectiveness in guiding customized policy roll-outs for subgroups within a single experiment, as well as in coordinating policy deployments across multiple experiments with overlapping scenarios. By reducing estimation variability to improve decision-making effectiveness, DPTR provides a scalable, practical solution for online platforms to better leverage their experimental data in today's increasingly complex business environments.
DISCRET: Synthesizing Faithful Explanations For Treatment Effect Estimation
School of Computer Science, Peking University(北京大学计算机学院);University of Pennsylvania(宾夕法尼亚大学);Harvard University(哈佛大学);Perelman School of Medicine, University of Pennsylvania(宾夕法尼亚大学佩雷尔曼医学院)
Collaborative Indirect Treatment Comparisons with Multiple Distributed Single-arm Trials
University of Pennsylvania(宾夕法尼亚大学);Pfizer Inc.(辉瑞公司);Division of Biostatistics and Health Data Science, University of Minnesota Twin Cities(明尼苏达双城大学生物统计与健康数据科学系);School of Mathematical Sciences, Peking University(北京大学数学科学学院)
Toward Efficient Estimation of Regional Treatment Effects in Multi-Regional Clinical Trials
Gilead Sciences(吉利德科学);State Key Laboratory of Mathematical Sciences, Academy of Mathematics and Systems Science, Chinese Academy of Sciences(中国科学院数学与系统科学研究院数学与应用数学国家重点实验室);Biostatistics and Bioinformatics Branch, Division of Population Health Research, Eunice Kennedy Shriver National Institute of Child Health and Human Development, National Institutes of Health(美国国立卫生研究院儿童与健康人类发展研究所尤妮丝·肯尼迪·施莱弗国家儿童健康与人类发展研究所人口健康研究处生物统计与生物信息学分支)
Hidden in Plain Sight: How Non-Collapsibility Biases Treatment Effects in (Network) Meta-Analysis
HEOR - Precision AQ;Department of Statistics, University of British Columbia(不列颠哥伦比亚大学统计系);Department of Clinical Pharmacy, University of California, San Francisco(加州大学旧金山分校临床药学系)
Targeted Data Fusion for Region-Specific Survival Effects in the AMP HIV Prevention Trials
North Carolina State University(北卡罗来纳州立大学);Duke Clinical Research Institute(杜克临床研究所);University of Pennsylvania(宾夕法尼亚大学);Duke University School of Medicine(杜克大学医学院);Fred Hutch Cancer Center(弗雷德·哈钦癌症中心);Brown University(布朗大学)
Scalable and Distributed Individualized Treatment Rules for Massive Datasets
Center for Applied Statistics and School of Statistics, Renmin University of China(中国人民大学统计学院与应用统计研究中心);School of Statistics, Renmin University of China(中国人民大学统计学院);School of Statistics, Beijing Normal University(北京师范大学统计学院);Department of Biostatistics, University of Michigan(密歇根大学生物统计系)