arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2410.05552stat.MLcs.LG
收藏

估计处理效应的最优自适应实验设计

Optimal Adaptive Experimental Design for Estimating Treatment Effect

MIT(麻省理工学院);Peking University(北京大学)

Jiachun Li, David Simchi-Levi, Yunxiao Zhao

AI总结:

本文研究异质协变量下处理效应的最优估计精度问题,提出一种基于双重稳健方法的低切换自适应实验设计框架,将其转化为在线老虎机学习问题,并在非渐近意义下证明了其最优性,仅需两到三次策略更新即可逼近最优估计精度。

摘要:

给定n个具有潜在异质协变量的实验对象以及两种可能的处理方式,即积极处理和对照,本文探讨了确定处理效应估计的最优精度这一基本问题。此外,我们提出了一种逼近该最优精度的实验设计,为这个基本但仍然悬而未决的问题给出了(非渐近的)答案。方法论贡献如下。首先,我们建立了一个具有最小方差的理想化最优估计器作为基准,然后证明自适应实验是实现接近最优估计精度的必要条件。其次,通过将双重稳健方法的概念引入序贯实验设计,我们将最优估计问题转化为在线老虎机学习问题,从而架起了统计估计和老虎机学习这两个领域之间的桥梁。利用老虎机算法设计和自适应统计估计的工具与思想,我们提出了一个通用的低切换自适应实验框架,该框架可以作为广泛自适应实验设计的通用研究范式。通过针对非独立同分布数据的新颖下界技术,我们证明了所提实验的最优性。数值结果表明,仅需两到三次策略更新,估计精度即可逼近最优。

英文摘要:

Given n experiment subjects with potentially heterogeneous covariates and two possible treatments, namely active treatment and control, this paper addresses the fundamental question of determining the optimal accuracy in estimating the treatment effect. Furthermore, we propose an experimental design that approaches this optimal accuracy, giving a (non-asymptotic) answer to this fundamental yet still open question. The methodological contribution is listed as following. First, we establish an idealized optimal estimator with minimal variance as benchmark, and then demonstrate that adaptive experiment is necessary to achieve near-optimal estimation accuracy. Secondly, by incorporating the concept of doubly robust method into sequential experimental design, we frame the optimal estimation problem as an online bandit learning problem, bridging the two fields of statistical estimation and bandit learning. Using tools and ideas from both bandit algorithm design and adaptive statistical estimation, we propose a general low switching adaptive experiment framework, which could be a generic research paradigm for a wide range of adaptive experimental design. Through novel lower bound techniques for non-i.i.d. data, we demonstrate the optimality of our proposed experiment. Numerical result indicates that the estimation accuracy approaches optimal with as few as two or three policy updates.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑