arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2001.07426cs.LGstat.ML
收藏

潜在结果与因果效应估计的泛化界与表示学习

Generalization Bounds and Representation Learning for Estimation of Potential Outcomes and Causal Effects

Chalmers University of Technology(查尔姆斯理工大学);Technion, Israel Institute of Technology(以色列理工学院);Cornell Tech(康奈尔理工学院);Massachusetts Institute of Technology(麻省理工学院)

Fredrik D. Johansson, Uri Shalit, Nathan Kallus, David Sontag

AI总结:

本文研究从观测数据中估计个体因果效应,给出了允许样本重加权的泛化界,并基于该界设计了通过正则化处理组距离和信息共享来最小化误差的表示学习算法,实验验证了其有效性。

摘要:

医疗、经济和教育等领域的从业者渴望应用机器学习来改善决策。实验的成本与不可行性,以及近期电子记录保存的巨大增长,引起了基于非实验观测数据评估决策问题的关注。这正是本文的研究背景。具体而言,我们研究从记录的背景、决策和结果中估计个体因果效应,例如单个患者对替代药物的反应。我们基于接受不同处理组之间的距离度量,给出了估计效应误差的泛化界,并允许样本重加权。我们提供了使该界紧致的条件,并展示了它与无监督域适应结果的关系。在理论结果的引导下,我们设计了表示学习算法,通过正则化表示所诱导的处理组距离并鼓励处理组间信息共享来最小化该界。我们将这些算法扩展为同时学习加权表示,以进一步减小处理组距离。最后,在真实和合成数据上的实验评估表明了我们提出的表示架构和正则化方案的价值。

英文摘要:

Practitioners in diverse fields such as healthcare, economics and education are eager to apply machine learning to improve decision making. The cost and impracticality of performing experiments and a recent monumental increase in electronic record keeping has brought attention to the problem of evaluating decisions based on non-experimental observational data. This is the setting of this work. In particular, we study estimation of individual-level causal effects, such as a single patient's response to alternative medication, from recorded contexts, decisions and outcomes. We give generalization bounds on the error in estimated effects based on distance measures between groups receiving different treatments, allowing for sample re-weighting. We provide conditions under which our bound is tight and show how it relates to results for unsupervised domain adaptation. Led by our theoretical results, we devise representation learning algorithms that minimize our bound, by regularizing the representation's induced treatment group distance, and encourage sharing of information between treatment groups. We extend these algorithms to simultaneously learn a weighted representation to further reduce treatment group distances. Finally, an experimental evaluation on real and synthetic data shows the value of our proposed representation architecture and regularization scheme.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑