arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2105.02071math.STstat.MEstat.TH
收藏

带有高维冗余参数的一致有效因果推断的成本与收益

The costs and benefits of uniformly valid causal inference with high-dimensional nuisance parameters

Niloofar Moosavi, Jenny Häggström, Xavier de Luna

AI总结:

本文综述高维冗余参数下一致有效因果推断的研究,分析其双重稳健性等优势及方差膨胀的成本,提出的双重选择结果回归估计量兼具一致渐近无偏性与更低方差。

摘要:

近年来,在需要估计高维冗余模型时,针对低维因果参数生成一致有效推断的方法开发已取得重要进展。本文综述了一致有效因果推断领域的相关文献,探讨了使用一致有效推断程序的成本与收益。基于正则化、机器学习或冗余模型初步模型选择阶段的朴素估计策略,其有限样本分布难以用渐近分布良好近似。为解决这一严重问题,文献中提出了在一类数据生成机制上分布一致收敛的估计量。为在高维场景下获得一致有效结果,通常需要对冗余模型施加稀疏性条件,不过存在双重稳健性质:若其中一个冗余模型更稀疏,则允许另一个冗余模型的稀疏度更低。尽管一致有效推断是一项极具吸引力的性质,但一致有效程序会因方差膨胀付出高昂代价。我们通过研究一种双重选择结果回归估计量来阐释这一两难困境,实验表明该估计量具有一致渐近无偏性,且在开展的数值实验中,其方差低于一致有效估计量。

英文摘要:

Important advances have recently been achieved in developing procedures yielding uniformly valid inference for a low dimensional causal parameter when high-dimensional nuisance models must be estimated. In this paper, we review the literature on uniformly valid causal inference and discuss the costs and benefits of using uniformly valid inference procedures. Naive estimation strategies based on regularisation, machine learning, or a preliminary model selection stage for the nuisance models have finite sample distributions which are badly approximated by their asymptotic distributions. To solve this serious problem, estimators which converge uniformly in distribution over a class of data generating mechanisms have been proposed in the literature. In order to obtain uniformly valid results in high-dimensional situations, sparsity conditions for the nuisance models need typically to be made, although a double robustness property holds, whereby if one of the nuisance model is more sparse, the other nuisance model is allowed to be less sparse. While uniformly valid inference is a highly desirable property, uniformly valid procedures pay a high price in terms of inflated variability. Our discussion of this dilemma is illustrated by the study of a double-selection outcome regression estimator, which we show is uniformly asymptotically unbiased, but is less variable than uniformly valid estimators in the numerical experiments conducted.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑