arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1406.5840math.STstat.TH
收藏

反褶积、凸优化、非参数经验贝叶斯和无响应处理

Deconvolution, convex optimization, non-parametric empirical Bayes and treatment of non-response

Eitan Greenshtein, Theodor Itskov

摘要:

令$(Y_i,θ_i)$、$i=1,...,n$是像$(Y,θ) \sim G^*$一样分布的独立随机向量,其中$θ$的边缘分布完全未知,并且以$θ$为条件的$Y$的条件分布已知。期望基于观察到的$Y_1,...,Y_n$来估计$θ$在$G^*$下的边际分布以及给定$h$的形式$E_{G^*} h(Y,θ)$的泛函。在本文中,我们提出了一个反卷积方法,上述估计问题,并讨论了它在经验贝叶斯分析中的一些应用。该方法涉及二次规划步骤,这是对Efron(2013)中的配方和技术的阐述。它是计算效率高,可以处理大数据集,其中流行的方法,使用EM算法的反卷积,是不切实际的。我们研究的主要应用是无应答的治疗。我们的方法是非标准的,不涉及随机缺失类型的假设。该方法在模拟中得到了证明,以及在以色列劳动力调查的真实数据集的分析。其他应用,包括估计的风险,估计的错误发现率,也进行了讨论。我们还提出了一种方法,其中涉及凸优化,用于构造置信区间的$E_{G^*} h$,在上述设置。

英文摘要:

Let $(Y_i,θ_i)$, $i=1,...,n$, be independent random vectors distributed like $(Y,θ) \sim G^*$, where the marginal distribution of $θ$ is completely unknown, and the conditional distribution of $Y$ conditional on $θ$ is known. It is desired to estimate the marginal distribution of $θ$ under $G^*$, as well as functionals of the form $E_{G^*} h(Y,θ)$ for a given $h$, based on the observed $Y_1,...,Y_n$. In this paper we suggest a deconvolution method for the above estimation problems and discuss some of its applications in Empirical Bayes analysis. The method involves a quadratic programming step, which is an elaboration on the formulation and technique in Efron(2013). It is computationally efficient and may handle large data sets, where the popular method, of deconvolution using EM-algorithm, is impractical. The main application that we study is treatment of non-response. Our approach is nonstandard and does not involve missing at random type of assumptions. The method is demonstrated in simulations, as well as in an analysis of a real data set from the Labor force survey in Israel. Other applications including estimation of the risk, and estimation of False Discovery Rates, are also discussed. We also present a method, that involves convex optimization, for constructing confidence intervals for $E_{G^*} h$, under the above setup.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑