arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.09183math.STstat.TH
收藏

推广的Bregman散度与参数估计

The extended Bregman divergence and parametric estimation

Sancharee Basak, Ayanendranath Basu

摘要:

在鲁棒推理领域,最小化数据密度和模型密度之间的统计距离已被证明是一种非常有用的技术。除了\cite{a}和\cite{b}的$ϕ$ -发散类之外,Bregman发散(\cite{c})已被广泛用于此目的。然而,由于数据密度必须有一个线性的存在,在向量积项的Bregman分歧涉及的数据和模型的密度,几个有用的分歧不能捕捉到通常的Bregman形式。在这方面,我们提供了一个扩展的普通Bregman发散考虑指数的密度函数作为参数,而不是密度函数本身。我们证明,许多有用的分歧家庭,这不是通常Bregman分歧,可以容纳在这个扩展的描述。使用这个公式,人们可以开发许多新的家庭的分歧,这可能是有用的鲁棒推理。特别是,通过应用这个扩展,我们提出了新的类的GSB发散族。我们探讨了离散参数模型中最小GSB散度估计的适用性。仿真研究以及符合实际数据的例子来证明估计的性能,并证实理论发展。

英文摘要:

Minimization of suitable statistical distances~(between the data and model densities) has proved to be a very useful technique in the field of robust inference. Apart from the class of $ϕ$-divergences of \cite{a} and \cite{b}, the Bregman divergence (\cite{c}) has been extensively used for this purpose. However, since the data density must have a linear presence in the cross product term of the Bregman divergence involving both the data and model densities, several useful divergences cannot be captured by the usual Bregman form. In this respect, we provide an extension of the ordinary Bregman divergence by considering an exponent of the density function as the argument rather than the density function itself. We demonstrate that many useful divergence families, which are not ordinarily Bregman divergences, can be accommodated within this extended description. Using this formulation, one can develop many new families of divergences which may be useful in robust inference. In particular, through an application of this extension, we propose the new class of the GSB divergence family. We explore the applicability of the minimum GSB divergence estimator in discrete parametric models. Simulation studies as well as conforming real data examples are given to demonstrate the performance of the estimator and to substantiate the theory developed.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑