从低维数据估计高维变量概率分布的极大熵估计
Maximum Entropy estimation of probability distribution of variables in higher dimensions from lower dimensional data
摘要:
常见的统计情况涉及从已知分布P(y)推断未知分布Q(x),其中X(维度n)和Y(维度m)具有已知的函数关系。最常见的是n<m,任务相对简单。例如,如果Y1和Y2是独立的随机变量,每个都在[0,1]上均匀分布,则可以确定X = Y1 + Y2的分布;这里m=2,n=1。然而,当n>m时,可能出现生物和物理情况。一般来说,在没有额外信息的情况下,在这些情况下Q没有唯一的解。尽管如此,人们还是想对Q做一些推论。为此,我们提出了一种新的最大熵(MaxEnt)方法,该方法仅基于可用数据(即P(y))来估计Q(x)。该方法的另一个优点是不需要显式计算拉格朗日乘子。在本文中,我们开发的方法,离散和连续的概率分布,并证明其有效性。我们也给出了一个直观的理由,并举例说明。
英文摘要:
A common statistical situation concerns inferring an unknown distribution Q(x) from a known distribution P(y), where X (dimension n), and Y (dimension m) have a known functional relationship. Most commonly, n<m, and the task is relatively straightforward. For example, if Y1 and Y2 are independent random variables, each uniform on [0, 1], one can determine the distribution of X = Y1 + Y2; here m=2 and n=1. However, biological and physical situations can arise where n>m. In general, in the absence of additional information, there is no unique solution to Q in those cases. Nevertheless, one may still want to draw some inferences about Q. To this end, we propose a novel maximum entropy (MaxEnt) approach that estimates Q(x) based only on the available data, namely, P(y). The method has the additional advantage that one does not need to explicitly calculate the Lagrange multipliers. In this paper we develop the approach, for both discrete and continuous probability distributions, and demonstrate its validity. We give an intuitive justification as well, and we illustrate with examples.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。