快速参数密度估计
Rapid parametric density estimation
摘要:
参数密度估计,例如高斯分布,是统计领域的基础。机器学习需要对复杂得多的密度进行廉价的估计,基本方法是相对昂贵的最大似然估计(MLE)。将讨论廉价的密度估计,例如,将多项式(或傅立叶级数)字面上拟合到样本,其系数通过仅对样本上的单项式(或正弦/余弦)求平均来计算。另一个讨论的基本应用是将失真拟合到一些标准分布,如高斯分布-类似于ICA,但另外允许重建受干扰的密度。最后,通过使用加权平均,它也可以应用于非概率密度的估计,如建模质量分布,或通过使用负(或复)权重来解决各种聚类问题:拟合一个函数,该函数的符号(或参数)确定聚类。估计的参数接近最佳值,误差下降,如$1/\sqrt{n}$,其中$n$是样本量。
英文摘要:
Parametric density estimation, for example as Gaussian distribution, is the base of the field of statistics. Machine learning requires inexpensive estimation of much more complex densities, and the basic approach is relatively costly maximum likelihood estimation (MLE). There will be discussed inexpensive density estimation, for example literally fitting a polynomial (or Fourier series) to the sample, which coefficients are calculated by just averaging monomials (or sine/cosine) over the sample. Another discussed basic application is fitting distortion to some standard distribution like Gaussian - analogously to ICA, but additionally allowing to reconstruct the disturbed density. Finally, by using weighted average, it can be also applied for estimation of non-probabilistic densities, like modelling mass distribution, or for various clustering problems by using negative (or complex) weights: fitting a function which sign (or argument) determines clusters. The estimated parameters are approaching the optimal values with error dropping like $1/\sqrt{n}$, where $n$ is the sample size.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。