arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1202.0302cs.LGstat.ML
收藏

基于非参数散度估计的样本集核

Kernels on Sample Sets via Nonparametric Divergence Estimates

Carnegie Mellon University(卡内基梅隆大学)

Danica J. Sutherland, Liang Xiong, Barnabás Póczos, Jeff Schneider

摘要:

大多数机器学习算法,如分类或回归,将单个数据点视为感兴趣的对象。在这里,我们考虑扩展机器学习算法来对数据点组进行操作。我们建议将一组数据点视为独立同分布。从该组的基础特征分布中提取样本集。我们的方法采用内核机器上的内核i.i.d.。向量的样本集。我们在成对的分布上定义某些核函数,然后使用非参数估计器来一致地估计基于样本集的这些函数。估计的Gram矩阵到对称半正定矩阵锥的投影使我们能够使用核机器进行分类,回归,异常检测和分布空间中的低维嵌入。我们提出了几个数值实验上的真实和模拟数据集,以证明我们的新方法的优点。

英文摘要:

Most machine learning algorithms, such as classification or regression, treat the individual data point as the object of interest. Here we consider extending machine learning algorithms to operate on groups of data points. We suggest treating a group of data points as an i.i.d. sample set from an underlying feature distribution for that group. Our approach employs kernel machines with a kernel on i.i.d. sample sets of vectors. We define certain kernel functions on pairs of distributions, and then use a nonparametric estimator to consistently estimate those functions based on sample sets. The projection of the estimated Gram matrix to the cone of symmetric positive semi-definite matrices enables us to use kernel machines for classification, regression, anomaly detection, and low-dimensional embedding in the space of distributions. We present several numerical experiments both on real and simulated datasets to demonstrate the advantages of our new approach.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑