Sharp-SSL:用于半监督学习的选择性高维轴对齐随机投影
Sharp-SSL: Selective high-dimensional axis-aligned random projections for semi-supervised learning
AI总结:
本文提出Sharp-SSL方法,通过聚合高维轴对齐随机投影的低维分析结果并基于白化类间协方差矩阵迹评分来识别关键变量,理论证明其能以高概率恢复信号坐标,实验验证了其优越性能。
摘要:
我们提出了一种新的高维半监督学习方法,该方法基于对应用于数据的多个轴对齐随机投影的低维程序结果进行精心聚合。我们的主要目标是识别用于区分类别的重要变量;然后可以应用现有的低维方法进行最终的类别分配。受广义Rayleigh商的启发,我们根据投影数据上估计的白化类间协方差矩阵的迹来对投影进行评分。这使我们能够为给定投影中的每个变量分配重要性权重,并通过在高评分投影上聚合这些权重来选择信号变量。我们的理论表明,当我们在足够多的随机投影上进行聚合,并且基础程序对白化类间协方差矩阵的估计足够好时,所得到的Sharp-SSL算法能够以高概率恢复信号坐标。高斯EM算法是作为基础程序的一个自然选择,我们对其在半监督设置下的性能进行了新的分析,该分析以样本中标记数据的比例来控制参数估计误差。在模拟数据和一个真实结肠肿瘤数据集上的数值结果支持了该方法出色的经验性能。
英文摘要:
We propose a new method for high-dimensional semi-supervised learning problems based on the careful aggregation of the results of a low-dimensional procedure applied to many axis-aligned random projections of the data. Our primary goal is to identify important variables for distinguishing between the classes; existing low-dimensional methods can then be applied for final class assignment. Motivated by a generalized Rayleigh quotient, we score projections according to the traces of the estimated whitened between-class covariance matrices on the projected data. This enables us to assign an importance weight to each variable for a given projection, and to select our signal variables by aggregating these weights over high-scoring projections. Our theory shows that the resulting Sharp-SSL algorithm is able to recover the signal coordinates with high probability when we aggregate over sufficiently many random projections and when the base procedure estimates the whitened between-class covariance matrix sufficiently well. The Gaussian EM algorithm is a natural choice as a base procedure, and we provide a new analysis of its performance in semi-supervised settings that controls the parameter estimation error in terms of the proportion of labeled data in the sample. Numerical results on both simulated data and a real colon tumor dataset support the excellent empirical performance of the method.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。