KNIFE:核迭代特征提取
KNIFE: Kernel Iterative Feature Extraction
摘要:
在非线性或核空间中选择重要特征在分类和回归问题中都是一个困难的挑战。当许多特征不相关时,诸如支持向量机和核岭回归之类的核方法有时会表现不佳。我们建议用一组稀疏的权重对内核中的特征进行加权,这些权重是结合原始分类或回归问题估计的。迭代算法KNIFE在寻找原始问题的系数和通过核线性化寻找特征权重之间交替。此外,对KNIFE稍加修改,就可以得到一个有效的算法来寻找特征正则化路径,或者每个特征的权重路径。仿真结果表明,实用的KNIFE核回归和支持向量机与各种内核。特征路径实现还揭示了特征之间的重要非线性相关性,这些特征在确定重要变量的子集时被证明是有用的。元音识别数据,帕金森氏病的数据,和微阵列数据的结果也给出了。
英文摘要:
Selecting important features in non-linear or kernel spaces is a difficult challenge in both classification and regression problems. When many of the features are irrelevant, kernel methods such as the support vector machine and kernel ridge regression can sometimes perform poorly. We propose weighting the features within a kernel with a sparse set of weights that are estimated in conjunction with the original classification or regression problem. The iterative algorithm, KNIFE, alternates between finding the coefficients of the original problem and finding the feature weights through kernel linearization. In addition, a slight modification of KNIFE yields an efficient algorithm for finding feature regularization paths, or the paths of each feature's weight. Simulation results demonstrate the utility of KNIFE for both kernel regression and support vector machines with a variety of kernels. Feature path realizations also reveal important non-linear correlations among features that prove useful in determining a subset of significant variables. Results on vowel recognition data, Parkinson's disease data, and microarray data are also given.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。