arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1707.00727stat.ML
收藏

回归密集阵

Regression Phalanxes

Hongyang Zhang, William J. Welch, Ruben H. Zamar

摘要:

Tomal et al.(2015)在两类分类问题中的稀有类检测的背景下引入了“方阵”的概念。方阵是分类任务的特征子集。在本文中,我们提出了一个不同的类的应用程序在回归设置的方阵。我们定义了一个“回归方阵”--一个能够很好地协同工作进行预测的特征子集。我们提出了一种新的算法,自动选择回归方阵从高维数据集,使用层次聚类,并建立一个预测模型,为每个方阵进一步集成。通过广泛的模拟研究和在各个领域(包括药物发现,光谱数据的化学分析,微阵列分析和气候预测)的几个实际应用,我们表明,当与Lasso或随机森林等有效的预测方法相结合时,回归方阵的集合可以提高预测精度。

英文摘要:

Tomal et al. (2015) introduced the notion of "phalanxes" in the context of rare-class detection in two-class classification problems. A phalanx is a subset of features that work well for classification tasks. In this paper, we propose a different class of phalanxes for application in regression settings. We define a "Regression Phalanx" - a subset of features that work well together for prediction. We propose a novel algorithm which automatically chooses Regression Phalanxes from high-dimensional data sets using hierarchical clustering and builds a prediction model for each phalanx for further ensembling. Through extensive simulation studies and several real-life applications in various areas (including drug discovery, chemical analysis of spectra data, microarray analysis and climate projections) we show that an ensemble of Regression Phalanxes improves prediction accuracy when combined with effective prediction methods like Lasso or Random Forests.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑