arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1404.5065cs.LG
收藏

基于随机线性目标组合的多目标回归

Multi-Target Regression via Random Linear Target Combinations

Aristotle University of Thessaloniki(塞萨洛尼基亚里士多德大学)

Grigorios Tsoumakas, Eleftherios Spyromitros-Xioufis, Aikaterini Vrekou, Ioannis Vlahavas

摘要:

多目标回归是基于同一组输入变量同时预测多个连续目标变量。它出现在几个有趣的工业和环境应用领域,如生态建模和能源预测。本文提出了一种多目标回归的集成方法,通过现有目标的随机线性组合来构造新的目标变量。我们讨论了我们的方法与多标签分类算法,特别是RA $k$ EL,最初启发了这项工作,和一个家庭最近的多标签分类算法,涉及输出编码的连接。在12个多目标数据集上的实验结果表明,它的性能显着优于使用梯度提升为每个目标学习单个模型的强基线,并与多目标随机森林方法相比,这是一种最先进的方法。实验进一步表明,当目标之间存在更强的无条件依赖时,我们的方法改进得更多。

英文摘要:

Multi-target regression is concerned with the simultaneous prediction of multiple continuous target variables based on the same set of input variables. It arises in several interesting industrial and environmental application domains, such as ecological modelling and energy forecasting. This paper presents an ensemble method for multi-target regression that constructs new target variables via random linear combinations of existing targets. We discuss the connection of our approach with multi-label classification algorithms, in particular RA$k$EL, which originally inspired this work, and a family of recent multi-label classification algorithms that involve output coding. Experimental results on 12 multi-target datasets show that it performs significantly better than a strong baseline that learns a single model for each target using gradient boosting and compares favourably to multi-objective random forest approach, which is a state-of-the-art approach. The experiments further show that our approach improves more when stronger unconditional dependencies exist among the targets.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑