arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1810.11071cs.LGstat.ML
收藏

RELF:扩展了包络损失函数的稳健回归

RELF: Robust Regression Extended with Ensemble Loss Function

Ferdowsi University of Mashhad(马什哈德菲尔多西大学)

Hamideh Hajiabadi, Reza Monsefi, Hadi Sadoghi Yazdi

摘要:

包围技术是一种强大的方法,它将几个弱学习器组合起来,构建一个更强的学习器。集成技术作为一种元学习框架,可以很容易地应用到许多机器学习方法中。受集成技术的启发,本文提出了一种适用于简单回归量的集成损失函数。然后,我们提出了一个半二次学习算法,以找到参数的回归和最佳的权重与每个损失函数。此外,我们表明,我们提出的损失函数是强大的噪声环境中。对于一类特殊的损失函数,我们表明,我们提出的合奏损失函数是贝叶斯一致的和强大的。几个数据集上的实验评估表明,我们提出的集成损失函数显着提高了性能的一个简单的回归相比,国家的最先进的方法。

英文摘要:

Ensemble techniques are powerful approaches that combine several weak learners to build a stronger one. As a meta-learning framework, ensemble techniques can easily be applied to many machine learning methods. Inspired by ensemble techniques, in this paper we propose an ensemble loss functions applied to a simple regressor. We then propose a half-quadratic learning algorithm in order to find the parameter of the regressor and the optimal weights associated with each loss function. Moreover, we show that our proposed loss function is robust in noisy environments. For a particular class of loss functions, we show that our proposed ensemble loss function is Bayes consistent and robust. Experimental evaluations on several datasets demonstrate that our proposed ensemble loss function significantly improves the performance of a simple regressor in comparison with state-of-the-art methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑