arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.03599cs.LG
收藏

基于核密度估计与袋外评分的袋外预测评估

Evaluation of Bagging Predictors with Kernel Density Estimation and Bagging Score

Institute of Digital Engineering, Technical University of Applied Sciences W\" u rzburg-Schweinfurt Ignaz-Schön-Straße 11 Schweinfurt, Bavaria Germany 97421;Institute of Digital Engineering, Technical University of Applied Sciences W\" u rzburg-Schweinfurt

Philipp Seitz, Jan Schmitt, Andreas Schiffler

AI总结:

本文提出利用核密度估计和神经网络进行非线性回归,以确定袋外预测的代表性值,并引入袋外评分作为置信度指标,优于传统均值或中位数方法,且在无优化或特征选择的情况下表现优异。

摘要:

对于多个不同训练的机器学习模型的预测集合,通常取平均值作为袋外预测。然而,这种做法在某些参数区域可能偏离真实地面真相。本文提出一种方法,利用核密度估计(KDE)在非线性回归中同时提供一个关联的质量标准beta_BS,称为袋外评分(BS),以反映所获得的集成预测的置信度。证明使用新方法比使用常规的均值或中位数方法能获得更好的预测结果。此外,该方法与文献中的几种非线性回归方法进行了对比,在计算的误差值中均排名第一,且无需使用任何优化或特征选择技术。

英文摘要:

For a larger set of predictions of several differently trained machine learning models, known as bagging predictors, the mean of all predictions is taken by default. Nevertheless, this proceeding can deviate from the actual ground truth in certain parameter regions. An approach is presented to determine a representative y_BS from such a set of predictions using Kernel Density Estimation (KDE) in nonlinear regression with Neural Networks (NN) which simultaneously provides an associated quality criterion beta_BS, called Bagging Score (BS), that reflects the confidence of the obtained ensemble prediction. It is shown that working with the new approach better predictions can be made than working with the common use of mean or median. In addition to this, the used method is contrasted to several approaches of nonlinear regression from the literatur, resulting in a top ranking in each of the calculated error values without using any optimization or feature selection technique.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑