arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2105.01567cs.LG
收藏

影响学习者对真值归纳偏差的错误测度

Towards Error Measures which Influence a Learners Inductive Bias to the Ground Truth

University of Southampton(南安普顿大学);The Alan Turing Institute(艾伦·图灵研究所)

A. I. Parkes, A. J. Sobey, D. A. Hudson

摘要:

人工智能应用于一系列部门,并依赖于需要高度信任的决策。对于回归方法,如果它们近似真实的输入-输出关系并且在训练数据的界限之外准确地执行,则信任度增加。但是,测试集外的性能往往很差,特别是当数据稀疏时。这是因为条件平均值,这在许多情况下是一个很好的近似“地面真相”,只有在数据集遵守限制性假设时,才用传统的闵可夫斯基-r误差测量建模,许多真实的数据集违反了这些假设。为了解决这个问题,有几种方法使用先验知识来近似“基本事实”。然而,先验知识并不总是可用的,本文探讨了如何错误的措施影响回归方法的能力,在这些情况下的“真值”建模。目前的错误措施,以创建一个无益的偏见,并得出一个新的错误措施,不表现出这种行为。这是36个具有不同特征的代表性数据集进行测试,表明它是更一致的确定"真值“,并在超出范围的训练数据的区域提供改进的预测。

英文摘要:

Artificial intelligence is applied in a range of sectors, and is relied upon for decisions requiring a high level of trust. For regression methods, trust is increased if they approximate the true input-output relationships and perform accurately outside the bounds of the training data. But often performance off-test-set is poor, especially when data is sparse. This is because the conditional average, which in many scenarios is a good approximation of the `ground truth', is only modelled with conventional Minkowski-r error measures when the data set adheres to restrictive assumptions, with many real data sets violating these. To combat this there are several methods that use prior knowledge to approximate the `ground truth'. However, prior knowledge is not always available, and this paper investigates how error measures affect the ability for a regression method to model the `ground truth' in these scenarios. Current error measures are shown to create an unhelpful bias and a new error measure is derived which does not exhibit this behaviour. This is tested on 36 representative data sets with different characteristics, showing that it is more consistent in determining the `ground truth' and in giving improved predictions in regions beyond the range of the training data.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑