arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1708.05688cs.HCcs.AI
收藏

人的不确定性与排序误差--预测数据采掘中成功评价的秘密

Human Uncertainty and Ranking Error -- The Secret of Successful Evaluation in Predictive Data Mining

University of Duesseldorf(杜塞尔多夫大学);Institute of Information Science(信息科学研究所)

Kevin Jasberg, Sergej Sizov

摘要:

数据采掘中最关键的问题之一是对人类行为进行建模,以提供个性化、适应性和推荐。这通常涉及隐性或显性知识,通过观察用户交互或直接询问用户。但这些信息来源总是受到人类决策的波动性的影响,使得所使用的数据在一定程度上不确定。在这方面的贡献,我们阐述了这种人类的不确定性的影响,当涉及到不同的数据采掘方法的比较评估。特别是,我们揭示了两个问题:(1)基于模型的预测的各种指标的偏差效应和(2)传播的不确定性,从而引起的错误概率的算法排名。为此,我们引入了一个概率的观点,并证明了这些问题的存在数学,以及提供可能的解决策略。我们主要在推荐系统的背景下,随着度量RMSE作为一个突出的例子,精确的质量措施,我们的理论。

英文摘要:

One of the most crucial issues in data mining is to model human behaviour in order to provide personalisation, adaptation and recommendation. This usually involves implicit or explicit knowledge, either by observing user interactions, or by asking users directly. But these sources of information are always subject to the volatility of human decisions, making utilised data uncertain to a particular extent. In this contribution, we elaborate on the impact of this human uncertainty when it comes to comparative assessments of different data mining approaches. In particular, we reveal two problems: (1) biasing effects on various metrics of model-based prediction and (2) the propagation of uncertainty and its thus induced error probabilities for algorithm rankings. For this purpose, we introduce a probabilistic view and prove the existence of those problems mathematically, as well as provide possible solution strategies. We exemplify our theory mainly in the context of recommender systems along with the metric RMSE as a prominent example of precision quality measures.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑