预测数据采掘中人为不确定性的概率分析
Probabilistic Perspectives on Collecting Human Uncertainty in Predictive Data Mining
摘要:
在数据采掘的许多领域中,数据是从人类那里收集的。在这篇文章中,我们提出了一个问题,人们实际上是如何应对有序尺度的。观察到的主要问题是,用户往往是不稳定的,在他们的选择,即复杂的认知并不总是导致相同的决定,但可能的决策输出的分布。这种人为的不确定性有时可能对常见的数据采掘方法产生相当大的影响,因此,对这种所谓的人为不确定性进行有效建模的问题自然出现。我们的贡献介绍了两种不同的方法来模拟人类的不确定性用户的反应。在这样做的过程中,我们开发的技术,以衡量这种不确定性的用户输入的水平,以及用户的认知水平。在全面的用户实验和大规模模拟的支持下,我们系统地比较了这两种方法及其对个性化方法的影响。我们的研究结果表明,大量的用户确实提交了与他们实际想法(认知)完全不同的东西(动作)。此外,我们表明,算法评估方面的统计上合理的证据变得很难实现,特别是当明确的排名应建立。
英文摘要:
In many areas of data mining, data is collected from humans beings. In this contribution, we ask the question of how people actually respond to ordinal scales. The main problem observed is that users tend to be volatile in their choices, i.e. complex cognitions do not always lead to the same decisions, but to distributions of possible decision outputs. This human uncertainty may sometimes have quite an impact on common data mining approaches and thus, the question of effective modelling this so called human uncertainty emerges naturally. Our contribution introduces two different approaches for modelling the human uncertainty of user responses. In doing so, we develop techniques in order to measure this uncertainty at the level of user inputs as well as the level of user cognition. With support of comprehensive user experiments and large-scale simulations, we systematically compare both methodologies along with their implications for personalisation approaches. Our findings demonstrate that significant amounts of users do submit something completely different (action) than they really have in mind (cognition). Moreover, we demonstrate that statistically sound evidence with respect to algorithm assessment becomes quite hard to realise, especially when explicit rankings shall be built.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。