arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1903.04016stat.MLcs.LG
收藏

$β^3$ - IRT:一种新的项目反应模型及其应用

$β^3$-IRT: A New Item Response Model and its Applications

University of Bristol(布里斯托大学);Universidade Federal de Pernambuco(伯南布哥联邦大学);Amazon(亚马逊);Alan Turing Institute(艾伦·图灵研究所)

Yu Chen, Telmo Silva Filho, Ricardo B. C. Prudêncio, Tom Diethe, Peter Flach

摘要:

项目反应理论(IRT)旨在根据被试在不同难度的能力倾向测验中回答的正确性来评估被试的潜在能力。在本文中,我们提出了$β^3$ -IRT模型,它模拟连续的反应,可以产生一个更丰富的家庭的项目特征曲线(ICC)。在实验中,我们将所提出的模型应用于来自在线考试平台的数据,并显示我们的模型在所有数据集上都优于更标准的2 PL-ND模型。此外,我们展示了如何应用$β^3$ -IRT来评估机器学习分类器的能力。这种新的应用程序的结果在一个新的度量,用于评估分类器的概率估计的质量,推断的困难和歧视的数据实例的基础上。

英文摘要:

Item Response Theory (IRT) aims to assess latent abilities of respondents based on the correctness of their answers in aptitude test items with different difficulty levels. In this paper, we propose the $β^3$-IRT model, which models continuous responses and can generate a much enriched family of Item Characteristic Curve (ICC). In experiments we applied the proposed model to data from an online exam platform, and show our model outperforms a more standard 2PL-ND model on all datasets. Furthermore, we show how to apply $β^3$-IRT to assess the ability of machine learning classifiers. This novel application results in a new metric for evaluating the quality of the classifier's probability estimates, based on the inferred difficulty and discrimination of data instances.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑