一种新的开放式在线作业项目反应理论模型
A New Item Response Theory Model for Open-Ended Online Homework with Multiple Allowed Attempts
摘要:
项目反应理论(IRT)最初是在传统的考试环境中发展起来的,它已被证明,该模型不容易转移到形成性评估的形式在线作业。我们调查,如果这主要是由于学习者的特点,不成为明显的考试设置,即随机猜测,由于缺乏勤奋或奉献精神,并复制其他学生或资源的工作。这两个特征都掩盖了学习者的真实能力,这是大多数主流一维IRT模型中考虑的唯一特征。我们发现,这些特质的引入确实可以更好地评估学习者的真实能力,以及更好地衡量评估项目的质量。对应的模型特征的自我报告的行为进行了调查和确认。我们发现,这两个特点,复制答案有较大的影响,在最初的家庭作业尝试比随机猜测。
英文摘要:
Item Response Theory (IRT) was originally developed in traditional exam settings, and it has been shown that the model does not readily transfer to formative assessment in the form of online homework. We investigate if this is mostly due to learner traits that do not become apparent in exam settings, namely random guessing due to lack of diligence or dedication, and copying work from other students or resources. Both of these traits mask the true ability of the learner, which is the only trait considered in most mainstream unidimensional IRT models. We find that indeed the introduction of these traits allows to better assess the true ability of the learners, as well as to better gauge the quality of assessment items. Correspondence of the model traits to self-reported behavior is investigated and confirmed. We find that of these two traits, copying answers has a larger influence on initial homework attempts than random guessing.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。