基于辅助任务引导的交互式注意模型的问题难度预测
Auxiliary Task Guided Interactive Attention Model for Question Difficulty Prediction
摘要:
在线学习平台进行考试,以单调的方式评估学习者,其中数据库中的问题可以被分类到Bloom分类法中,作为从基础知识到高级评估的不同复杂程度。这些考试中向所有学习者提出的问题都是静态的。向每个学习者提出不同难度的新问题以提供个性化的学习体验变得非常重要。在本文中,我们提出了一个多任务的方法与互动的注意力机制,Qdiff,共同预测布鲁姆的分类和难度水平的学术问题。我们使用一个注意力机制来帮助预测难度,预测的布卢姆分类表示和输入表示之间的相互作用建模。所提出的学习方法将有助于学习捕获Bloom的分类法和难度标签之间的关系的表示。所提出的多任务方法通过利用相关任务之间的关系来学习良好的输入表示,并且可以在任务相关的类似设置中使用。实验结果表明,该方法在难度预测方面优于单纯训练。然而,Bloom的标签可能并不总是针对某些数据集给出。因此,我们用一个模型对另一个数据集进行软标签,该模型经过微调以预测Bloom的标签,以证明我们的方法对只有困难标签的数据集的适用性。
英文摘要:
Online learning platforms conduct exams to evaluate the learners in a monotonous way, where the questions in the database may be classified into Bloom's Taxonomy as varying levels in complexity from basic knowledge to advanced evaluation. The questions asked in these exams to all learners are very much static. It becomes important to ask new questions with different difficulty levels to each learner to provide a personalized learning experience. In this paper, we propose a multi-task method with an interactive attention mechanism, Qdiff, for jointly predicting Bloom's Taxonomy and difficulty levels of academic questions. We model the interaction between the predicted bloom taxonomy representations and the input representations using an attention mechanism to aid in difficulty prediction. The proposed learning method would help learn representations that capture the relationship between Bloom's taxonomy and difficulty labels. The proposed multi-task method learns a good input representation by leveraging the relationship between the related tasks and can be used in similar settings where the tasks are related. The results demonstrate that the proposed method performs better than training only on difficulty prediction. However, Bloom's labels may not always be given for some datasets. Hence we soft label another dataset with a model fine-tuned to predict Bloom's labels to demonstrate the applicability of our method to datasets with only difficulty labels.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。