Prob2Vec:自适应教学中问题检索的数学语义嵌入
Prob2Vec: Mathematical Semantic Embedding for Problem Retrieval in Adaptive Tutoring
摘要:
我们提出了一个新的应用嵌入技术的问题检索自适应辅导。目标是检索数学概念相似的问题。有两个挑战:第一,就像句子一样,对辅导有帮助的问题在基本概念方面从来都不完全相同。相反,好的问题以创新的方式混合概念,同时仍然显示出它们之间关系的连续性。其次,人类很难确定在足够大的训练集上一致的相似性得分。我们提出了一个层次化的问题嵌入算法,称为Prob 2 Vec,由抽象和嵌入步骤。Prob 2 Vec在问题相似性测试中达到了96.88%的准确率,而直接应用最先进的句子嵌入方法的准确率为75%。有趣的是,Prob 2 Vec能够区分问题之间非常细粒度的差异,这是人类需要时间和精力才能获得的能力。此外,不平衡训练数据集的概念标注子问题本身也很有趣。这是一个多标签问题的维数爆炸,我们提出了改善的方法。我们提出了一种新的负预训练算法,大大降低了假阴性和阳性率的分类,使用不平衡的训练数据集。
英文摘要:
We propose a new application of embedding techniques for problem retrieval in adaptive tutoring. The objective is to retrieve problems whose mathematical concepts are similar. There are two challenges: First, like sentences, problems helpful to tutoring are never exactly the same in terms of the underlying concepts. Instead, good problems mix concepts in innovative ways, while still displaying continuity in their relationships. Second, it is difficult for humans to determine a similarity score that is consistent across a large enough training set. We propose a hierarchical problem embedding algorithm, called Prob2Vec, that consists of abstraction and embedding steps. Prob2Vec achieves 96.88\% accuracy on a problem similarity test, in contrast to 75\% from directly applying state-of-the-art sentence embedding methods. It is interesting that Prob2Vec is able to distinguish very fine-grained differences among problems, an ability humans need time and effort to acquire. In addition, the sub-problem of concept labeling with imbalanced training data set is interesting in its own right. It is a multi-label problem suffering from dimensionality explosion, which we propose ways to ameliorate. We propose the novel negative pre-training algorithm that dramatically reduces false negative and positive ratios for classification, using an imbalanced training data set.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。