arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.10249cs.LG
收藏

基于源代码嵌入的编程技能建模用于上下文感知的练习推荐

Modeling Programming Skills with Source Code Embeddings for Context-aware Exercise Recommendation

Departamento de Informática Universidade Federal de Viçosa(信息学院弗拉门多大学);Instituto Federal de Minas Gerais(矿业联邦机构);Instituto de Ciências Matemáticas e de Computação Universidade de São Paulo(数学与计算机科学学院圣保罗大学);Departamento de Ciência da Computação Universidade Federal de Minas Gerais(计算机科学学院联邦矿业大学)

Carlos Eduardo P. Silva, João Pedro M. Sena, Julio C. S. Reis, André G. Santos, Lucas N. Ferreira

AI总结:

本文提出基于源代码嵌入的上下文感知推荐系统,通过建模学生编程技能以提高练习推荐的准确性。

摘要:

在本文中,我们提出了一种上下文感知的推荐系统,该系统通过学生在课程中提交的源代码嵌入来建模其编程技能。这些嵌入能够预测学生在多个编程主题上的技能,生成与未见过的作业问题所需技能相匹配的技能档案。为了生成推荐,我们计算学生档案与问题技能向量之间的余弦相似度,根据与学生当前能力的匹配程度对练习进行排序。我们使用来自我们大学入门编程课程的学生和练习的真实数据评估了我们的方法。首先,我们评估了我们的源代码嵌入对预测技能的有效性,将其与基于词的和基于图的替代方法进行比较。结果表明,Jina嵌入在大多数技能上都优于TF-IDF、CodeBERT-cpp和GraphCodeBERT。此外,我们通过分析七次课程周期中收集的学生提交,评估了系统推荐与每周课程内容对齐的能力。我们的方法在基于正确性或解题时间的基线方法上始终产生了更合适的推荐,表明预测的编程技能为问题推荐提供了更强的信号。

英文摘要:

In this paper, we propose a context-aware recommender system that models students' programming skills using embeddings of the source code they submit throughout a course. These embeddings predict students' skills across multiple programming topics, producing profiles that are matched to the skills required by unseen homework problems. To generate recommendations, we compute the cosine similarity between student profiles and problem skill vectors, ranking exercises according to their alignment with each student's current abilities. We evaluated our approach using real data from students and exercises in an introductory programming course at our university. First, we assessed the effectiveness of our source code embeddings for predicting skills, comparing them with token-based and graph-based alternatives. Results showed that Jina embeddings outperformed TF-IDF, CodeBERT-cpp, and GraphCodeBERT across most skills. Additionally, we evaluated the system's ability to recommend exercises aligned with weekly course content by analyzing student submissions collected over seven course offerings. Our approach consistently produced more suitable recommendations than baselines based on correctness or solution time, indicating that predicted programming skills provide a stronger signal for problem recommendation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑