arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.08828cs.SEcs.AI
收藏

利用预训练模型估计编程题难度等级

Estimating Difficulty Levels of Programming Problems with Pre-trained Model

East China Normal University(华东师范大学)

Zhiyuan Wang, Wei Zhang, Jun Wang

AI总结:

本文提出融合文本与代码双模态预训练模型,自动估计编程题难度,并在两个POJ数据集上验证了其有效性。

摘要:

随着编程技能在产业界和学术界的需求不断增长,学生通常借助编程在线评测(POJ)平台进行编码练习和竞赛。每道编程题的难度等级是指导学生自适应学习的重要参考。然而,现有的难度等级确定方法要么需要大量专家标注,要么需要较长时间才能为每道题积累足够的学生提交解答。为了解决这一问题,我们在给定题目文本描述和代码解答示例的条件下,形式化了每道编程题难度等级的自动估计问题。为应对该问题,我们提出将两个预训练模型耦合为一个统一模型,其中一个用于文本模态,另一个用于代码模态。我们为该任务构建了两个POJ数据集,实验结果表明所提方法的有效性以及两种模态的贡献。

英文摘要:

As the demand for programming skills grows across industries and academia, students often turn to Programming Online Judge (POJ) platforms for coding practice and competition. The difficulty level of each programming problem serves as an essential reference for guiding students' adaptive learning. However, current methods of determining difficulty levels either require extensive expert annotations or take a long time to accumulate enough student solutions for each problem. To address this issue, we formulate the problem of automatic difficulty level estimation of each programming problem, given its textual description and a solution example of code. For tackling this problem, we propose to couple two pre-trained models, one for text modality and the other for code modality, into a unified model. We built two POJ datasets for the task and the results demonstrate the effectiveness of the proposed approach and the contributions of both modalities.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑