arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2401.01257cs.PL
收藏

剖析编程语言学习

Profiling Programming Language Learning

Will Crichton, Shriram Krishnamurthi

AI总结:

本文通过在《The Rust Programming Language》中添加交互式测验收集一年数据,分析了读者学习轨迹与测验特征,并进行12次干预使目标得分提升20%,证明了测验能有效剖析和改善编程语言学习。

摘要:

本文记录了一项为期一年的实验,旨在“剖析”学习编程语言的过程:通过收集数据来理解什么因素使得一门语言难以学习,并利用这些数据改善学习过程。我们为学习 Rust 的官方教材《The Rust Programming Language》添加了交互式测验。在 13 个月内,62,526 名读者回答了 1,140,202 次问题。首先,我们分析了读者的学习轨迹。我们发现,许多读者在面对困难的语言概念(如 Rust 的所有权类型)时会过早放弃阅读。其次,我们使用经典测试理论和项目反应理论来分析测验问题的特征。我们发现,更好的问题本质上更具概念性,例如询问程序为何无法编译,而不是询问程序是否能编译。第三,我们对本书进行了 12 次干预,以帮助读者解决困难问题。我们发现,平均而言,干预措施使目标问题的测验得分提高了 +20%。第四,我们通过在小 N 上模拟统计推断,表明我们的技术可能推广到用户基数较小的语言。这些结果表明,测验是一种简单且有用的技术,可用于理解各种规模的编程语言学习。

英文摘要:

This paper documents a year-long experiment to "profile" the process of learning a programming language: gathering data to understand what makes a language hard to learn, and using that data to improve the learning process. We added interactive quizzes to The Rust Programming Language, the official textbook for learning Rust. Over 13 months, 62,526 readers answered questions 1,140,202 times. First, we analyze the trajectories of readers. We find that many readers drop-out of the book early when faced with difficult language concepts like Rust's ownership types. Second, we use classical test theory and item response theory to analyze the characteristics of quiz questions. We find that better questions are more conceptual in nature, such as asking why a program does not compile vs. whether a program compiles. Third, we performed 12 interventions into the book to help readers with difficult questions. We find that on average, interventions improved quiz scores on the targeted questions by +20%. Fourth, we show that our technique can likely generalize to languages with smaller user bases by simulating our statistical inferences on small N. These results demonstrate that quizzes are a simple and useful technique for understanding language learning at all scales.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑