TutorTrace：用于AI辅助编程教育中学习者行为状态分类的数据集与分类体系
TutorTrace: A Dataset and Taxonomy for Classifying Learner Behavioral States during AI-Assisted Programming Education
浏览论文内容
中文总结 AI 辅助
本研究提出TutorTrace数据集与分类体系，基于IDE遥测数据实现学习者行为语境的实时计算，经课堂评估和预测任务验证，可提升AI编程辅导的自适应能力。
中文摘要 AI 辅助
AI编程辅导器提供了可扩展的支持，但缺乏人类辅导者赖以调整支持以适应学习者需求的行为语境。我们提出TutorTrace，这是一个数据集和行为抽象流水线，能从底层IDE遥测数据中实时使学习者的行为语境变得可见且可计算。在两门Python入门课程的四次部署中（N=480），TutorTrace捕获了约180000个遥测事件、13633个行为片段和27个持续计算的指标。基于此基础，我们推导了学习者在首次AI查询前、连续查询之间以及整个会话中的活动分类体系，使系统不仅能响应学习者所说的内容，还能响应他们在求助时刻之前的行为。在一项初步课堂评估中，感知行为的提示与无独立工作的查询间隔从50.0%降至20.7%相关。作为下游效用的额外演示，我们在两个保留的预测任务上评估了TutorTrace：学习者是否会在接下来60秒内查询（AUROC=0.726），以及即将到来的查询是否反映指导性或依赖性求助（AUROC=0.717）。这些发现共同表明，行为语境如何能实现规模化的自适应AI辅导。
英文摘要
AI programming tutors provide scalable support, yet lack the behavioral context human tutors rely on to adapt support to learners' needs. We present TutorTrace, a dataset and behavioral abstraction pipeline that makes learners' behavioral context visible and computable in real time from low-level IDE telemetry. Across four deployments in two introductory Python courses (N=480), TutorTrace captures approximately 180K telemetry events, 13,633 behavioral segments, and 27 continuously computed metrics. From this foundation, we derive a taxonomy of learner activity before the first AI query, between consecutive queries, and across the full session, enabling systems to respond not just to what learners say, but to what they have done leading up to the help-seeking moment. In a preliminary classroom evaluation, behavior-aware prompts were associated with a decrease in intervals between queries with no independent work from 50.0% to 20.7%. As an additional demonstration of downstream utility, we evaluate TutorTrace on two held-out prediction tasks: whether a learner will query within the next 60 seconds (AUROC=.726) and whether an upcoming query reflects guided or dependent help-seeking (AUROC=.717). Together, these findings show how behavioral context can enable adaptive AI tutoring at scale.
发表机构
- Virginia Tech（弗吉尼亚理工大学）
- Sepuluh Nopember Institute of Technology（泗水十一人理工学院）
机构由 AI 辅助整理，请以论文原文为准。
