arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2608.16963cs.LGcs.CYstat.AP

EdNet日志中的学习策略簇追踪的是参与度而非掌握程度

Study-Strategy Clusters from EdNet Logs Track Engagement, Not Mastery

Qingchuan Lyu, Yingxin Li, Albert Yang

AI总结:

该研究基于EdNet-KT3数据聚类出8种学习策略簇,发现其可预测学习者后期参与度但与知识掌握程度关联微弱,说明聚类追踪的是参与度而非掌握程度。

AI中文摘要:

学习分析通常将智能辅导系统(ITS)日志的无监督聚类视为应预测学习效果的学习者类型,我们在EdNet-KT3上验证了这一假设。对5000名活跃学习者的学习策略特征(资源使用、复习、视频、习题练习)进行聚类,得到经轮廓系数筛选的父级划分(k=5),包含4个对比极点(以阅读为中心、以视频为主、以复习为主、以先做习题),加上占比约64.9%的近均值残差。对该残差重新聚类后新增4种更精细的风格,形成包含8种命名策略的自举稳定层级结构。我们按响应次数拆分每个学习者的时间线,使聚类仅使用前半段数据,结果仅使用后半段数据。早期簇可预测后期参与度(持续练习、完成后期会话,尤其是坚持性,η²≈0.106;完成率η²≈0.021),但无法预测后期无辅助正确率(后期首次尝试无帮助时的正确率;校正后p≈0.093)。部分策略的学习量上升,但仅基于学习量的聚类几乎无法匹配策略标签(ARI=0.064)。针对7个TOEIC考试部分的知识追踪模型(SAKT)预测下一次正确率的效果仅略优于仅知晓各部分通常难度的基线(AUC提升+0.051;95%置信区间[+0.045,+0.058]),且该掌握信号与行为风格几乎无关(ARI=0.007)。此处的行为聚类描述的是学习风格与参与度,而非知识增益。

英文摘要:

Learning analytics often treats unsupervised clusters of intelligent tutoring system (ITS) logs as learner types that should predict learning. We test that assumption on EdNet-KT3. Clustering study-strategy features (resource use, revision, video, problem practice) for 5{,}000 active learners yields a silhouette-selected parent cut ($k=5$) with 4 contrast poles (reading-focused, video-heavy, revision-heavy, and problem-first) plus a large near-mean residual ($\sim$64.9\%). Reclustering that residual adds four finer styles, giving a bootstrap-stable hierarchy of 8 named strategies. We split each learner's timeline by respond count so clusters use only the early half and outcomes only the late half. Early clusters predict later engagement (continuing to practice and finishing late sessions, especially persistence, $η^{2}\approx 0.106$; completion $η^{2}\approx 0.021$) but not later unassisted accuracy (correctness on late first-attempts without help; $p_{\mathrm{adj}}\approx 0.093$). Volume rises with some styles, yet volume-only clustering barely matches strategy labels (ARI$=0.064$). A knowledge-tracing model (SAKT) on the seven TOEIC exam sections predicts next correctness only modestly better than a baseline that knows only how hard each section usually is (AUC lift $+0.051$; CI $[+0.045,+0.058]$), and that mastery signal is nearly independent of behavior styles (ARI$=0.007$). Behavioral clustering here describes study styles and engagement, not knowledge gains.

↑