arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2601.04458cs.LG
收藏

利用大语言模型检测协作学习中的社会共享调节

Using Large Language Models to Detect Socially Shared Regulation of Collaborative Learning

University of Pennsylvania(宾夕法尼亚大学);Carnegie Mellon University(卡内基梅隆大学);Vanderbilt University(范德堡大学);University of Detroit Mercy(底特律默克大学);New York University(纽约大学)

Jiayi Zhang, Conrad Borchers, Clayton Cohn, Namrata Srivastava, Caitlin Snyder, Siyuan Guo, Ashwin T S, Naveeduddin Mohammed, Haley Noh, Gautam Biswas

AI总结:

本文利用大语言模型检测协作学习中的社会共享调节行为,通过嵌入方法提升学习分析的预测能力。

摘要:

学习分析领域在自动化检测多模态数据中的复杂学习过程方面取得了显著进展。然而,大多数进展集中在个体化问题解决,而非协作、开放性问题解决,这可能为行为预测提供更丰富的数据但也带来低凝聚力的挑战。本文扩展了预测模型,利用基于嵌入的方法,自动检测协作计算建模环境中学习的社会共享调节(SSRL)行为。我们利用大语言模型(LLMs)作为摘要工具,生成与系统日志对齐的学生活动任务感知表示。这些摘要结合纯文本嵌入、上下文丰富嵌入和日志衍生特征,用于训练预测模型。结果表明,纯文本嵌入在检测与执行或群体动态相关的SSRL行为(如偏离任务或请求帮助)方面表现更强。相比之下,上下文和多模态特征对计划和反思等构念提供了互补优势。总体而言,我们的发现突显了基于嵌入模型在扩展学习分析中的潜力,通过实现可扩展的SSRL行为检测,最终支持协作学习环境中教师重视的实时反馈和适应性支架。

英文摘要:

The field of learning analytics has made notable strides in automating the detection of complex learning processes in multimodal data. However, most advancements have focused on individualized problem-solving instead of collaborative, open-ended problem-solving, which may offer both affordances (richer data) and challenges (low cohesion) to behavioral prediction. Here, we extend predictive models to automatically detect socially shared regulation of learning (SSRL) behaviors in collaborative computational modeling environments using embedding-based approaches. We leverage large language models (LLMs) as summarization tools to generate task-aware representations of student dialogue aligned with system logs. These summaries, combined with text-only embeddings, context-enriched embeddings, and log-derived features, were used to train predictive models. Results show that text-only embeddings often achieve stronger performance in detecting SSRL behaviors related to enactment or group dynamics (e.g., off-task behavior or requesting assistance). In contrast, contextual and multimodal features provide complementary benefits for constructs such as planning and reflection. Overall, our findings highlight the promise of embedding-based models for extending learning analytics by enabling scalable detection of SSRL behaviors, ultimately supporting real-time feedback and adaptive scaffolding in collaborative learning environments that teachers value.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑