arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2605.27403cs.CYcs.AI
收藏

LLM辅助情感分析在综合计算与定性混合方法教育研究中的应用:学生书面反思作业案例研究

LLM-assisted sentiment analysis for integrated computational and qualitative mixed methods education research: A case study of students' written reflection assignments

Chandra Family Department of Electrical and Computer Engineering, University of Texas at Austin(德克萨斯大学奥斯汀分校电子与计算机工程系);Department of Engineering Education, Virginia Polytechnic Institute and State University(弗吉尼亚理工大学工程教育系);Gallogly College of Engineering, University of Oklahoma(俄克拉荷马大学加洛格利工程学院);Department of Mechanical and Materials Engineering, University of Nebraska-Lincoln(内布拉斯加大学林肯分校机械与材料工程系)

Xiomara Gonzalez, Gabriella Coloyan Fleming, Andrew Katz, Maya Denton, Jessica Deters

AI总结:

本研究通过纵向案例,利用LLM辅助情感分析结合统计检验与主题分析,探讨学生身份变量对留学期间语言交流情感的影响,发现海外生活经历是唯一显著变量。

摘要:

书面反思作业为学生提供了宝贵的批判性自我评估、意义建构和学习处理的机会。此外,此类反思为定性教育研究提供了丰富的数据。然而,定性数据分析可能耗时。定性比较不同参与者群体之间的发现更为耗时,通常将比较限制在最多一个变量(例如,二元性别)。大型语言模型(LLM)最近开始被批判性地评估用作定性研究助手。利用来自留学项目的纵向学生书面反思案例(n=151),我们研究了LLM辅助情感分析如何能够实现结合计算分析和主题分析的纵向混合方法研究。首先,使用统计检验根据七个不同的学生身份/生活经历变量定量比较情感差异。然后,这些结果指导定性数据分析,以调查这些差异背后的原因。对于本科留学学生,我们发现先前的海外生活经历是唯一影响学生对语言和交流行为情感的个人变量。这一工作流程对于定性研究人员在比较不同人口群体参与者时如何更轻松地探究多个变量具有启示意义。

英文摘要:

Written reflection assignments give students valuable opportunities for critical self-assessment, meaning making, and learning processing. Additionally, such reflections provide rich data for qualitative education research. However, qualitative data can be time-consuming to analyze. It is even more time-intensive to qualitatively compare findings between different groups of participants, usually limiting comparison to, at most, one variable (e.g., binary gender). Large language models (LLMs) have recently begun to be critically evaluated for use as qualitative research assistants. Using a longitudinal case of written student reflections (n=151) from a study abroad program, we investigate how LLM-assisted sentiment analysis can enable longitudinal mixed-methods research combining computational and thematic analyses. First, statistical testing is used to quantitatively compare sentiment differences according to seven different student identity/lived experience variables. Then, these results inform qualitative data analysis to investigate the reasons underlying these differences. For the case of undergraduate students studying abroad, we found that prior experience living abroad was the only personal variable impacting students' sentiments of their verbal language and communication behaviors. This workflow has implications for how qualitative researchers can more easily probe multiple variables when comparing participants from different demographic groups.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑