arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.15460cs.HCcs.AI
收藏

支点还是天花板?不同世代的LLM如何塑造EFL学生的写作

The Crutch or the Ceiling? How Different Generations of LLMs Shape EFL Student Writings

Education University of Hong Kong(教育大学(香港));Everwrite Limited(Everwrite有限公司);International Christian School(国际基督教学校)

Hengky Susanto, David James Woo, Chingyi Yeung, Stephanie Wing Yan Lo-Philip, Chi Ho Yeung

AI总结:

本研究探讨LLM在辅助EFL学生写作中的作用及局限,发现高级LLM虽提升评分和词汇多样性,但可能掩盖真实能力,建议教学应关注学习过程而非仅输出质量。

摘要:

大型语言模型(LLM)的快速演变使其成为增强学生写作的强大工具。本研究探讨了LLM在协助中等教育阶段的英语作为外语(EFL)学生写作任务中的程度和限制。尽管现有研究关注输出质量,我们的研究则考察了LLM的发展变化及其对EFL学生的影响,评估更高级的模型是真正的支架还是单纯的补偿拐杖。为此,我们分析了在ChatGPT发布前后由LLM辅助的学生写作,使用专家定性评分和定量指标(可读性测试、皮尔逊相关系数、MTLD等)。我们的结果表明,高级LLM提高了低水平学习者的评估分数和词汇多样性,可能掩盖其真实能力。关键的是,增加的LLM辅助与人类专家评分呈负相关,表明表面流畅性而非深层连贯性。为了将AI辅助练习转变为真正的学习,教学必须从关注输出质量转向验证学习过程。教育者应将AI功能,特别是区分意念支架与文本生产,纳入学习者的最近发展区。

英文摘要:

The rapid evolution of Large Language Models (LLMs) has made them powerful tools for enhancing student writing. This study explores the extent and limitations of LLMs in assisting secondary-level English as a Foreign Language (EFL) students with their writing tasks. While existing studies focus on output quality, our research examines the developmental shift in LLMs and their impact on EFL students, assessing whether smarter models act as true scaffolds or mere compensatory crutches. To achieve this, we analyse student compositions assisted by LLMs before and after ChatGPT's release, using both expert qualitative scoring and quantitative metrics (readability tests, Pearson's correlation coefficient, MTLD, and others). Our results indicate that advanced LLMs boost assessment scores and lexical diversity for lower-proficiency learners, potentially masking their true ability. Crucially, increased LLM assistance correlated negatively with human expert ratings, suggesting surface fluency without deep coherence. To transform AI-assisted practice into genuine learning, pedagogy must shift from focusing on output quality to verifying the learning process. Educators should align AI functions, specifically differentiating ideational scaffolding from textual production, within the learner's Zone of Proximal Development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑