arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2410.22282cs.CY
收藏

谁的ChatGPT?揭示大型语言模型带来的现实教育不平等

Whose ChatGPT? Unveiling Real-World Educational Inequalities Introduced by Large Language Models

Renzhe Yu, Zhen Xu, Sky CH-Wang, Richard Arum

AI总结:

本研究通过分析美国一所少数族裔服务公立院校超百万份学生写作作业,发现LLM普及虽提升整体写作质量、缩小语言群体差距,但公平效应更多集中于高社会经济地位学生,揭示了LLM时代的教育数字鸿沟。

摘要:

自2022年末以来,ChatGPT及其他同类工具的普及引发了公众的极大热情,也推动了大量关于大型语言模型(LLM)提升学习体验与学习成果潜力的实验研究,尤其针对弱势背景学习者。然而,除了理论预测和针对创新LLM应用的对照研究外,鲜有研究系统检验LLM普及对教育公平的现实影响。为描绘LLM出现后的不平等趋势,我们分析了2021至2024年间美国一所服务少数族裔的公立院校中16791名大学生提交的1140328份学术写作作业,这些作业来自2391门课程。我们发现,LLM普及后学生的整体写作质量逐步提升,语言优势群体与语言弱势群体学生之间的写作质量差距持续缩小。但这种公平化效应更多集中在社会经济地位较高的学生群体中。这些发现揭示了LLM时代的数字鸿沟,引发了对LLM早期阶段公平效益的质疑,也凸显了研究者与从业者需制定负责任的实践方案,以通过LLM促进教育公平。

英文摘要:

The universal availability of ChatGPT and other similar tools since late 2022 has prompted tremendous public excitement and experimental effort about the potential of large language models (LLMs) to improve learning experience and outcomes, especially for learners from disadvantaged backgrounds. However, little research has systematically examined the real-world impacts of LLM availability on educational equity beyond theoretical projections and controlled studies of innovative LLM applications. To depict trends of post-LLM inequalities, we analyze 1,140,328 academic writing submissions from 16,791 college students across 2,391 courses between 2021 and 2024 at a public, minority-serving institution in the US. We find that students' overall writing quality gradually increased following the availability of LLMs and that the writing quality gaps between linguistically advantaged and disadvantaged students became increasingly narrower. However, this equitizing effect was more concentrated on students with higher socioeconomic status. These findings shed light on the digital divides in the era of LLMs and raise questions about the equity benefits of LLMs in early stages and highlight the need for researchers and practitioners on developing responsible practices to improve educational equity through LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑