arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.11203cs.CYcs.CL
收藏

大型语言模型的生命周期:教育领域偏见综述

The Life Cycle of Large Language Models: A Review of Biases in Education

Cornell University(康奈尔大学);Columbia University(哥伦比亚大学);University of Michigan(密歇根大学)

Jinsook Lee, Yann Hicke, Renzhe Yu, Christopher Brooks, René F. Kizilcec

AI总结:

本综述绘制了大型语言模型从开发到教育应用的全生命周期图谱,系统识别各阶段偏见来源,并指出传统偏见度量不适用于高维、多答案的LLM生成内容,为教育公平评估提供实用指导。

摘要:

大型语言模型(LLM)正越来越多地被应用于教育场景,为师生提供个性化支持。基于LLM的应用在理解和生成自然语言方面展现出前所未有的能力,有望提升教学效果和学习成果,但将LLM整合进教育技术也重新引发了人们对算法偏见的担忧,这种偏见可能加剧教育不平等。本综述在先前关于传统机器学习生命周期映射工作的基础上,提供了从LLM初始开发到针对教育场景中各种应用定制预训练模型的LLM生命周期的整体图谱。我们解释了LLM生命周期的每一步,并识别了在教育情境中可能出现的偏见来源。我们讨论了为何传统机器学习中的偏见度量无法迁移到教育中LLM生成的内容(如辅导对话),因为文本是高维的,可能存在多个正确答案,而且定制化回应在教学上可能是可取的而非不公平的。本综述旨在阐明LLM应用中偏见的复杂性,并为其评估提供实用指导,以促进教育公平。

英文摘要:

Large Language Models (LLMs) are increasingly adopted in educational contexts to provide personalized support to students and teachers. The unprecedented capacity of LLM-based applications to understand and generate natural language can potentially improve instructional effectiveness and learning outcomes, but the integration of LLMs in education technology has renewed concerns over algorithmic bias which may exacerbate educational inequities. In this review, building on prior work on mapping the traditional machine learning life cycle, we provide a holistic map of the LLM life cycle from the initial development of LLMs to customizing pre-trained models for various applications in educational settings. We explain each step in the LLM life cycle and identify potential sources of bias that may arise in the context of education. We discuss why current measures of bias from traditional machine learning fail to transfer to LLM-generated content in education, such as tutoring conversations because the text is high-dimensional, there can be multiple correct responses, and tailoring responses may be pedagogically desirable rather than unfair. This review aims to clarify the complex nature of bias in LLM applications and provide practical guidance for their evaluation to promote educational equity.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑