arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2412.06989cs.HCcs.AIcs.CY
收藏

五步学习算法审计:为高中生搭建系统性批判性评估机器学习应用的支架

Learning About Algorithm Auditing in Five Steps: Scaffolding How High School Youth Can Systematically and Critically Evaluate Machine Learning Applications

University of Pennsylvania(宾夕法尼亚大学);Teachers College, Columbia University(哥伦比亚大学教师学院)

Luis Morales-Navarro, Yasmin B. Kafai, Lauren Vogelstein, Evelyn Yu, Danaë Metaxa

AI总结:

本研究梳理专家与用户的算法审计实践,提出支持青少年审计机器学习系统的五步骤框架,并通过青少年审计TikTok生成式AI滤镜的课外工坊案例验证,为算法审计融入K-12教育提供支架设计参考与实践方向。

摘要:

尽管学界对支持年轻人批判性评估由机器学习驱动的系统抱有广泛兴趣,但关于如何引导他们探究这类系统的运作方式、局限性及潜在影响的研究仍十分匮乏。在K-12教育领域之外,评估黑盒系统的一种有效策略是算法审计——这是一种从外部向内理解算法系统不透明的内部运作机制与外部影响的方法。\n本文梳理了专家研究者开展算法审计的方式,以及终端用户参与审计实践的模式,据此提出五个步骤,将其融入学习活动后可支持年轻人开展算法审计。我们展示了一项案例研究:一组青少年在课外工坊中按照每个步骤开展实践,审计了由同龄人设计的生成式AI TikTok滤镜。我们讨论了为支持青少年进行算法审计所提供的各类支架,以及将算法审计融入课堂活动的方向与挑战。本文的贡献包括:(a) 提出了为算法审计学习活动搭建支架的五个步骤的概念框架;(b) 提供了在我们的试点研究中青少年参与每个步骤的实例。

英文摘要:

While there is widespread interest in supporting young people to critically evaluate machine learning-powered systems, there is little research on how we can support them in inquiring about how these systems work and what their limitations and implications may be. Outside of K-12 education, an effective strategy in evaluating black-boxed systems is algorithm auditing-a method for understanding algorithmic systems' opaque inner workings and external impacts from the outside in. In this paper, we review how expert researchers conduct algorithm audits and how end users engage in auditing practices to propose five steps that, when incorporated into learning activities, can support young people in auditing algorithms. We present a case study of a team of teenagers engaging with each step during an out-of-school workshop in which they audited peer-designed generative AI TikTok filters. We discuss the kind of scaffolds we provided to support youth in algorithm auditing and directions and challenges for integrating algorithm auditing into classroom activities. This paper contributes: (a) a conceptualization of five steps to scaffold algorithm auditing learning activities, and (b) examples of how youth engaged with each step during our pilot study.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑