建模假设与现实世界发生冲突:学生分配算法的透明度、公平性和社区挑战
Modeling Assumptions Clash with the Real World: Transparency, Equity, and Community Challenges for Student Assignment Algorithms
摘要:
在美国,越来越多的学区正在转向匹配算法来分配学生到公立学校。这些算法的设计者旨在促进过程中的透明度,公平和社区等价值。然而,学区在部署中遇到了实际挑战。事实上,旧金山联合学区投票决定停止使用并完全重新设计他们的学生分配算法,因为它在实践中没有促进教育公平。我们分析了这个系统,使用价值敏感的设计方法,并发现,在实践中不满足的价值观的一个原因是,该系统依赖于建模假设家庭的优先级,约束条件和目标,与现实世界的冲突。这些假设忽视了许多家庭面临的理想参与的复杂障碍,特别是由于社会经济不平等。我们认为,与利益相关者直接、持续的接触是将算法价值与现实世界条件相结合的核心。在这样做的时候,我们必须拓宽我们评估算法的方式,同时认识到纯算法解决方案在解决复杂社会政治问题方面的局限性。
英文摘要:
Across the United States, a growing number of school districts are turning to matching algorithms to assign students to public schools. The designers of these algorithms aimed to promote values such as transparency, equity, and community in the process. However, school districts have encountered practical challenges in their deployment. In fact, San Francisco Unified School District voted to stop using and completely redesign their student assignment algorithm because it was not promoting educational equity in practice. We analyze this system using a Value Sensitive Design approach and find that one reason values are not met in practice is that the system relies on modeling assumptions about families' priorities, constraints, and goals that clash with the real world. These assumptions overlook the complex barriers to ideal participation that many families face, particularly because of socioeconomic inequalities. We argue that direct, ongoing engagement with stakeholders is central to aligning algorithmic values with real world conditions. In doing so we must broaden how we evaluate algorithms while recognizing the limitations of purely algorithmic solutions in addressing complex socio-political problems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。