arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2107.03487cs.HCcs.CY
收藏

以儿童福利为例建立公共部门高风险决策框架

A Framework of High-Stakes Algorithmic Decision-Making for the Public Sector Developed through a Case Study of Child-Welfare

Devansh Saxena, Karla Badillo-Urquiola, Pamela Wisniewski, Shion Guha

摘要:

算法已经渗透到整个公民政府和社会,在那里它们被用来做出关乎人类生命的高风险决策。在本文中,我们首先开发了一个有凝聚力的框架,算法决策适用于公共部门(ADMAPS),反映了复杂的社会技术之间的互动\textit{human discretion},\textit{bureaucratic processes},和\textit{algorithmic decision-making}通过合成不同的机构的工作领域的人机交互(HCI),科学和技术研究(STS),公共管理(PA)。然后,我们应用ADMAPS框架对一个儿童福利机构内日常使用的算法进行了深入的、为期八个月的人种学案例研究,该机构为美国中西部约900个家庭和1300名儿童提供服务。总的来说,我们发现有必要关注以社会生态框架为中心的基于实力的算法结果。此外,算法系统需要支持现有的官僚程序,增加人类的自由裁量权,而不是取代它。最后,算法系统的集体购买需要在实践者和官僚层面对目标结果的信任。作为我们的研究结果,我们提出了指导方针的设计高风险的算法决策工具,在儿童福利系统,更普遍的是,在公共部门。我们从经验上验证了理论推导的ADMAPS框架,以展示它如何有助于系统地为公共部门的算法设计做出务实的决策。

英文摘要:

Algorithms have permeated throughout civil government and society, where they are being used to make high-stakes decisions about human lives. In this paper, we first develop a cohesive framework of algorithmic decision-making adapted for the public sector (ADMAPS) that reflects the complex socio-technical interactions between \textit{human discretion}, \textit{bureaucratic processes}, and \textit{algorithmic decision-making} by synthesizing disparate bodies of work in the fields of Human-Computer Interaction (HCI), Science and Technology Studies (STS), and Public Administration (PA). We then applied the ADMAPS framework to conduct a qualitative analysis of an in-depth, eight-month ethnographic case study of the algorithms in daily use within a child-welfare agency that serves approximately 900 families and 1300 children in the mid-western United States. Overall, we found there is a need to focus on strength-based algorithmic outcomes centered in social ecological frameworks. In addition, algorithmic systems need to support existing bureaucratic processes and augment human discretion, rather than replace it. Finally, collective buy-in in algorithmic systems requires trust in the target outcomes at both the practitioner and bureaucratic levels. As a result of our study, we propose guidelines for the design of high-stakes algorithmic decision-making tools in the child-welfare system, and more generally, in the public sector. We empirically validate the theoretically derived ADMAPS framework to demonstrate how it can be useful for systematically making pragmatic decisions about the design of algorithms for the public sector.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑