儿童福利领域中超越预测算法的研究
Beyond Predictive Algorithms in Child Welfare
AI总结:
该研究针对儿童福利领域风险评估算法的偏差与局限性,通过对比实验和文本分析发现现有风险指标及个案笔记均无法准确预测未团聚儿童的离院结果,提出应转向利用叙述类语境信息研究公共社会技术系统。
摘要:
儿童福利(CW)领域的个案工作者使用基于风险评估(RA)数据构建的预测决策算法来指导和支持儿童福利决策。研究人员指出,风险评估可能包含有偏差的信号,会抹平儿童福利个案的复杂性,而纳入语境丰富的个案叙述(即个案工作者撰写的个案笔记)可能会让算法受益。为探究这一假设的改进效果,我们对美国某儿童福利机构常用的两种风险评估进行了定量解构。我们训练了分类器模型,对比了有无个案笔记叙述时风险评估的预测效度,并对个案笔记应用计算文本分析,以揭示个案笔记中未被发现的主题。研究发现,用于评估家庭并构建儿童福利系统预测风险模型(PRM)的常见风险指标,无法预测未与亲生父母团聚的儿童的离院结果。我们还发现,尽管个案笔记无法预测离院结果,但它们包含语境化的个案信号。鉴于风险评估分数和个案笔记均缺乏预测效度,我们提出公共部门算法应超越定量风险评估,转向利用叙述等语境信息源来研究公共社会技术系统。
英文摘要:
Caseworkers in the child welfare (CW) sector use predictive decision-making algorithms built on risk assessment (RA) data to guide and support CW decisions. Researchers have highlighted that RAs can contain biased signals which flatten CW case complexities and that the algorithms may benefit from incorporating contextually rich case narratives, i.e. - casenotes written by caseworkers. To investigate this hypothesized improvement, we quantitatively deconstructed two commonly used RAs from a United States CW agency. We trained classifier models to compare the predictive validity of RAs with and without casenote narratives and applied computational text analysis on casenotes to highlight topics uncovered in the casenotes. Our study finds that common risk metrics used to assess families and build CWS predictive risk models (PRMs) are unable to predict discharge outcomes for children who are not reunified with their birth parent(s). We also find that although casenotes cannot predict discharge outcomes, they contain contextual case signals. Given the lack of predictive validity of RA scores and casenotes, we propose moving beyond quantitative risk assessments for public sector algorithms and towards using contextual sources of information such as narratives to study public sociotechnical systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。