审视基于指数的风险评估:纽约市应对极端热浪事件决策的案例研究
Scrutinizing Index-Based Risk Assessments: A Case Study in NYC Decision-making for Heat Emergency Management
AI总结:
本文通过纽约市应对极端热浪事件的案例研究,探讨了基于指数的地理定向和决策方法在应急管理中的挑战,分析了指数模型在选择输入变量和空间尺度时对风险评分的影响,并提出了可推广的建议,以帮助公共部门技术人员在指数与预测算法之间做出权衡。
摘要:
城市越来越多地利用大规模数据分析和机器学习来做出重大决策。尽管算法公平性社区专注于分析这些复杂方法的风险和益处,但对许多更简单但仍然广泛使用的数据驱动工具的审视却较少。在本研究中,我们研究了用于地理定向和应急管理决策的人工指数——这一领域负责协调应对自然灾害和人为威胁的准备和响应工作。指数捕捉了抽象原则和总体优先事项(例如减少社会脆弱性),是低复杂度的统计聚合模型。它们通常灵活且可解释,但也可以对关键设计选择敏感,并需要强假设。通过纽约市应对极端热浪事件的案例研究,我们探讨了从业者在选择指数以应对准备和响应行动时面临的挑战。我们通过指数模拟的实证发现,将结果映射到测量文献中的有效性与可靠性问题,并通过敏感性分析显示,不同的合理输入变量或空间尺度选择会导致指数风险评分的实质性差异,从而影响下游政府决策。我们这些挑战与开发更紧密关联具体、可测量结果的预测算法的考虑进行了对比。最终,我们提供了可推广的建议,供从业者和公共部门技术专家在其他政府环境中权衡指数与预测算法之间的取舍。
英文摘要:
Cities are increasingly turning to large-scale data analysis and machine learning to make consequential decisions. While the algorithmic fairness community has focused on analyzing the risks and benefits associated with these complex methods, there has been much less scrutiny of the many simpler, but still widely used, data-driven tools that support government decision-making in a variety of settings. In this work, we study hand-crafted indices for geographic targeting and decision-making in emergency management -- a field responsible for coordinating preparedness and response efforts to hazards ranging from natural disasters to human threats. Indices, which capture abstract principles and overarching priorities (e.g., reducing social vulnerability), are low-complexity models that statistically aggregate chosen variables. They are generally flexible and interpretable, but can also be sensitive to key design choices and require strong assumptions. Through a case study of decision-making for extreme heat emergencies in NYC, we examine the challenges that practitioners may face in selecting an index for preparedness and response actions. We map empirical findings from index-based simulations to concerns related to validity and reliability from the measurement literature and show via sensitivity analyses that different reasonable choices of input variables or spatial scale can result in substantive differences to index risk scores, thereby affecting downstream government decision-making. We contrast these challenges with considerations for developing predictive algorithms that more narrowly relate to concrete, measurable outcomes. Ultimately, we provide generalizable recommendations that practitioners and public-sector technologists can use for navigating the trade-offs between indices and predictive algorithms in other government settings.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。