始终潜伏:了解和减轻在线人口贩运检测中的偏见
Always Lurking: Understanding and Mitigating Bias in Online Human Trafficking Detection
摘要:
近年来,基于网络的人口贩运活动有所增加,但仍然分散在护送广告中,并且由于其往往具有隐蔽性而难以识别。因此,使用智能系统侦查贩运活动可对调查资源分配和决策产生直接影响,并在更广泛的意义上有助于遏制这一普遍的社会问题。贩运检测涉及到为从网络上抓取的一组护送广告分配一个标准化的分数-分数越高,表明与贩运有关的(非自愿)活动的风险越大。在本文中,我们定义和研究贩运检测的问题,并提出了一个贩运检测管道体系结构,在DARPA Memex计划的研究开发了三年。利用在此期间收集的多机构数据、系统和经验,我们还进行了事后偏倚分析,并提出了偏倚缓解计划。我们的研究结果表明,虽然自动贩运检测是人工智能在社会公益方面的重要应用,但它也为部署预测性机器学习算法提供了警示性教训,而无需适当的去偏置。这最终导致了一个可解释的解决方案集成到一个搜索系统中,该系统包含超过1亿个广告,并被200多个执法机构用于调查线索。
英文摘要:
Web-based human trafficking activity has increased in recent years but it remains sparsely dispersed among escort advertisements and difficult to identify due to its often-latent nature. The use of intelligent systems to detect trafficking can thus have a direct impact on investigative resource allocation and decision-making, and, more broadly, help curb a widespread social problem. Trafficking detection involves assigning a normalized score to a set of escort advertisements crawled from the Web -- a higher score indicates a greater risk of trafficking-related (involuntary) activities. In this paper, we define and study the problem of trafficking detection and present a trafficking detection pipeline architecture developed over three years of research within the DARPA Memex program. Drawing on multi-institutional data, systems, and experiences collected during this time, we also conduct post hoc bias analyses and present a bias mitigation plan. Our findings show that, while automatic trafficking detection is an important application of AI for social good, it also provides cautionary lessons for deploying predictive machine learning algorithms without appropriate de-biasing. This ultimately led to integration of an interpretable solution into a search system that contains over 100 million advertisements and is used by over 200 law enforcement agencies to investigate leads.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。