arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.22679cs.CYcs.AI
收藏

供应链依赖如何使AI招聘应用中的偏见测量和问责制归因复杂化

How Supply Chain Dependencies Complicate Bias Measurement and Accountability Attribution in AI Hiring Applications

Mila Quebec AI Institute(魁北克人工智能研究所)

Gauri Sharma, Maryam Molamohammadi

AI总结:

本文探讨了AI招聘系统中供应链依赖如何使偏见评估和问责制归因复杂化,指出组件交互导致偏见产生,且碎片化责任导致法律与技术层面的不透明。

摘要:

随着AI系统在招聘中的广泛应用,算法偏见和问责制问题引起关注,促使欧盟AI法案、纽约市本地法144和科罗拉多州AI法案等监管措施出台。尽管现有研究从技术和监管角度探讨偏见,但两者均忽略了关键挑战:现代AI招聘系统处于复杂的供应链中,责任分散于数据供应商、模型开发者、平台提供者和部署组织。本文研究这些依赖链如何使偏见评估和问责制归因复杂化。通过文献综述和监管分析,我们证明碎片化责任导致两个关键问题。首先,偏见源于组件交互而非孤立元素,但专有配置阻止了整合评估。一个简历解析器可能独立无偏见,但与特定排序算法和过滤阈值整合后可能产生歧视。其次,信息不对称意味着部署组织承担法律责任,但缺乏对供应商算法的技术可见性,而供应商控制实施却无实质性披露要求。每个利益相关者可能认为自己合规,但整合系统可能产生偏见结果。实施模糊性分析揭示了这些挑战。我们提出多层次干预,包括系统级审计、供应商指南、持续监控机制和依赖链中的文档记录。我们的发现表明,有效的治理需要协调技术、组织和监管领域的行为,以在分布式开发环境中建立有意义的问责制。

英文摘要:

The increasing adoption of AI systems in hiring has raised concerns about algorithmic bias and accountability, prompting regulatory responses including the EU AI Act, NYC Local Law 144, and Colorado's AI Act. While existing research examines bias through technical or regulatory lenses, both perspectives overlook a fundamental challenge: modern AI hiring systems operate within complex supply chains where responsibility fragments across data vendors, model developers, platform providers, and deploying organizations. This paper investigates how these dependency chains complicate bias evaluation and accountability attribution. Drawing on literature review and regulatory analysis, we demonstrate that fragmented responsibilities create two critical problems. First, bias emerges from component interactions rather than isolated elements, yet proprietary configurations prevent integrated evaluation. A resume parser may function without bias independently but contribute to discrimination when integrated with specific ranking algorithms and filtering thresholds. Second, information asymmetries mean deploying organizations bear legal responsibility without technical visibility into vendor-supplied algorithms, while vendors control implementations without meaningful disclosure requirements. Each stakeholder may believe they are compliant; nevertheless, the integrated system may produce biased outcomes. Analysis of implementation ambiguities reveals these challenges in practice. We propose multi-layered interventions including system-level audits, vendor guidelines, continuous monitoring mechanisms, and documentation across dependency chains. Our findings reveal that effective governance requires coordinated action across technical, organizational, and regulatory domains to establish meaningful accountability in distributed development environments.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑