了解行业实践中用户自定义算法审计的实践、挑战和机遇
Understanding Practices, Challenges, and Opportunities for User-Engaged Algorithm Auditing in Industry Practice
摘要:
近年来,研究人员和从业人员对用户参与的算法审计方法越来越感兴趣,这种方法直接让用户参与检测算法系统中的问题行为。然而,我们对行业从业者目前在用户参与审计方面的做法和挑战知之甚少,也不知道他们在实践中有什么机会更好地利用这些方法。为了进行调查,我们与在工作中采用用户参与审计方法的从业人员进行了一系列访谈和迭代协同设计活动。我们的研究结果揭示了从业者在适当招募和激励用户审计员,脚手架用户审计以及从用户参与的审计报告中获得可操作的见解方面面临的几个挑战。此外,从业人员在用户参与审计方面遇到了共同的组织障碍,使从业人员和用户审计员之间的复杂关系浮出水面。基于这些发现,我们讨论了未来HCI研究的机会,以帮助实现潜在的(和减轻风险)的用户参与审计在行业实践中。
英文摘要:
Recent years have seen growing interest among both researchers and practitioners in user-engaged approaches to algorithm auditing, which directly engage users in detecting problematic behaviors in algorithmic systems. However, we know little about industry practitioners' current practices and challenges around user-engaged auditing, nor what opportunities exist for them to better leverage such approaches in practice. To investigate, we conducted a series of interviews and iterative co-design activities with practitioners who employ user-engaged auditing approaches in their work. Our findings reveal several challenges practitioners face in appropriately recruiting and incentivizing user auditors, scaffolding user audits, and deriving actionable insights from user-engaged audit reports. Furthermore, practitioners shared organizational obstacles to user-engaged auditing, surfacing a complex relationship between practitioners and user auditors. Based on these findings, we discuss opportunities for future HCI research to help realize the potential (and the mitigate risks) of user-engaged auditing in industry practice.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。