保持设计师在循环中:在多个目标中传达固有的设计权衡
Keeping Designers in the Loop: Communicating Inherent Algorithmic Trade-offs Across Multiple Objectives
摘要:
人工智能算法已被用于增强各种各样的产品和服务,包括在高风险环境中协助人类决策。然而,这些算法是复杂的,并有权衡,特别是预测精度和公平的人口分组之间。这使得设计师很难理解算法,并以尊重用户目标、价值观和需求的方式设计产品或服务。我们提出了一种方法来帮助设计者和用户探索算法,可视化他们的权衡,并选择与他们的目标和需求一致的权衡算法。我们通过(i)大规模的亚马逊土耳其机器人实验,以及(ii)与领域专家的深入访谈,评估了我们在预测刑事被告再次犯罪可能性问题上的方法。我们的评估表明,我们的方法可以帮助这些系统的设计者和用户更好地理解和导航算法权衡。本文提供了一种新的方式,为设计人员提供理解和控制他们正在创建的算法系统的结果的能力。
英文摘要:
Artificial intelligence algorithms have been used to enhance a wide variety of products and services, including assisting human decision making in high-stakes contexts. However, these algorithms are complex and have trade-offs, notably between prediction accuracy and fairness to population subgroups. This makes it hard for designers to understand algorithms and design products or services in a way that respects users' goals, values, and needs. We proposed a method to help designers and users explore algorithms, visualize their trade-offs, and select algorithms with trade-offs consistent with their goals and needs. We evaluated our method on the problem of predicting criminal defendants' likelihood to re-offend through (i) a large-scale Amazon Mechanical Turk experiment, and (ii) in-depth interviews with domain experts. Our evaluations show that our method can help designers and users of these systems better understand and navigate algorithmic trade-offs. This paper contributes a new way of providing designers the ability to understand and control the outcomes of algorithmic systems they are creating.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。