CARE:基于能力的人类-AI交互中生殖公平性测量框架
CARE: A Capability-Based Measurement Framework for Reproductive Equity in Human-AI Interaction
AI总结:
提出CARE框架,将能力结果作为评估单元,通过规范性设计视角和评估视角,揭示标准指标忽略的能力差异,应用于性生殖健康场景。
摘要:
算法系统中介了性生殖健康(SRH)信息的寻求。标准的人机交互和人工智能评估侧重于可用性、准确性和交互质量,这些指标旨在评估系统层面的任务性能和交互质量。我们引入了CARE,即生殖公平的能力方法,这是一个用于人类-AI交互的测量框架,它将能力结果作为任务性能之上的评估单元。CARE由两部分组成。规范性设计视角识别系统应支持的资源、转换因素、能力和功能。评估视角评估设计特征、交互模式和社会条件如何塑造能力结果、权衡以及使用中的生活体验。我们在12名参与者的研究中将CARE应用于SRH特定聊天机器人、通用大语言模型和搜索引擎功能,证明它揭示了标准指标聚合忽略的能力结果。相同的设计特征扩展了一些用户的能力,同时限制了其他用户:源级组织、响应格式、语气和SRH特定特征都塑造了哪些用户的能力得到扩展以及方向。参与者的专业背景、性别身份和先前AI熟悉程度进一步塑造了这些效应,产生了可用性和准确性指标(跨用户聚合)不会揭示的能力结果。这些发现证明了能力结果作为人类-AI交互评估的可测量单元,在任务性能之上扩展了现有指标的能力层。
英文摘要:
Algorithmic systems mediate sexual and reproductive health (SRH) information seeking. Standard HCI and AI evaluation centers usability, accuracy, and interaction quality, measures designed to assess task performance and interaction quality at the system level. We introduce CARE, the Capability Approach for Reproductive Equity, a measurement framework for human-AI interaction that adds capability outcomes as a unit of evaluation above task performance. CARE functions in two parts. The Normative Design Lens identifies the resources, conversion factors, capabilities, and functionings a system should support. The Evaluation lens assesses how design features, interaction patterns, and social conditions shape capability outcomes, tradeoffs, and lived experiences in use. We apply CARE to SRH-specific chatbots, general-purpose LLMs, and search engine features in a study with 12 participants, demonstrating that it surfaces capability outcomes standard metrics aggregate away. The same design features expanded capabilities for some users while constraining them for others: source-level organization, response format, tone, and SRH-specific features all shaped which capabilities expanded for which users and in which direction. Participants' professional backgrounds, gender identities, and prior AI familiarity further shaped these effects, producing capability outcomes that usability and accuracy metrics, aggregated across users, would not surface. These findings demonstrate capability outcomes as a measurable unit for human-AI interaction evaluation, extending existing metrics with a capability layer above task performance.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。