相同表现,隐藏偏见:评估假设驱动和推荐驱动的人工智能
Same Performance, Hidden Bias: Evaluating Hypothesis- and Recommendation-Driven AI
AI总结:
本文通过网页实验比较推荐驱动与假设驱动交互设计,发现即使性能相同,推荐设计会降低用户证据阈值并引入隐藏偏见,影响判断分布。
摘要:
人机交互社区通常根据决策支持系统是否提升任务表现或促进适当用户依赖来评估系统。本文通过网页实验(N=290)比较推荐驱动和假设驱动交互设计,并利用信号检测理论框架,发现即使性能相同,推荐驱动设计会降低用户对充分证据的阈值,并在判断中引入“隐藏偏见”,导致错误分布偏移。此外,发现专家与新手同样易受这些系统性偏移影响。本文呼吁关注决策过程和稳定证据标准,而非仅依赖性能和依赖性。
英文摘要:
The HCI community commonly evaluates decision support systems based on whether they improve task performance or promote appropriate user reliance. In this work, we look beyond decision outcomes to examine the process through which users develop decision-making strategies. Through a web-based experiment (N = 290) comparing recommendation-driven and hypothesis-driven interaction designs, and using Signal Detection Theory as a theoretical framework, we show that even when performance remains identical, recommendation-driven designs lower participants' thresholds for sufficient evidence and introduce a "hidden bias" in their judgments, resulting in a shifted distribution of errors. Furthermore, we find that experts are just as susceptible to these systemic shifts as novices. We conclude by advocating for a shift in focus: prioritizing decision processes and the preservation of stable evidence standards over performance and reliance alone.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。