arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2602.07283cs.HC
收藏

映射计算机使用代理的用户体验设计空间

Mapping the Design Space of User Experience for Computer Use Agents

Apple(苹果公司);Carnegie Mellon University(卡内基梅隆大学)

Ruijia Cheng, Jenny T. Liang, Eldon Schoop, Jeffrey Nichols

AI总结:

本文通过两阶段研究,提出了计算机使用代理用户体验设计的分类学,并通过实验证明了设计领域之间的联系及用户需求的多样性。

摘要:

基于大型语言模型(LLM)的计算机使用代理通过与可用的UI元素交互来执行用户命令,但人们对用户如何与这些代理交互或哪些设计因素影响其用户体验(UX)知之甚少。我们进行了一项两阶段研究,旨在映射计算机使用代理的UX设计空间。在第一阶段,我们回顾了现有系统以开发UX考虑的分类学,然后通过与八名UX和AI专业人士的访谈对其进行了细化。所得到的分类学包括诸如用户提示、可解释性、用户控制和用户心理模型等类别,以及相应的子类别和示例设计特征。在第二阶段,我们与20名参与者进行了Wizard-of-Oz研究,其中研究者充当基于网页的计算机使用代理,并在正常、易出错和高风险执行期间探测用户的反应。我们利用这些发现来验证第一阶段的分类学,并通过识别设计领域之间的联系以及用户需求和场景的差异来加深我们对设计空间的理解。我们的分类学和实证见解为开发人员提供了一张地图,以考虑计算机使用代理设计的不同方面,并将他们的设计置于用户多样的需求和场景中。

英文摘要:

Large language model (LLM)-based computer use agents execute user commands by interacting with available UI elements, but little is known about how users want to interact with these agents or what design factors matter for their user experience (UX). We conducted a two-phase study to map the UX design space for computer use agents. In Phase 1, we reviewed existing systems to develop a taxonomy of UX considerations, then refined it through interviews with eight UX and AI practitioners. The resulting taxonomy included categories such as user prompts, explainability, user control, and users' mental models, with corresponding subcategories and example design features. In Phase 2, we ran a Wizard-of-Oz study with 20 participants, where a researcher acted as a web-based computer use agent and probed user reactions during normal, error-prone and risky execution. We used the findings to validate the taxonomy from Phase 1 and deepen our understand of the design space by identifying the connections between design areas and divergence in user needs and scenarios. Our taxonomy and empirical insights provide a map for developers to consider different aspects of user experience in computer use agent design and to situate their designs within users' diverse needs and scenarios.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑