arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.04543cs.HC
收藏

冒名顶替者就在我们中间:大型语言模型能否捕捉人类角色的复杂性?

The Impostor is Among Us: Can Large Language Models Capture the Complexity of Human Personas?

Christopher Lazik, Christopher Katins, Charlotte Kauter, Jonas Jakob, Caroline Jay, Lars Grunske, Thomas Kosch

AI总结:

本研究通过对比调查发现,用户认为LLM生成的角色比人类专家手工制作的角色信息更丰富、一致性更强,但更易遵循刻板印象,凸显了利用LLM创建角色时需加强多样性。

摘要:

大型语言模型(LLMs)为生成角色(personas)创造了新的机会,有望简化和加速以人为中心的设计过程。然而,AI生成的角色可能无法准确代表真实用户体验,因为它们可能遗漏对理解真实用户需求和行为至关重要的情境和情感洞察。这对质量构成了潜在威胁,尤其是对新手而言。本文考察了用户对LLM创建的角色与人类手工制作的角色在设计可信度方面的感知差异。我们收集了十个人类专家(HCI专家)根据相关工作中确立的相关属性开发的手工角色。然后,我们系统地用LLM生成了十个角色,并在调查中将其与手工角色进行比较。结果显示,参与者能够区分人类创建的角色和AI生成的角色,后者被认为信息更丰富且一致性更强。然而,参与者指出AI生成的角色倾向于遵循刻板印象,这凸显了在利用LLM进行角色创建时更加强调多样性的必要性。

英文摘要:

Large Language Models (LLMs) created new opportunities for generating personas, expected to streamline and accelerate the human-centered design process. Yet, AI-generated personas may not accurately represent actual user experiences, as they can miss contextual and emotional insights critical to understanding real users' needs and behaviors. This introduces a potential threat to quality, especially for novices. This paper examines the differences in how users perceive personas created by LLMs compared to those crafted by humans regarding their credibility for design. We gathered ten human-crafted personas developed by HCI experts according to relevant attributes established in related work. Then, we systematically generated ten personas with an LLM and compared them with human-crafted ones in a survey. The results showed that participants differentiated between human-created and AI-generated personas, with the latter perceived as more informative and consistent. However, participants noted that the AI-generated personas tended to follow stereotypes, highlighting the need for a greater emphasis on diversity when utilizing LLMs for persona creation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑