不仅仅是新奇感:关于AI工作流实用性与定制化的纵向研究
Not Just Novelty: A Longitudinal Study on Utility and Customization of an AI Workflow
AI总结:
通过与12名用户进行为期三周的纵向研究,发现生成式AI工作流的感知实用性在熟悉化阶段后因用户定制提示词而提升,证明其实用性不仅是新奇效应,并为未来生成式AI系统的挪用设计提供了启示。
摘要:
生成式AI为帮助人们处理日常任务带来了新颖且令人印象深刻的能力。通过将AI输出与人类交互串联起来,许多AI工作流能够解决现实且复杂的问题。尽管AI具有不可否认的吸引力,但在新奇感消退后,生成式AI工作流究竟有多实用仍不确定。此外,由生成式AI构建的工作流具有轻松定制以适应用户个人需求的潜力,但用户是否利用了这一点?我们与12名用户进行了一项为期三周的纵向研究,以了解生成式AI工具在科学传播中的熟悉化和定制化过程。我们的研究揭示存在一个熟悉化阶段,在此期间用户探索工作流的新功能,并发现他们觉得有用的方面。经过此阶段后,用户理解了工作流并能预测输出结果。令人惊讶的是,在熟悉化之后,系统的感知实用性评级高于之前,这表明AI的感知实用性不仅仅是新奇效应。收益的增加主要源于终端用户定制提示词的能力,从而有可能将系统挪用以满足自身需求。这指向了一个生成式AI系统能让我们为挪用而设计的未来。
英文摘要:
Generative AI brings novel and impressive abilities to help people in everyday tasks. There are many AI workflows that solve real and complex problems by chaining AI outputs together with human interaction. Although there is an undeniable lure of AI, it is uncertain how useful generative AI workflows are after the novelty wears off. Additionally, workflows built with generative AI have the potential to be easily customized to fit users' individual needs, but do users take advantage of this? We conducted a three-week longitudinal study with 12 users to understand the familiarization and customization of generative AI tools for science communication. Our study revealed that there exists a familiarization phase, during which users were exploring the novel capabilities of the workflow and discovering which aspects they found useful. After this phase, users understood the workflow and were able to anticipate the outputs. Surprisingly, after familiarization the perceived utility of the system was rated higher than before, indicating that the perceived utility of AI is not just a novelty effect. The increase in benefits mainly comes from end-users' ability to customize prompts, and thus potentially appropriate the system to their own needs. This points to a future where generative AI systems can allow us to design for appropriation.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。