arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~

超越生产力:衡量开发者在生成式AI辅助软件开发中的认知负荷

Beyond Productivity: Measuring Developers' Cognitive Load During GenAI-Supported Software Development

Charlotte Brandebusemeyer, Daniela Gasser, Tobias Schimmer, Bert Arnrich

arXiv 2609.37645首次发表:更新:

发表机构

Hasso Plattner Institute, University of Potsdam; SAP Labs(波茨坦大学哈索·普拉特纳研究所; SAP实验室)

机构由 AI 辅助整理,请以论文原文为准。

AI 中文总结

本研究通过四天工业现场实验,发现GenAI使用和任务背景与开发者感知认知负荷相关,生理数据仅提供有限补充信息,建议结合工作背景评估认知负荷。

AI 中文摘要

生成式人工智能(GenAI)正在改变软件开发工作流程以及开发者的工作方式。行业对GenAI采用的评估通常关注生产力提升、使用情况和输出质量,但对实际采用者和驱动者——即软件开发者——的交互体验和认知负荷关注有限。理解GenAI是否改变或转移了开发者在日常开发中的认知需求,对于以开发者为中心的GenAI辅助软件开发评估至关重要。这可以帮助组织设计和评估有效的AI辅助工作流程。在本研究中,我们探讨了GenAI使用和任务背景如何与专业开发者的感知认知负荷相关联,以及可穿戴设备衍生的生理特征是否提供了超出该背景的额外信息。在SAP两个站点进行的为期四天的工业现场研究中,21名开发者在佩戴EmbracePlus腕带的同时,记录了他们的任务、任务持续时间、GenAI使用情况和感知认知负荷。结果表明,感知认知负荷与GenAI使用和任务背景均相关,而生理测量仅提供有限的额外信息。这些发现表明,在GenAI辅助的软件开发过程中,开发者的感知认知负荷应结合具体工作背景进行评估,可穿戴生理数据应作为补充信息而非独立信息使用。

英文摘要

Generative AI (GenAI) is changing software development workflows and how developers work. Industry evaluations of GenAI adoption often monitor productivity gains, usage, and output quality, but limited attention is paid to the interaction experience and cognitive load of the actual adopters and drivers of GenAI technology - the software developers. Understanding whether GenAI changes or shifts developers' cognitive demands during everyday development is important for a developer-centered evaluation of GenAI-supported software development. It can inform organizations in designing and evaluating effective AI-supported workflows. In this work, we study how GenAI use and task context relate to professional developers' perceived cognitive load and whether wearable-derived physiological characteristics provide additional information beyond this context. In a four-day industrial field study at two SAP sites, 21 developers documented their tasks, task duration, GenAI use, and perceived cognitive load while wearing an EmbracePlus wristband. The results show that perceived cognitive load is associated with both GenAI use and task context, while physiological measures provide only limited additional information. These findings suggest that developers' perceived cognitive load during GenAI-supported software development should be evaluated in relation to the concrete work context, with wearable physiological data used as complementary rather than standalone information.

论文原文

arXiv 摘要页 · PDF 原文 · HTML 原文

↑