arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2501.02684cs.HCcs.SE
收藏

AI助手时代下解码开发者认知的探索

Towards Decoding Developer Cognition in the Age of AI Assistants

Ebtesam Al Haque, Chris Brown, Thomas D. LaToza, Brittany Johnson

AI总结:

本文提出结合EEG、眼动追踪与交互数据的受控观察研究,考察专业水平如何影响开发者使用AI助手的模式,以及该模式对实际认知负荷、任务时间和感知生产力的影响。

摘要:

背景:AI助手在编程中的采用日益增多,已催生大量探讨其收益的研究。尽管开发者持续报告这些工具带来显著的生产力提升,但实证测量往往显示出更为温和的改善。既往研究已经记录了开发者使用AI辅助编程工具的自我报告体验,但几乎没有工作去理解其使用模式以及实践中实际施加的认知负荷。目标:在这项探索性研究中,我们旨在调查AI助手在开发者生产力中所扮演的角色。具体而言,我们关注开发者的专业水平如何影响其AI使用模式,以及这些模式如何影响他们在开发任务中的实际认知负荷和生产力。我们还试图更好地理解这与他们所感知的生产力之间的关系。方法:我们提出一项受控观察研究,将生理测量(EEG和眼动追踪)与交互数据相结合,以考察开发者对AI辅助编程工具的使用。我们将招募专业开发者,在有和没有AI辅助的情况下分别完成编程任务,同时测量他们的认知负荷和任务完成时间。通过任务前和任务后问卷,我们将使用NASA-TLX收集关于感知生产力和认知负荷的数据。

英文摘要:

Background: The increasing adoption of AI assistants in programming has led to numerous studies exploring their benefits. While developers consistently report significant productivity gains from these tools, empirical measurements often show more modest improvements. While prior research has documented self-reported experiences with AI-assisted programming tools, little to no work has been done to understand their usage patterns and the actual cognitive load imposed in practice. Objective: In this exploratory study, we aim to investigate the role AI assistants play in developer productivity. Specifically, we are interested in how developers' expertise levels influence their AI usage patterns, and how these patterns impact their actual cognitive load and productivity during development tasks. We also seek to better understand how this relates to their perceived productivity. Method: We propose a controlled observational study combining physiological measurements (EEG and eye tracking) with interaction data to examine developers' use of AI-assisted programming tools. We will recruit professional developers to complete programming tasks both with and without AI assistance while measuring their cognitive load and task completion time. Through pre- and post-task questionnaires, we will collect data on perceived productivity and cognitive load using NASA-TLX.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑