arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2604.18538cs.HC
收藏

快速而易忘:关于新手在AI辅助和人机配对编程范式中表现、学习、工作负荷和情绪的受控研究

Fast and Forgettable: A Controlled Study of Novices' Performance, Learning, Workload, and Emotion in AI-Assisted and Human Pair Programming Paradigms

University of Virginia(弗吉尼亚大学);Abilene Christian University(阿比林基督教大学);Aalto University(阿尔托大学);University of Auckland(奥克兰大学)

Nicholas Gardella, James Prather, Juho Leinonen, Paul Denny, Raymond Pettit, Sara L. Riggs

AI总结:

本文通过22名参与者在20分钟内使用GitHub Copilot和人类搭档编写Python代码,探讨AI辅助与人类配对编程对表现、学习、工作负荷和情绪的影响,发现AI提升表现但降低情绪,建议重新审视配对编程作为教育工具。

摘要:

代码生成人工智能在过去几年内已在专业和教育编程领域中变得流行。尽管研究和教学开始应对这一变化,但计算学生却必须承担AI带来的未知后果,而缺乏关于其影响的实证证据。尽管学生之间的配对编程已被广泛研究,且已知对自我效能和学业成就有益,但其仍被低估,并进一步受到AI可以替代人类编程伙伴这一命题的威胁。本文呈现了一项受控的配对编程研究,22名参与者在20分钟内以两人小组和单独使用GitHub Copilot编写Python代码。他们通过奖金补偿平衡了表现与理解,并在一周的保留间隔后单独重新测试编程任务。收集了主观的工作负荷和情绪测量以及客观的表现和学习(重新测试表现)测量。结果显示,参与者在使用GitHub Copilot时比与人类队友表现显著更好,且几个工作负荷维度显著降低。然而,与Copilot工作相比,与人类队友工作在情绪上显著更积极和激动。此外,在AI条件下有非显著的绝对重新测试表现下降,在AI条件下有更大的重新测试表现下降。我们建议教育者应考虑重新审视配对编程作为教育工具,同时拥抱现代AI。

英文摘要:

Code-generating Artificial Intelligence has gained popularity within both professional and educational programming settings over the past several years. While research and pedagogy are beginning to cope with this change, computing students are left to bear the unforeseen consequences of AI amidst a dearth of empirical evidence about its effects. Though pair programming between students is well studied and known to be beneficial to self-efficacy and academic achievement, it remains underutilized and further threatened by the proposition that AI can replace a human programming partner. In this paper, we present a controlled pair programming study with 22 participants who wrote Python code under time pressure in teams of two and individually with GitHub Copilot for 20 minutes each. They were incentivized by bonus compensation to balance performance with understanding and were retested individually on the programming tasks after a retention interval of one week. Subjective measures of workload and emotion as well as objective measures of performance and learning (retest performance) were collected. Results showed that participants performed significantly better with GitHub Copilot than their human teammate, and several dimensions of their workload were significantly reduced. However, the emotional effect of the human teammate was significantly more positive and arousing as compared to working with Copilot. Furthermore, there was a nonsignificant absolute retest performance reduction in the AI condition and a larger retest performance decrement in the AI condition. We recommend that educators strongly consider revisiting pair programming as an educational tool in addition to embracing modern AI.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑