人与机器:软件工程师如何看待和参与AI辅助代码评审及其与同行评审的比较
Human and Machine: How Software Engineers Perceive and Engage with AI-Assisted Code Reviews Compared to Their Peers
AI总结:
该研究通过访谈20名软件工程师,对比分析了LLM辅助代码评审与人类同行评审在认知、情感和行为参与维度上的差异,揭示了LLM评审降低情绪调节需求但可能增加认知负荷,且其反馈采纳受信任和上下文缺失限制,为AI与人类在软件工程中的协作提供了见解。
摘要:
人工智能(AI)的整合持续增加并不断演进,包括在软件工程(SE)领域。这种整合涉及传统上由人类负责的过程,例如编码。然而,其对代码评审等社会技术过程的影响仍未得到充分探索。在这项基于访谈的研究(20名受访者)中,我们调查了软件工程师如何看待和参与大语言模型(LLM)辅助的代码评审,并与人类同行主导的评审进行比较。在这一本质上以人为中心的过程中,我们旨在理解软件工程师如何应对AI被引入协作工作流的情况。我们发现,代码评审中的参与是多维度的,涵盖认知、情感和行为维度。LLM辅助评审的引入影响了其中一些属性。例如,与同行打交道相比,与LLM打交道时对情绪调节和应对机制的需求较少。然而,由于LLM生成的反馈细节过多,处理这些反馈时的认知负荷有时会更高。软件工程师使用类似的感知过程来评估和采纳来自同行和LLM的反馈建议。然而,LLM反馈的采纳受到信任和评审中缺乏上下文的限制。我们的发现有助于更深入地理解AI工具如何影响软件工程中的社会技术过程,并为软件工程实践中AI与人类协作的未来提供了见解。
英文摘要:
The integration of artificial intelligence (AI) continues to increase and evolve, including in software engineering (SE). This integration involves processes traditionally entrusted to humans, such as coding. However, the impact on socio-technical processes like code review remains underexplored. In this interview-based study (20 interviewees), we investigate how software engineers perceive and engage with Large Language Model (LLM)-assisted code reviews compared to human peer-led reviews. In this inherently human-centric process, we aim to understand how software engineers navigate the introduction of AI into collaborative workflows. We found that engagement in code review is multi-dimensional, spanning cognitive, emotional, and behavioral dimensions. The introduction of LLM-assisted review impacts some of these attributes. For example, there is less need for emotional regulation and coping mechanisms when dealing with an LLM compared to peers. However, the cognitive load sometimes is higher in dealing with LLM-generated feedback due to its excessive details. Software engineers use a similar sense-making process to evaluate and adopt feedback suggestions from their peers and the LLM. However, the LLM feedback adoption is constrained by trust and lack of context in the review. Our findings contribute to a deeper understanding of how AI tools are impacting SE socio-technical processes and provide insights into the future of AI-human collaboration in SE practices.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。