arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.08733cs.SE
收藏

使用 GitHub Copilot 的实践与挑战:一项实证研究

Practices and Challenges of Using GitHub Copilot: An Empirical Study

Beiqi Zhang, Peng Liang, Xiyu Zhou, Aakash Ahmad, Muhammad Waseem

AI总结:

本研究通过分析 169 个 Stack Overflow 帖子与 655 个 GitHub 讨论,实证揭示 GitHub Copilot 的使用语言、IDE、技术、功能、收益与集成挑战。

摘要:

随着机器学习的进步,人们对用于自动补全源代码的 AI 工具越来越感兴趣。GitHub Copilot 也被称为“AI 结对程序员”,已在数十亿行开源 GitHub 代码上进行训练,并且是自 2021 年 6 月推出以来使用日益广泛的此类工具之一。然而,在理解使用 Copilot 借助自动补全源代码进行编程时的实践和挑战方面,投入的研究还很少。为此,我们开展了一项实证研究,收集并分析来自 Stack Overflow(SO)和 GitHub Discussions 的数据。更具体地说,我们搜索并手动收集了与 Copilot 使用相关的 169 个 SO 帖子和 655 个 GitHub 讨论。我们识别了与 Copilot 一起使用的编程语言、IDE、技术,所实现的功能,以及使用 Copilot 时的收益、局限和挑战。结果表明,当从业者使用 Copilot 时:(1)与 Copilot 一起使用的主要编程语言是 JavaScript 和 Python;(2)与 Copilot 一起使用的主要 IDE 是 Visual Studio Code;(3)与 Copilot 一起使用的最常见技术是 Node.js;(4)Copilot 实现的首要功能是数据处理;(5)使用 Copilot 的显著收益是有用的代码生成;(6)从业者在使用 Copilot 时遇到的主要局限是集成困难。我们的结果表明,使用 Copilot 就像一把双刃剑,这要求开发者在决定是否使用它时仔细考虑各个方面。我们的研究为未来研究 Copilot 作为 AI 结对程序员在软件开发中的作用提供了基于实证的基础和依据。

英文摘要:

With the advances in machine learning, there is a growing interest in AI-enabled tools for autocompleting source code. GitHub Copilot, also referred to as the "AI Pair Programmer", has been trained on billions of lines of open source GitHub code, and is one of such tools that has been increasingly used since its launch on June 2021. However, little effort has been devoted to understanding the practices and challenges of using Copilot in programming with auto-completed source code. To this end, we conducted an empirical study by collecting and analyzing the data from Stack Overflow (SO) and GitHub Discussions. More specifically, we searched and manually collected 169 SO posts and 655 GitHub discussions related to the usage of Copilot. We identified the programming languages, IDEs, technologies used with Copilot, functions implemented, benefits, limitations, and challenges when using Copilot. The results show that when practitioners use Copilot: (1) The major programming languages used with Copilot are JavaScript and Python, (2) the main IDE used with Copilot is Visual Studio Code, (3) the most common used technology with Copilot is Node.js, (4) the leading function implemented by Copilot is data processing, (5) the significant benefit of using Copilot is useful code generation, and (6) the main limitation encountered by practitioners when using Copilot is difficulty of integration. Our results suggest that using Copilot is like a double-edged sword, which requires developers to carefully consider various aspects when deciding whether or not to use it. Our study provides empirically grounded foundations and basis for future research on the role of Copilot as an AI pair programmer in software development.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑