arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2403.08299cs.SEcs.AI
收藏

AutoDev:自动化AI驱动开发

AutoDev: Automated AI-Driven Development

Microsoft(微软)

Michele Tufano, Anisha Agarwal, Jinu Jang, Roshanak Zilouchian Moghaddam, Neel Sundaresan

AI总结:

AutoDev是一个全自动AI驱动软件开发框架,通过自主AI代理在Docker容器内执行复杂任务,在HumanEval上实现代码生成和测试生成Pass@1分别为91.5%和87.8%。

摘要:

软件开发领域随着AI辅助工具的出现,如GitHub Copilot,已经经历了范式转变。然而,现有解决方案并未充分利用IDE中可用的所有潜在能力,如构建、测试、执行代码、git操作等。因此,它们受限于有限的能力,主要聚焦于在基于聊天的界面中建议代码片段和文件操作。为填补这一空白,我们提出了AutoDev,一个全自动的AI驱动软件开发框架,专为自主规划和执行复杂软件工程任务而设计。AutoDev允许用户定义复杂的软件工程目标,这些目标被分配给AutoDev的自主AI代理去实现。这些AI代理可以对代码库执行多种操作,包括文件编辑、检索、构建过程、执行、测试和git操作。它们还能访问文件、编译器输出、构建和测试日志、静态分析工具等。这使得AI代理能够以完全自动化的方式执行任务,并全面理解所需的上下文信息。此外,AutoDev通过将所有操作限制在Docker容器内,建立了一个安全的开发环境。该框架包含了保障措施,以确保用户隐私和文件安全,允许用户在AutoDev内定义特定允许或限制的命令和操作。在我们的评估中,我们在HumanEval数据集上测试了AutoDev,在代码生成和测试生成方面分别获得了91.5%和87.8%的Pass@1,取得了令人鼓舞的结果,证明了其在自动化软件工程任务方面的有效性,同时维护了一个安全且用户可控的开发环境。

英文摘要:

The landscape of software development has witnessed a paradigm shift with the advent of AI-powered assistants, exemplified by GitHub Copilot. However, existing solutions are not leveraging all the potential capabilities available in an IDE such as building, testing, executing code, git operations, etc. Therefore, they are constrained by their limited capabilities, primarily focusing on suggesting code snippets and file manipulation within a chat-based interface. To fill this gap, we present AutoDev, a fully automated AI-driven software development framework, designed for autonomous planning and execution of intricate software engineering tasks. AutoDev enables users to define complex software engineering objectives, which are assigned to AutoDev's autonomous AI Agents to achieve. These AI agents can perform diverse operations on a codebase, including file editing, retrieval, build processes, execution, testing, and git operations. They also have access to files, compiler output, build and testing logs, static analysis tools, and more. This enables the AI Agents to execute tasks in a fully automated manner with a comprehensive understanding of the contextual information required. Furthermore, AutoDev establishes a secure development environment by confining all operations within Docker containers. This framework incorporates guardrails to ensure user privacy and file security, allowing users to define specific permitted or restricted commands and operations within AutoDev. In our evaluation, we tested AutoDev on the HumanEval dataset, obtaining promising results with 91.5% and 87.8% of Pass@1 for code generation and test generation respectively, demonstrating its effectiveness in automating software engineering tasks while maintaining a secure and user-controlled development environment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑