在多智能体配置中提升市售AI产品的性能
Improving Performance of Commercially Available AI Products in a Multi-Agent Configuration
AI总结:
本研究针对市售AI工具多智能体协同的实际案例较少的问题,测试了Crowdbotics PRD AI与GitHub Copilot的上下文共享,显著提升了代码建议能力和开发者任务成功率。
摘要:
近年来,随着大语言模型(LLMs)的快速发展,多智能体系统的实际应用能力日益增强。与此同时,软件开发行业涌现出多款新型AI驱动工具,用于优化软件开发生命周期(SDLC)。学术界已对多智能体系统在SDLC中的作用给予了大量关注。尽管单智能体系统在实际应用中已被频繁研究,但公开可用的商业工具在多智能体系统中协同工作并带来可衡量性能提升的实际案例仍相对较少。在本实验中,我们测试了Crowdbotics PRD AI(一款利用AI生成软件需求的工具)与GitHub Copilot(一款AI结对编程工具)之间的上下文共享机制。通过共享来自PRD AI的业务需求,我们将GitHub Copilot的代码建议能力提升了13.8%,开发者任务成功率提升了24.5%——这展示了一个市售AI系统协同工作以实现更优结果的实际案例。
英文摘要:
In recent years, with the rapid advancement of large language models (LLMs), multi-agent systems have become increasingly more capable of practical application. At the same time, the software development industry has had a number of new AI-powered tools developed that improve the software development lifecycle (SDLC). Academically, much attention has been paid to the role of multi-agent systems to the SDLC. And, while single-agent systems have frequently been examined in real-world applications, we have seen comparatively few real-world examples of publicly available commercial tools working together in a multi-agent system with measurable improvements. In this experiment we test context sharing between Crowdbotics PRD AI, a tool for generating software requirements using AI, and GitHub Copilot, an AI pair-programming tool. By sharing business requirements from PRD AI, we improve the code suggestion capabilities of GitHub Copilot by 13.8% and developer task success rate by 24.5% -- demonstrating a real-world example of commercially-available AI systems working together with improved outcomes.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。