arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2308.04477cs.SEcs.AI

ChatGPT 3.5 在 10 种编程语言中代码生成的比较研究

A Comparative Study of Code Generation using ChatGPT 3.5 across 10 Programming Languages

Alessio Buscemi

AI总结:

本研究评估 ChatGPT 3.5 在 10 种编程语言和 4 个软件领域中的代码生成能力,识别其意外行为与局限,并探讨自动化代码生成对编程语言演进和技术行业的影响。

摘要:

大型语言模型(LLMs)是先进的人工智能(AI)系统,它们经过大规模数据集的广泛训练,以理解和生成与人类高度相似的语言。这些模型已达到一定的熟练程度,能够成功完成多个学科的大学考试,并生成可处理新问题的功能性代码。本研究调查了 ChatGPT 3.5 的编码能力,该模型是 OpenAI 于 2022 年 11 月发布的大型语言模型,因其出色的文本生成和代码创建能力而获得广泛认可。研究在 10 种不同编程语言和 4 个不同软件领域中评估了该模型生成代码片段的能力。基于本研究得出的发现,识别出了该模型的主要意外行为和局限性。本研究旨在确定潜在的发展方向,并考察自动化代码生成对编程语言演进以及技术行业的影响。

英文摘要:

Large Language Models (LLMs) are advanced Artificial Intelligence (AI) systems that have undergone extensive training using large datasets in order to understand and produce language that closely resembles that of humans. These models have reached a level of proficiency where they are capable of successfully completing university exams across several disciplines and generating functional code to handle novel problems. This research investigates the coding proficiency of ChatGPT 3.5, a LLM released by OpenAI in November 2022, which has gained significant recognition for its impressive text generating and code creation capabilities. The skill of the model in creating code snippets is evaluated across 10 various programming languages and 4 different software domains. Based on the findings derived from this research, major unexpected behaviors and limitations of the model have been identified. This study aims to identify potential areas for development and examine the ramifications of automated code generation on the evolution of programming languages and on the tech industry.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑