arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2310.05686cs.CLcs.AI
收藏

大语言模型提升概率学习的潜力:针对ChatGPT3.5与计算机工程大一学生的研究

The potential of large language models for improving probability learning: A study on ChatGPT3.5 and first-year computer engineering students

Rey Juan Carlos University(胡安·卡洛斯国王大学);European Commission, Joint Research Centre(欧盟委员会联合研究中心);CETINIA: Research Centre for Intelligent Information Technologies(CETINIA智能信息技术研究中心)

Angel Udias, Antonio Alonso-Ayuso, Ignacio Sanchez, Sonia Hernandez, Maria Eugenia Castellanos, Raquel Montes Diez, Emilio Lopez Cano

AI总结:

该研究评估ChatGPT解答计算机工程入门概率题的效能,发现其推理表达优于平均水平学生但数值运算有缺陷,用R脚本输出解答可弥补不足,证明大语言模型有潜力作为概率学习助手。

摘要:

本文评估了大语言模型ChatGPT(2023年2月版本)在解答计算机工程入门考试中常见概率题方面的效能。我们的研究采用了23道概率练习题,这些题目曾用于马德里雷伊·胡安·卡洛斯大学(URJC)的学生测试。由5名统计学教授组成的小组对ChatGPT生成的回答进行评估,采用与评判学生答卷相同的标准开展定性评价并打分。结果显示,ChatGPT在措辞表达、内容组织和逻辑推理方面的表现优于平均水平的学生。该模型在解答西班牙语和英语版本的习题时表现保持一致。不过,ChatGPT在执行基础数值运算时存在困难。我们的实验表明,要求ChatGPT以R脚本的形式给出解答是克服这些局限的有效方法。综上,研究结果表明,在解答计算机工程入门考试中常见的概率题方面,ChatGPT的表现优于平均水平的学生。尽管如此,该模型在对某些概率概念进行推理时仍存在局限。该模型能够提供高质量的讲解、用任意编程语言演示解题过程,结合其解答概率习题的表现,说明大语言模型具备充当学习助手的潜力。

英文摘要:

In this paper, we assess the efficacy of ChatGPT (version Feb 2023), a large-scale language model, in solving probability problems typically presented in introductory computer engineering exams. Our study comprised a set of 23 probability exercises administered to students at Rey Juan Carlos University (URJC) in Madrid. The responses produced by ChatGPT were evaluated by a group of five statistics professors, who assessed them qualitatively and assigned grades based on the same criteria used for students. Our results indicate that ChatGPT surpasses the average student in terms of phrasing, organization, and logical reasoning. The model's performance remained consistent for both the Spanish and English versions of the exercises. However, ChatGPT encountered difficulties in executing basic numerical operations. Our experiments demonstrate that requesting ChatGPT to provide the solution in the form of an R script proved to be an effective approach for overcoming these limitations. In summary, our results indicate that ChatGPT surpasses the average student in solving probability problems commonly presented in introductory computer engineering exams. Nonetheless, the model exhibits limitations in reasoning around certain probability concepts. The model's ability to deliver high-quality explanations and illustrate solutions in any programming language, coupled with its performance in solving probability exercises, suggests that large language models have the potential to serve as learning assistants.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑