arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2403.18679cs.SEcs.HC
收藏

高年级计算机专业学生在一学期项目中使用大型语言模型作为工具的探索性研究

An Exploratory Study on Upper-Level Computing Students' Use of Large Language Models as Tools in a Semester-Long Project

Ben Arie Tanay, Lexy Arinze, Siddhant S. Joshi, Kirsten A. Davis, James C. Davis

AI总结:

本研究探索高年级计算机专业学生在学期项目中使用LLM的情况,发现其使用覆盖技术与专业场景,学生认可LLM效率但担忧影响学习,建议研究低年级课程中LLM的合理融入方式。

摘要:

研究背景:ChatGPT、CoPilot等大型语言模型(LLM)正影响着软件工程实践,软件工程教育者必须教会未来的软件工程师如何用好这类工具。目前鲜有关于课堂中LLM使用情况的研究,因此评估学生对LLM的认知,以及调整计算机课程以适配这些转变范式的可行方式十分重要。研究目的:本研究旨在探索计算机专业学生在一学期的工程项目中使用LLM的体验与方式。研究设计/方法:我们从普渡大学的一门高年级软件工程课程中收集数据,该课程采用项目式学习(PBL)设计,学生在项目中使用ChatGPT、Copilot等LLM。我们对部分学生团队进行访谈,以了解两点:(1)他们如何在项目中使用LLM;(2)整个学期内他们对LLM的看法是否发生变化、如何变化。我们对数据进行分析,以识别与学生使用模式和学习成果相关的主题。研究结果/讨论:计算机专业学生在项目中使用LLM的场景既涵盖技术应用,也包括专业应用。此外,这些学生认为LLM是获取信息、完成任务的高效工具,但他们也担忧在不损害自身学习成果的前提下负责任地使用LLM的问题。基于研究结果,我们建议未来研究调查低年级计算机工程课程中LLM的使用情况,以明确LLM是否能、以及如何能作为学习辅助工具被整合进课程且不损害学习成果。

英文摘要:

Background: Large Language Models (LLMs) such as ChatGPT and CoPilot are influencing software engineering practice. Software engineering educators must teach future software engineers how to use such tools well. As of yet, there have been few studies that report on the use of LLMs in the classroom. It is, therefore, important to evaluate students' perception of LLMs and possible ways of adapting the computing curriculum to these shifting paradigms. Purpose: The purpose of this study is to explore computing students' experiences and approaches to using LLMs during a semester-long software engineering project. Design/Method: We collected data from a senior-level software engineering course at Purdue University. This course uses a project-based learning (PBL) design. The students used LLMs such as ChatGPT and Copilot in their projects. A sample of these student teams were interviewed to understand (1) how they used LLMs in their projects; and (2) whether and how their perspectives on LLMs changed over the course of the semester. We analyzed the data to identify themes related to students' usage patterns and learning outcomes. Results/Discussion: When computing students utilize LLMs within a project, their use cases cover both technical and professional applications. In addition, these students perceive LLMs to be efficient tools in obtaining information and completion of tasks. However, there were concerns about the responsible use of LLMs without being detrimental to their own learning outcomes. Based on our findings, we recommend future research to investigate the usage of LLM's in lower-level computer engineering courses to understand whether and how LLMs can be integrated as a learning aid without hurting the learning outcomes.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑