arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2501.11935cs.HCcs.AI
收藏

用Google还是用ChatGPT?CS2课程学生信息收集方式与效果的比较研究

To Google or To ChatGPT? A Comparison of CS2 Students' Information Gathering Approaches and Outcomes

Indian Institute of Technology Kanpur(坎普尔印度理工学院);Microsoft(微软公司);Universidad Internacional de la Rioja(拉里奥哈国际大学);University of Houston(休斯顿大学)

Aayush Kumar, Daniel Prol, Amin Alipour, Sruti Srinivasa Ragavan

AI总结:

本研究通过受试者内混合方法实验,对比CS2学生用ChatGPT等大语言模型和Google搜索等传统在线方式学习编程的行为与效果,发现传统方法更利于学习难概念,且两类工具的查询策略存在差异。

摘要:

ChatGPT等大语言模型(LLM)已被高等教育阶段的学生广泛用作编程及相关概念的学习工具,但目前尚不清楚学生借助LLM学习的实际效果如何,以及会采用哪些策略。由于学生的在线自主学习经验大多来自使用Google等搜索引擎,在此语境下评估AI工具有助于填补这些研究空白。在这项混合方法研究中,我们开展了一项探索性的受试者内研究,旨在了解CS2课程的学生如何同时使用LLM以及教育网站、视频等传统在线方法学习编程概念,以考察学生在两种场景下及跨场景的学习方式。我们发现,学生认为用传统方法学习较难概念比用ChatGPT更容易。我们还发现,学生使用搜索引擎时提出的后续问题更少,且更多使用基于关键词的查询,而他们向LLM发送的提示往往是明确索要信息。

英文摘要:

LLMs such as ChatGPT have been widely adopted by students in higher education as tools for learning programming and related concepts. However, it remains unclear how effective students are and what strategies students use while learning with LLMs. Since the majority of students' experiences in online self-learning have come through using search engines such as Google, evaluating AI tools in this context can help us address these gaps. In this mixed methods research, we conducted an exploratory within-subjects study to understand how CS2 students learn programming concepts using both LLMs as well as traditional online methods such as educational websites and videos to examine how students approach learning within and across both scenarios. We discovered that students found it easier to learn a more difficult concept using traditional methods than using ChatGPT. We also found that students ask fewer follow-ups and use more keyword-based queries for search engines while their prompts to LLMs tend to explicitly ask for information.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑