arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2408.07302cs.CYcs.CLcs.HC
收藏

提示工程干预对本科生人工智能自我效能、人工智能知识和提示工程能力的影响:一项混合方法研究

Effects of a Prompt Engineering Intervention on Undergraduate Students' AI Self-Efficacy, AI Knowledge and Prompt Engineering Ability: A Mixed Methods Study

Precious Blood Secondary School(宝血女子中学);The University of Hong Kong(香港大学)

David James Woo, Deliang Wang, Tim Yung, Kai Guo

AI总结:

本研究通过混合方法探讨提示工程干预对本科生人工智能自我效能、知识及能力的影响,发现干预显著提升学生在AI相关领域的技能和理解。

摘要:

提示工程对于有效与大型语言模型(如ChatGPT)交互至关重要。然而,努力教授这一技能给学生却受到限制。本研究设计并实施了一项提示工程干预,考察其对本科生人工智能自我效能、人工智能知识和创建有效提示能力的影响。干预涉及27名学生,他们在大学历史课程中参与了一个100分钟的研讨会。在研讨会中,学生被介绍提示工程策略,并将其应用于规划课程的期末论文任务。收集了多种数据源,包括学生在研讨会前后的问卷回答、研讨会前后的提示库以及书面反思。研究发现,学生由于干预,表现出更高的人工智能自我效能,对人工智能概念有更深入的理解,并提高了提示工程技能。这些发现对人工智能素养教育有启示作用,因为它们突显了提示工程培训对于特定高等教育使用案例的重要性。这与学生随意和直观地学习提示工程形成了显著差异。通过提示工程教育,教育者可以帮助学生更有效地导航和利用LLMs来支持他们的课程学习。

英文摘要:

Prompt engineering is critical for effective interaction with large language models (LLMs) such as ChatGPT. However, efforts to teach this skill to students have been limited. This study designed and implemented a prompt engineering intervention, examining its influence on undergraduate students' AI self-efficacy, AI knowledge, and proficiency in creating effective prompts. The intervention involved 27 students who participated in a 100-minute workshop conducted during their history course at a university in Hong Kong. During the workshop, students were introduced to prompt engineering strategies, which they applied to plan the course's final essay task. Multiple data sources were collected, including students' responses to pre- and post-workshop questionnaires, pre- and post-workshop prompt libraries, and written reflections. The study's findings revealed that students demonstrated a higher level of AI self-efficacy, an enhanced understanding of AI concepts, and improved prompt engineering skills because of the intervention. These findings have implications for AI literacy education, as they highlight the importance of prompt engineering training for specific higher education use cases. This is a significant shift from students haphazardly and intuitively learning to engineer prompts. Through prompt engineering education, educators can faciitate students' effective navigation and leverage of LLMs to support their coursework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑