革新本科学习:CourseGPT及其生成式AI进展
Revolutionizing Undergraduate Learning: CourseGPT and Its Generative AI Advancements
AI总结:
本文介绍了基于开源LLM的生成式AI工具CourseGPT,通过利用课程特定内容并允许教师控制回答,提升本科生学习体验;在CPR E 431课程试点中,Mixtral-8x7b模型达到88.0%正确率和66.6%忠实度,反馈显示其高度准确且有益。
摘要:
将生成式AI(GenAI)融入教育环境为提升学习体验带来了变革性潜力。本文介绍了CourseGPT,这是一种旨在支持教师并提升本科生教育体验的生成式AI工具。CourseGPT基于Mistral AI的开源大型语言模型(LLM)构建,提供持续的教师支持并定期更新课程材料,从而丰富学习环境。通过利用课程特定内容(如幻灯片、补充阅读材料和参考文献),CourseGPT能针对学生的提问提供精确、动态生成的回答。与通用AI模型不同,CourseGPT允许教师管理和控制回答,从而扩展课程范围而不会因细节过多而让学生感到负担。本文以CPR E 431《信息系统安全基础》课程作为试点,展示了CourseGPT的应用。该课程注册人数众多且课程内容多样,是测试CourseGPT的理想试验床。该工具旨在提升学习体验、加快反馈流程并简化行政任务。研究评估了CourseGPT对学生学习成果的影响,重点关注正确性得分、上下文召回率和回答的忠实度。结果表明,参数量更高的Mixtral-8x7b模型优于较小模型,达到了88.0%的正确性得分和66.6%的忠实度得分。此外,还收集了往届学生和助教关于CourseGPT准确性、有用性和整体表现的反馈。结果显示,绝大多数人认为CourseGPT在解决他们的问题方面高度准确且有益,许多人赞扬其提供及时和相关信息的能力。
英文摘要:
Integrating Generative AI (GenAI) into educational contexts presents a transformative potential for enhancing learning experiences. This paper introduces CourseGPT, a generative AI tool designed to support instructors and enhance the educational experiences of undergraduate students. Built on open-source Large Language Models (LLMs) from Mistral AI, CourseGPT offers continuous instructor support and regular updates to course materials, enriching the learning environment. By utilizing course-specific content, such as slide decks and supplementary readings and references, CourseGPT provides precise, dynamically generated responses to student inquiries. Unlike generic AI models, CourseGPT allows instructors to manage and control the responses, thus extending the course scope without overwhelming details. The paper demonstrates the application of CourseGPT using the CPR E 431 - Basics of Information System Security course as a pilot. This course, with its large enrollments and diverse curriculum, serves as an ideal testbed for CourseGPT. The tool aims to enhance the learning experience, accelerate feedback processes, and streamline administrative tasks. The study evaluates CourseGPT's impact on student outcomes, focusing on correctness scores, context recall, and faithfulness of responses. Results indicate that the Mixtral-8x7b model, with a higher parameter count, outperforms smaller models, achieving an 88.0% correctness score and a 66.6% faithfulness score. Additionally, feedback from former students and teaching assistants on CourseGPT's accuracy, helpfulness, and overall performance was collected. The outcomes revealed that a significant majority found CourseGPT to be highly accurate and beneficial in addressing their queries, with many praising its ability to provide timely and relevant information.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。