arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2406.07796cs.HCcs.AI
收藏

在高等教育中利用生成式AI对抗“Botpoop”:一项关于检索增强生成聊天机器人对学习影响的研究

Battling Botpoop using GenAI for Higher Education: A Study of a Retrieval Augmented Generation Chatbots Impact on Learning

Nanyang Technological University(南洋理工大学)

Maung Thway, Jose Recatala-Gomez, Fun Siong Lim, Kedar Hippalgaonkar, Leonard W. T. Ng

AI总结:

本研究针对学生作答中低质量AI生成内容(Botpoop)泛滥的问题,开发了定制化RAG聊天机器人Professor Leodar并部署于高校,经混合方法验证97.1%参与者体验积极,为AI教育应用提供了基准。

摘要:

生成式人工智能(GenAI)和大语言模型(LLM)在为提升人类学习开辟新途径的同时,也导致学生作答中低质量信息(被称为Botpoop)的泛滥。本研究推出了Professor Leodar,这是一款定制化、使用新加坡式英语(Singlish)的检索增强生成(RAG)聊天机器人,旨在提升教育效果同时减少Botpoop。该机器人部署在新加坡南洋理工大学,可提供个性化指导、24/7全天候服务以及情境相关信息,让人们得以窥见AI辅助学习的未来。我们通过混合研究方法,考察了Professor Leodar对学习、参与度和备考情况的影响,其中97.1%的参与者报告了积极的使用体验。这些发现有助于明确AI在教育中的可能角色,凸显了定制化GenAI聊天机器人的潜力。我们将聊天机器人开发、课堂部署与效果研究相结合的方式,为GenAI教育工具提供了基准,也为重新定义AI与人类学习的相互作用奠定了基础。

英文摘要:

Generative artificial intelligence (GenAI) and large language models (LLMs) have simultaneously opened new avenues for enhancing human learning and increased the prevalence of poor-quality information in student response - termed Botpoop. This study introduces Professor Leodar, a custom-built, Singlish-speaking Retrieval Augmented Generation (RAG) chatbot designed to enhance educational while reducing Botpoop. Deployed at Nanyang Technological University, Singapore, Professor Leodar offers a glimpse into the future of AI-assisted learning, offering personalized guidance, 24/7 availability, and contextually relevant information. Through a mixed-methods approach, we examine the impact of Professor Leodar on learning, engagement, and exam preparedness, with 97.1% of participants reporting positive experiences. These findings help define possible roles of AI in education and highlight the potential of custom GenAI chatbots. Our combination of chatbot development, in-class deployment and outcomes study offers a benchmark for GenAI educational tools and is a stepping stone for redefining the interplay between AI and human learning.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑