arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2408.01462cs.CYcs.ETcs.LG
收藏

教师对RAG在计算机科学高等教育中潜力的看法

Faculty Perspectives on the Potential of RAG in Computer Science Higher Education

The University of Texas at Tyler(德克萨斯大学泰勒分校)

Sagnik Dakshit

AI总结:

本文面向计算机科学高等教育构建课程个性化RAG应用,并首次收集教师对其作为虚拟助教和教学辅助工具的反馈,揭示部署潜力、障碍及伦理保障需求。

摘要:

大型语言模型(LLM)的出现显著影响了自然语言处理领域,并因其在应用程序中的广泛集成和公开可访问性而改变了各个领域的对话任务。围绕LLM在教育中应用的讨论引发了伦理方面的担忧,尤其是关于抄袭和政策合规的问题。尽管LLM在对话任务中表现出色,但其可靠性局限和幻觉问题加剧了对对话进行护栏约束的需求,这促使我们研究RAG在计算机科学高等教育中的应用。我们为虚拟教学助理和教学辅助工具这两项任务开发了检索增强生成(Retrieval Augmented Generation,RAG)应用程序。在研究中,我们使用为每门课程定制的个性化RAG系统,收集了不同层次本科和研究生计算机科学大学课程中教师的评分与意见。本研究首次收集了教师对基于LLM的RAG在教育中应用的反馈。调查显示,虽然教师认可RAG系统作为虚拟教学助理和教学辅助工具的潜力,但也提出了全面部署所面临的若干障碍和应具备的功能。这些发现有助于推进关于在教育环境中整合先进语言模型的持续讨论,强调需要审慎考虑伦理影响,并制定适当的保障措施,以确保负责任且有效的实施。

英文摘要:

The emergence of Large Language Models (LLMs) has significantly impacted the field of Natural Language Processing and has transformed conversational tasks across various domains because of their widespread integration in applications and public access. The discussion surrounding the application of LLMs in education has raised ethical concerns, particularly concerning plagiarism and policy compliance. Despite the prowess of LLMs in conversational tasks, the limitations of reliability and hallucinations exacerbate the need to guardrail conversations, motivating our investigation of RAG in computer science higher education. We developed Retrieval Augmented Generation (RAG) applications for the two tasks of virtual teaching assistants and teaching aids. In our study, we collected the ratings and opinions of faculty members in undergraduate and graduate computer science university courses at various levels, using our personalized RAG systems for each course. This study is the first to gather faculty feedback on the application of LLM-based RAG in education. The investigation revealed that while faculty members acknowledge the potential of RAG systems as virtual teaching assistants and teaching aids, certain barriers and features are suggested for their full-scale deployment. These findings contribute to the ongoing discussion on the integration of advanced language models in educational settings, highlighting the need for careful consideration of ethical implications and the development of appropriate safeguards to ensure responsible and effective implementation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑