利用LLM和RAG增强课堂教学
Enhancing classroom teaching with LLMs and RAG
AI总结:
本研究探索利用RAG流水线以课程材料为数据源辅助K-12教育,通过评估不同块大小和Reddit数据源,发现其答案正确率低,但方法可有效评估数据源,为教育资源评估提供启示。
摘要:
大型语言模型已成为我们日常查询的宝贵信息来源。然而,在训练之后,其数据源很快就会过时,这使得RAG成为提供更新或更相关数据的有用工具。在这项工作中,我们研究了以课程材料作为数据源的RAG流水线如何可能帮助K-12教育中的学生。初步研究利用Reddit作为最新网络安全信息的来源。评估了块大小以确定生成准确答案所需的最佳上下文量。在对不同块大小进行实验后,使用RAGAs评估了答案的正确性,任何块大小的平均答案正确率均未超过50%。这表明Reddit不是挖掘网络安全威胁问题数据的好来源。该方法在评估数据源方面是成功的,这对评估教育资源有效性具有启示意义。
英文摘要:
Large Language Models have become a valuable source of information for our daily inquiries. However, after training, its data source quickly becomes out-of-date, making RAG a useful tool for providing even more recent or pertinent data. In this work, we investigate how RAG pipelines, with the course materials serving as a data source, might help students in K-12 education. The initial research utilizes Reddit as a data source for up-to-date cybersecurity information. Chunk size is evaluated to determine the optimal amount of context needed to generate accurate answers. After running the experiment for different chunk sizes, answer correctness was evaluated using RAGAs with average answer correctness not exceeding 50 percent for any chunk size. This suggests that Reddit is not a good source to mine for data for questions about cybersecurity threats. The methodology was successful in evaluating the data source, which has implications for its use to evaluate educational resources for effectiveness.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。