arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2505.00057cs.CL

关于 LLMs 评估高中问题的报告

A Report on the llms evaluating the high school questions

School of Environmental Science and Engineering, Guangdong University of Technology(广东工业大学环境科学与工程学院);School of Computer Science, Guangdong University of Technology(广东工业大学计算机学院)

Zhu Jiawei, Chen Wei

AI总结:

本报告评估了至少8个LLM API在解答2019-2023高考数学题上的表现,基于准确率、响应时间等指标发现其在逻辑推理和创造性解题方面仍有改进空间,为教育应用提供实证基础。

摘要:

本报告旨在评估大型语言模型(LLMs)在解答高中科学问题上的表现,并探索其在教育领域的潜在应用。随着 LLMs 在自然语言处理领域的快速发展,其在教育中的应用引起了广泛关注。本研究选取了高考(2019-2023)的数学考试题作为评估数据,并利用至少 8 个 LLM API 来提供答案。基于准确率、响应时间、逻辑推理和创造力等指标进行了综合评估。通过对评估结果的深入分析,本报告揭示了 LLMs 在处理高中科学问题时的优缺点,并讨论了其对教育实践的启示。研究结果表明,尽管 LLMs 在某些方面表现出色,但在逻辑推理和创造性问题解决方面仍有改进空间。本报告为 LLMs 在教育领域的进一步研究和应用提供了实证基础,并提出了改进建议。

英文摘要:

This report aims to evaluate the performance of large language models (LLMs) in solving high school science questions and to explore their potential applications in the educational field. With the rapid development of LLMs in the field of natural language processing, their application in education has attracted widespread attention. This study selected mathematics exam questions from the college entrance examinations (2019-2023) as evaluation data and utilized at least eight LLM APIs to provide answers. A comprehensive assessment was conducted based on metrics such as accuracy, response time, logical reasoning, and creativity. Through an in-depth analysis of the evaluation results, this report reveals the strengths and weaknesses of LLMs in handling high school science questions and discusses their implications for educational practice. The findings indicate that although LLMs perform excellently in certain aspects, there is still room for improvement in logical reasoning and creative problem-solving. This report provides an empirical foundation for further research and application of LLMs in the educational field and offers suggestions for improvement.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑