arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2306.04538physics.ed-ph
收藏

ChatGPT与微软必应AI聊天在越南高中毕业考试物理试题中的表现评估

Evaluation of ChatGPT and Microsoft Bing AI Chat Performances on Physics Exams of Vietnamese National High School Graduation Examination

Dao Xuan-Quy, Le Ngoc-Bich, Phan Xuan-Dung, Ngo Bac-Bien, Vo The-Duy

AI总结:

本研究评估ChatGPT与BingChat在越南高中物理考试中的表现,发现两者均不及学生,且无法应对高应用层次问题,但可辅助教学提供即时反馈与个性化学习。

摘要:

本研究评估了基于语言模型的方法在物理教学中的前景与困难。研究评估了两种最先进的大语言模型(LLMs)——ChatGPT和BingChat——在回答2019年至2023年越南高中物理考试问题时的表现。当我们将LLMs的结果与越南学生的分数进行比较时,发现ChatGPT和BingChat的表现均不如越南学生,这证明LLMs尚不能完全替代人类在物理教学领域的智力。结果还显示,两种LLM均无法回答高应用层次的问题。在准确性方面,BingChat通常优于ChatGPT,但ChatGPT表现出更高的稳定性。我们的研究表明,LLMs可以在学习和教学活动中帮助学生和教师,特别是通过提供即时反馈和个性化学习体验。

英文摘要:

The promise and difficulties of language model-based approaches for physics teaching were assessed in this study. This study evaluates how well ChatGPT and BingChat, two state-of-the-art (SOTA) large language models (LLMs), perform when answering high school physics questions on Vietnamese exams from 2019 to 2023. When we compared the results of the LLMs with the scores of Vietnamese students, we discovered that ChatGPT and BingChat both perform worse than Vietnamese students, proving that LLMs are not yet capable of fully replacing human intellect in the field of physics teaching. The outcomes also showed that neither LLM is capable of responding to questions at the high application levels. In terms of accuracy, BingChat typically surpassed ChatGPT, although ChatGPT showed more stability. Our research suggests that LLMs can help students and teachers during learning and teaching activities, particularly by offering immediate feedback and individualized learning experiences.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑