ChatGPT 在数学推理与问题解决中有效性的研究：来自越南国家高中毕业考试的证据
Investigating the Effectiveness of ChatGPT in Mathematical Reasoning and Problem Solving: Evidence from the Vietnamese National High School Graduation Examination
AI总结：
本研究基于越南国家高中毕业考试250道数学题评估ChatGPT的推理能力，发现其在低难度题准确率达83%、高难度题仅10%，并指出其有教学潜力但处理图形和难题仍存不足。
摘要：
本研究对 ChatGPT 在越南国家高中毕业考试（VNHSGE）中回答不同主题和难度级别多项选择题的数学能力进行了完整分析。数据集包含 250 道题，分为四个级别：知识（K）、理解（C）、应用（A）和高级应用（H），并涵盖十个主题，涉及多种数学概念。结果表明，ChatGPT 的表现随难度级别和主题的不同而变化。它在知识（K）级别题目上表现最佳，准确率为 83%；但随着难度级别上升，其得分较差，准确率仅为 10%。研究还表明，ChatGPT 在指数函数与对数函数、等比数列和等差数列等主题的题目上取得了显著成功。研究发现，ChatGPT 在导数及其应用、空间几何和 Oxyz 空间微积分等主题上难以正确作答。此外，本研究将 ChatGPT 的结果与越南学生在 VNHSGE 及其他数学竞赛中的表现进行了对比。ChatGPT 在 SAT 数学竞赛中占优，成功率为 70%，其次是 VNHSGE 数学（58.8%）。然而，它在其他考试中的成功率较低，例如 AP Statistics、GRE Quantitative、AMC 10、AMC 12 和 AP Calculus BC。这些结果表明，ChatGPT 有潜力成为有效的数学教学工具，但仍需进一步工作以增强其处理图形数据的能力，并应对难度不断提高的题目所带来的挑战。
英文摘要：
This study offers a complete analysis of ChatGPT's mathematics abilities in responding to multiple-choice questions for the Vietnamese National High School Graduation Examination (VNHSGE) on a range of subjects and difficulty levels. The dataset included 250 questions divided into four levels: knowledge (K), comprehension (C), application (A), and high application (H), and it included ten themes that covered diverse mathematical concepts. The outcomes demonstrate that ChatGPT's performance varies depending on the difficulty level and subject. It performed best on questions at Level (K), with an accuracy rate of $83\%$; but, as the difficulty level rose, it scored poorly, with an accuracy rate of $10\%$. The study has also shown that ChatGPT significantly succeeds in providing responses to questions on subjects including exponential and logarithmic functions, geometric progression, and arithmetic progression. The study found that ChatGPT had difficulty correctly answering questions on topics including derivatives and applications, spatial geometry, and Oxyz spatial calculus. Additionally, this study contrasted ChatGPT outcomes with Vietnamese students in VNHSGE and in other math competitions. ChatGPT dominated in the SAT Math competition with a success rate of $70\%$, followed by VNHSGE mathematics ($58.8\%)$. However, its success rates were lower on other exams, such as AP Statistics, the GRE Quantitative, AMC 10, AMC 12, and AP Calculus BC. These results suggest that ChatGPT has the potential to be an effective teaching tool for mathematics, but more work is needed to enhance its handling of graphical data and address the challenges presented by questions that are getting more challenging.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
