arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2407.09573cs.AIcs.LG
收藏

我们实现通用人工智能(AGI)了吗?对比ChatGPT、Claude与Gemini和人类读写能力及教育基准的表现

Have We Reached AGI? Comparing ChatGPT, Claude, and Gemini to Human Literacy and Education Benchmarks

Methodist University(卫理公会大学)

Mfon Akpan

AI总结:

该研究将ChatGPT、Claude、Gemini等大语言模型的教育基准表现与美国人平均受教育及读写水平对比,发现其在本科知识等任务上远超人类基准,凸显向AGI的进展,同时指出需更广泛认知评估及伦理研究。

摘要:

近期人工智能领域的进展,尤其是ChatGPT、Claude和Gemini这类大语言模型(LLM)的发展,引发了人们对其距离通用人工智能(AGI)还有多远的疑问。本研究利用美国人口普查局数据及技术报告,将大语言模型在教育基准上的表现与美国人的平均受教育程度和读写水平进行对比。结果显示,大语言模型在本科知识、高级阅读理解等任务上显著优于人类基准,表明其向AGI迈进取得了实质性进展。但真正的AGI需要更广泛的认知评估。本研究强调了相关进展对人工智能发展、教育和社会影响的启示,指出需持续开展研究并纳入伦理考量。

英文摘要:

Recent advancements in AI, particularly in large language models (LLMs) like ChatGPT, Claude, and Gemini, have prompted questions about their proximity to Artificial General Intelligence (AGI). This study compares LLM performance on educational benchmarks with Americans' average educational attainment and literacy levels, using data from the U.S. Census Bureau and technical reports. Results show that LLMs significantly outperform human benchmarks in tasks such as undergraduate knowledge and advanced reading comprehension, indicating substantial progress toward AGI. However, true AGI requires broader cognitive assessments. The study highlights the implications for AI development, education, and societal impact, emphasizing the need for ongoing research and ethical considerations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑