arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2603.20114cs.CL
收藏

当前大型语言模型仍无法充分讨论语法模块:来自句法的证据

Current LLMs still cannot 'talk much' about grammar modules: Evidence from syntax

Ibb University(伊卜大学);Arab Open University(阿拉伯开放大学)

Mohammed Q. Shormani, Yehia A. AlSohbani

AI总结:

研究探讨了大型语言模型在句法核心属性上的表达能力,发现ChatGPT翻译准确率仅25%,提出需加强AI专家与语言学家合作以提升翻译准确性。

摘要:

我们旨在考察大型语言模型(LLMs)在句法模块上的表达能力,通过将句法核心属性翻译成阿拉伯语进行证据收集。我们收集了44个生成句法文献中的术语,并由人类和ChatGPT-5进行翻译。分析显示,仅25%的翻译准确,38.6%不准确,36.4%部分正确。基于此,提出需加强AI专家与语言学家合作以提升LLM的翻译准确性。

英文摘要:

We aim to examine the extent to which Large Language Models (LLMs) can 'talk much' about grammar modules, providing evidence from syntax core properties translated by ChatGPT into Arabic. We collected 44 terms from generative syntax previous works, including books and journal articles, as well as from our experience in the field. These terms were translated by humans, and then by ChatGPT-5. We then analyzed and compared both translations. We used an analytical and comparative approach in our analysis. Findings unveil that LLMs still cannot 'talk much' about the core syntax properties embedded in the terms under study involving several syntactic and semantic challenges: only 25% of ChatGPT translations were accurate, while 38.6% were inaccurate, and 36.4.% were partially correct, which we consider appropriate. Based on these findings, a set of actionable strategies were proposed, the most notable of which is a close collaboration between AI specialists and linguists to better LLMs' working mechanism for accurate or at least appropriate translation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑