arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2604.00239cs.CL
收藏

编程语言的分类:为代码生成提供分类

A Taxonomy of Programming Languages for Code Generation

George Mason University(乔治梅森大学);Rochester Institute of Technology(罗彻斯特理工学院)

Nishat Raihan, Christian Newman, Marcos Zampieri

AI总结:

本文提出首个可复现的编程语言资源分类,将646种语言分为四类,揭示资源分布的极端不均衡,为多语言大模型的评估提供框架。

摘要:

世界上超过7000种语言在自然语言处理(NLP)资源的可用性上差异极大,推动了系统性分类的努力。编程语言(PLs)同样存在资源差异,但尚未建立代码生成的资源层级分类。随着大型语言模型(LLMs)生成代码的能力增强,此类分类变得至关重要。为此,我们提出了首个可复现的PL资源分类,将646种语言分为四个层级。我们发现,仅1.9%的语言(第三级,高资源)占七个主要语料库中74.6%的token,而71.7%的语言(第0级,稀缺)仅贡献1.0%。对各层级内部不平等、分散度和分布偏斜的统计分析证实,这种不平衡既极端又系统。我们的结果为数据集编纂和多语言LLM的层级感知评估提供了原则性框架。

英文摘要:

The world's 7,000+ languages vary widely in the availability of resources for NLP, motivating efforts to systematically categorize them by their degree of resourcefulness (Joshi et al., 2020). A similar disparity exists among programming languages (PLs); however, no resource-tier taxonomy has been established for code. As large language models (LLMs) grow increasingly capable of generating code, such a taxonomy becomes essential. To fill this gap, we present the first reproducible PL resource classification, grouping 646 languages into four tiers. We show that only 1.9% of languages (Tier 3, High) account for 74.6% of all tokens in seven major corpora, while 71.7% of languages (Tier 0, Scarce) contribute just 1.0%. Statistical analyses of within-tier inequality, dispersion, and distributional skew confirm that this imbalance is both extreme and systematic. Our results provide a principled framework for dataset curation and tier-aware evaluation of multilingual LLMs.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑