arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2602.09071cs.SEcs.AIcs.LG
收藏

DRAGON:用于非常大规模软件仓库集合的鲁棒分类

DRAGON: Robust Classification for Very Large Collections of Software Repositories

Univ. Bordeaux(波尔多大学);CNRS(法国国家科学研究中心);Bordeaux INP(波尔多国立理工学院);Institut Universitaire de France(法国大学研究院)

Stefano Balla, Stefano Zacchiroli, Thomas Degueule, Jean-Rémy Falleri, Romain Robbes

AI总结:

DRAGON通过利用版本控制系统中的轻量信号实现对大规模软件仓库的鲁棒分类,提升分类准确率并释放大规模开源数据集用于未来研究。

摘要:

自动按'主题'对源代码仓库进行分类的能力非常有用,尤其是在浏览或搜索大型软件集合时。然而,现有方法通常依赖README文件和其他元数据,这些文件经常缺失,限制了它们在真实大规模环境中的适用性。我们提出了DRAGON,一种专为非常大且多样化的软件集合设计的仓库分类器。它完全基于版本控制系统中常见的轻量信号运行:文件和目录名称,以及可选的README文件。在大规模仓库分类中,DRAGON将F1@5从54.8%提升到60.8%,超越了现有最佳水平。即使在README文件缺失的情况下,DRAGON的表现也仅下降6%。这种鲁棒性使其在文档稀少或不一致的现实环境中具有实用性。此外,许多剩余的分类错误属于'近似错误',即预测标签与正确主题在语义上接近。这一特性增加了在现实软件集合中预测的实际价值,因为在实际应用中,建议几个相关主题仍能指导搜索和发现。作为开发DRAGON的副产品,我们还发布了迄今为止最大的开源数据集用于仓库分类,包含825,000个仓库及其关联的真值主题,来源自Software Heritage档案,为未来大规模且语言无关的软件仓库理解研究提供了基础。

英文摘要:

The ability to automatically classify source code repositories with ''topics'' that reflect their content and purpose is very useful, especially when navigating or searching through large software collections. However, existing approaches often rely heavily on README files and other metadata, which are frequently missing, limiting their applicability in real-world large-scale settings. We present DRAGON, a repository classifier designed for very large and diverse software collections. It operates entirely on lightweight signals commonly stored in version control systems: file and directory names, and optionally the README when available. In repository classification at scale, DRAGON improves F1@5 from 54.8% to 60.8%, surpassing the state of the art. DRAGON remains effective even when README files are absent, with performance degrading by only 6% w.r.t. when they are present. This robustness makes it practical for real-world settings where documentation is sparse or inconsistent. Furthermore, many of the remaining classification errors are near misses, where predicted labels are semantically close to the correct topics. This property increases the practical value of the predictions in real-world software collections, where suggesting a few related topics can still guide search and discovery. As a byproduct of developing DRAGON, we also release the largest open dataset to date for repository classification, consisting of 825 thousand repositories with associated ground-truth topics, sourced from the Software Heritage archive, providing a foundation for future large-scale and language-agnostic research on software repository understanding.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑