arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2608.25202cs.SEcs.AI

SPECMINE:一个大规模的规范驱动开发制品语料库

SpecMine: A Large-Scale Corpus of Spec-Driven Development Artifacts

  • Carnegie Mellon University(卡内基梅隆大学)

机构由 AI 辅助整理,请以论文原文为准。

Shyam Agarwal, Anmol Singhal, Travis Breaux, Bogdan Vasilescu

AI总结:

SPECMINE是一个大规模语料库,通过两次普查收集公共GitHub仓库中的规范驱动开发制品,含大量文件、PR及引用数据,助力研究AI智能体时代软件的规范过程。

AI中文摘要:

规范驱动开发(Spec-Driven Development,SDD)是一种快速兴起的实践,其中开发者编写的结构化自然语言规范,或更常见的是由AI工具草拟后经开发者整理的规范,会驱动AI编码智能体的实现工作。自2025年以来,已涌现出大量相关工具(GitHub Spec Kit [3]、OpenSpec [4]、AWS Kiro [5]及数十种其他工具),但这些工具生成的制品从未被大规模研究过。我们推出SPECMINE,这一语料库通过两次普查捕获了公共GitHub仓库中的SDD情况:一次是针对该类URL文件的广泛普查,覆盖了大多数工具(来自17种命名工具的73030个仓库中的470795个文件);另一次是针对Kiro的普查,关注其独特的需求/设计/任务布局(来自12910个仓库中的98574个文件)。每个规范都附带完整的仓库元数据、完整的提交历史和解析后的文档结构。规范如何转化为代码本身仍是一个开放性问题,因此我们对11种工具的仓库中涉及规范且星标数至少为10的所有拉取请求(PR)进行了全面排查,共捕获了来自581个仓库的5992个此类PR及其变更集,这使得最简单的工作流(规范与实现在同一个PR中同步变更)可被直接观测到;此外,普查范围内的索引包含2421323个类型化引用(128万个指向代码文件、86.3万个指向同级文档、15.2万个指向PR、6.2万个指向引用、4.3万个指向分支、2.2万个指向问题),提供了从规范到代码的第二个独立链接。SPECMINE使社区首次能够研究AI智能体时代的软件规范方式。

英文摘要:

Spec-Driven Development (SDD) is a fast-emerging practice in which a structured natural-language specification, written by a developer, or (more often) drafted by an AI tool and then curated by the developer, drives an AI coding agent's implementation. A wave of tooling (GitHub Spec Kit [3], OpenSpec [4], AWS Kiro [5], and dozens of others) has appeared since 2025, yet the artifacts these tools produce have never been studied at scale. We present SpecMine, a corpus that captures SDD in public GitHub repositories through two censuses: a broad census of spec.md/specs.md files covering most tools (470,795 files across 73,030 repositories, attributed to 17 named tools), and a Kiro census of its distinct requirements/design/tasks layout (98,574 files across 12,910 repositories). Each spec is enriched with full repository metadata, complete commit history, and parsed document structure. How a spec becomes code is itself an open question, so for 11 tools we sweep every pull request that touches a spec in their repositories with at least ten stars, capturing 5,992 such PRs across 581 repositories with their changesets. That makes the simplest workflow, spec and implementation changing together in one PR, directly observable, and a census-wide index of 2,421,323 typed references (1.28M to code files, 863k to sibling documents, 152k to PRs, 62k refs, 43k branches, 22k issues) gives a second, independent link from spec to code. SpecMine lets the community study, for the first time, how software is specified in the age of AI agents.

↑