PeaTMOSS：开源软件中预训练模型的数据集与初步分析
PeaTMOSS: A Dataset and Initial Analysis of Pre-Trained Models in Open-Source Software
AI总结：
针对预训练模型供应链研究缺乏结构化数据的问题，本文构建了包含28万余个预训练模型元数据及对应下游开源仓库映射的PeaTMOSS数据集，初步分析了供应链特征与许可证问题，为相关研究提供基础。
摘要：
深度学习模型的开发与训练成本日益高昂、过程愈发复杂。因此，软件工程师正将预训练模型（PTMs）应用于下游任务。目前，预训练模型供应链的动态机制在很大程度上仍未被探究，这表明学界迫切需要既能记录元数据、又能追踪这些模型后续应用情况的结构化数据集。缺乏这类数据，MSR（软件仓库挖掘）社区就无法全面理解预训练模型采用与复用带来的影响。\n本文提出PeaTMOSS数据集，该数据集包含281638个预训练模型的元数据，以及所有月下载量超过50次的预训练模型（共14296个）的详细快照，同时收录了GitHub上28575个使用这些模型的开源软件仓库。此外，数据集还包含44337条映射关系，覆盖15129个下游GitHub仓库与其所使用的2530个预训练模型的对应关联。为提升数据集的全面性，我们为大语言模型设计了提示词，用于自动提取模型元数据，包括模型的训练数据集、参数规模和评估指标。\n我们对该数据集的分析给出了预训练模型供应链的首批汇总统计数据，揭示了预训练模型的发展趋势以及预训练模型包文档存在的普遍缺陷。我们的示例应用还发现，预训练模型与其依赖项目之间存在软件许可证不一致的问题。PeaTMOSS为未来相关研究奠定了基础，为探究预训练模型供应链提供了丰富的研究方向。本文还概述了预训练模型挖掘、下游使用情况研究以及跨领域相关问题的研究机会。
英文摘要：
The development and training of deep learning models have become increasingly costly and complex. Consequently, software engineers are adopting pre-trained models (PTMs) for their downstream applications. The dynamics of the PTM supply chain remain largely unexplored, signaling a clear need for structured datasets that document not only the metadata but also the subsequent applications of these models. Without such data, the MSR community cannot comprehensively understand the impact of PTM adoption and reuse. This paper presents the PeaTMOSS dataset, which comprises metadata for 281,638 PTMs and detailed snapshots for all PTMs with over 50 monthly downloads (14,296 PTMs), along with 28,575 open-source software repositories from GitHub that utilize these models. Additionally, the dataset includes 44,337 mappings from 15,129 downstream GitHub repositories to the 2,530 PTMs they use. To enhance the dataset's comprehensiveness, we developed prompts for a large language model to automatically extract model metadata, including the model's training datasets, parameters, and evaluation metrics. Our analysis of this dataset provides the first summary statistics for the PTM supply chain, showing the trend of PTM development and common shortcomings of PTM package documentation. Our example application reveals inconsistencies in software licenses across PTMs and their dependent projects. PeaTMOSS lays the foundation for future research, offering rich opportunities to investigate the PTM supply chain. We outline mining opportunities on PTMs, their downstream usage, and cross-cutting questions.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
