迈向衰减提案与源代码的关联:对Go仓库的探索性研究
Toward Linking Declined Proposals and Source Code: An Exploratory Study on the Go Repository
AI总结:
本研究首次尝试建立被拒绝的贡献与源代码之间的追溯性链接,通过LLM驱动的流水线实现了高准确率的链接生成,并分析了影响链接生成的因素。
摘要:
追溯性链接是软件开发者的重要信息来源,连接软件构件。这些链接在贡献构件与其相应源代码之间扮演着重要角色。通过这些链接,开发者可以追溯讨论内容,揭示设计理由、约束条件和安全问题。以往的研究主要考察了被接受的贡献,而被讨论后拒绝的贡献却被忽视了。被拒绝的贡献讨论捕捉了有价值的设计理由和隐含的决策标准,揭示了为什么特性被接受或拒绝。我们的先前工作也表明,开发者常常回顾并重新提交被拒绝的贡献,因此对它们的追溯性是有用的。在本研究中,我们首次尝试建立被拒绝的贡献与相关源代码之间的追溯性链接。我们提出了一种链接方法,并对生成的链接进行了实证分析,以讨论影响链接生成的因素。作为我们的数据集,我们使用了官方Go仓库中的提案,这些提案是用于提出新功能或语言变更的GitHub问题。为了将被拒绝的提案与源代码链接起来,我们设计了一个基于大语言模型(LLM)的流水线。我们的结果表明,该流水线为每个被拒绝的提案选择了正确的粒度,准确率为0.836,并在该粒度下生成了正确的链接,平均精确度为0.643。为了澄清链接被拒绝提案的挑战,我们对流水线未能生成链接的实例进行了失败分析。在这些情况下,讨论通常冗余且缺乏具体信息(例如,关于如何实现该功能的细节).
英文摘要:
Traceability links are key information sources for software developers, connecting software artifacts. Such links play an important role, particularly between contribution artifacts and their corresponding source code. Through these links, developers can trace the discussions in contributions and uncover design rationales, constraints, and security concerns. Previous studies have mainly examined accepted contributions, while those declined after discussion have been overlooked. Declined-contribution discussions capture valuable design rationale and implicit decision criteria, revealing why features are accepted or rejected. Our prior work also shows developers often revisit and resubmit declined contributions, making traceability to them useful. In this study, we present the first attempt to establish traceability links between declined contributions and related source code. We propose a linking approach and conduct an empirical analysis of the generated links to discuss the factors that affect link generation. As our dataset, we use proposals from the official Go repository, which are GitHub issues used to propose new features or language changes. To link declined proposals to source code, we design an LLM-driven pipeline. Our results show that the pipeline selected the correct granularity for each declined proposal with an accuracy of 0.836, and generated correct links at that granularity with a mean precision of 0.643. To clarify the challenges of linking declined proposals, we conduct a failure analysis of instances where the pipeline failed to generate links. In these cases, discussions were often redundant and lacked concrete information (e.g., details on how the feature should be implemented).
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。