arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2311.07786cs.SEcs.AIcs.LG
收藏

预测 Pull Request 中维护者和贡献者的首次响应延迟

Predicting the First Response Latency of Maintainers and Contributors in Pull Requests

Concordia University(康考迪亚大学);University of Calgary(卡尔加里大学)

SayedHassan Khatoonabadi, Ahmad Abdellatif, Diego Elias Costa, Emad Shihab

AI总结:

本文提出一种机器学习方法,利用从20个GitHub开源项目提取的21个特征,预测PR中维护者和贡献者的首次响应延迟,发现CatBoost模型效果最佳,并揭示了影响响应速度的关键因素。

摘要:

Pull Request (PR) 的成功取决于审查过程中维护者和贡献者的响应能力。了解预期等待时间可以带来更好的互动,并为维护者和贡献者管理期望。在本文中,我们提出了一种机器学习方法,用于预测维护者在提交 PR 后的首次响应延迟,以及贡献者在收到维护者首次响应后的首次响应延迟。我们整理了 GitHub 上 20 个大型且受欢迎的开源项目数据集,并提取了 21 个特征来表征项目、贡献者、PR 和审查过程。使用这些特征,我们评估了七种类型的分类器,以识别性能最佳的模型。我们还进行了置换特征重要性和 SHAP 分析,以了解不同特征的重要性和对预测响应延迟的影响。我们发现 CatBoost 模型在预测维护者和贡献者的首次响应延迟方面最为有效。我们还观察到,在一周较早时提交、包含平均数量的 commits 且描述简洁的 PR 更有可能从维护者那里获得更快的首次响应。类似地,维护者首次响应延迟较低、在一周较早时收到维护者首次响应且包含平均数量 commits 的 PR 倾向于从贡献者那里获得更快的首次响应。此外,接受率较高且在项目中有及时响应历史的贡献者可能获得并提供更快的首次响应。此外,我们展示了我们的方法在跨项目设置中的有效性。

英文摘要:

The success of a Pull Request (PR) depends on the responsiveness of the maintainers and the contributor during the review process. Being aware of the expected waiting times can lead to better interactions and managed expectations for both the maintainers and the contributor. In this paper, we propose a machine-learning approach to predict the first response latency of the maintainers following the submission of a PR, and the first response latency of the contributor after receiving the first response from the maintainers. We curate a dataset of 20 large and popular open-source projects on GitHub and extract 21 features to characterize projects, contributors, PRs, and review processes. Using these features, we then evaluate seven types of classifiers to identify the best-performing models. We also conduct permutation feature importance and SHAP analyses to understand the importance and the impact of different features on the predicted response latencies. We find that our CatBoost models are the most effective for predicting the first response latencies of both maintainers and contributors. We also observe that PRs submitted earlier in the week, containing an average number of commits, and with concise descriptions are more likely to receive faster first responses from the maintainers. Similarly, PRs with a lower first response latency from maintainers, that received the first response of maintainers earlier in the week, and containing an average number of commits tend to receive faster first responses from the contributors. Additionally, contributors with a higher acceptance rate and a history of timely responses in the project are likely to both obtain and provide faster first responses. Moreover, we show the effectiveness of our approach in a cross-project setting.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑