arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1610.04142cs.SEcs.HC
收藏

提高众包软件开发效率的决策支持

Decision Support for Increasing the Efficiency of Crowdsourced Software Development

Muhammad Rezaul Karim, David Messinger, Ye Yang, Guenther Ruhe

摘要:

众包软件开发(CSD)为大量值得信赖的软件工作者提供了一系列指定的任务。Topcoder是一个领先的CSD全过程管理平台。虽然越来越多地被接受为软件开发的现实选择,但对Topcoder的软件人群工作者行为的初步分析显示,82.9%的任务退出率令人担忧。此外,大量任务没有收到任何成功的提交。在本文中,我们报告了一种方法来提高CSD的效率。我们应用大量数据分析和机器学习来(i)对替代技术分析进行比较分析,以预测每个任务的赢家和输家的可能性,(ii)显著减少注册但不合适的任务中不成功的开发工作量,(iii)识别并排名每个任务最合格的注册工人,以及(iv)提供对获得任何成功提交的风险的任务的可靠预测。我们的研究结果和分析表明,随机森林(RF)为基础的预测技术进行最好的替代技术研究。应用RF,向工作人员推荐的任务可以在很大程度上减少非成功的开发工作量。平均而言,在30天的时间内,对于有经验的人来说,每个注册任务分别节省3.5和4.6个人日。没有经验的工人。对于工作者的任务相关推荐,我们可以准确地在排名最高的工作者中推荐至少1个实际获胜者,特别是每个任务的前2名推荐工作者中有94.07%的时间。最后,我们可以预测,超过80%的F-测量,任务可能不会得到任何提交,从而触发CSD平台或任务请求者的及时纠正措施。

英文摘要:

Crowdsourced software development (CSD) offers a series of specified tasks to a large crowd of trustworthy software workers. Topcoder is a leading platform to manage the whole process of CSD. While increasingly accepted as a realistic option for software development, preliminary analysis on Topcoder's software crowd worker behaviors reveals an alarming task-quitting rate of 82.9%. In addition, a substantial number of tasks do not receive any successful submission. In this paper, we report about a methodology to improve the efficiency of CSD. We apply massive data analytics and machine leaning to (i) perform comparative analysis on alternative technique analysis to predict likelihood of winners and quitters for each task, (ii) significantly reduce the amount of non-succeeding development effort in registered but inappropriate tasks, (iii) identify and rank the most qualified registered workers for each task, and (iv) provide reliable prediction of tasks risky to get any successful submission. Our results and analysis show that Random Forest (RF) based predictive technique performs best among the alternative techniques studied. Applying RF, the tasks recommended to workers can reduce the amount of non-succeeding development effort to a great extent. On average, over a period of 30 days, the savings are 3.5 and 4.6 person-days per registered tasks for experienced resp. unexperienced workers. For the task-related recommendations of workers, we can accurately recommend at least 1 actual winner in the top ranked workers, particularly 94.07% of the time among the top-2 recommended workers for each task. Finally, we can predict, with more than 80% F-measure, the tasks likely not getting any submission, thus triggering timely corrective actions from CSD platforms or task requesters.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑