arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2110.05035cs.SEcs.AIcs.CLcs.LG
收藏

使用个性检测工具进行软件工程研究:我们能走多远?

Using Personality Detection Tools for Software Engineering Research: How Far Can We Go?

University of Bari(巴里大学)

Fabio Calefato, Filippo Lanubile

摘要:

评估软件工程师的个性可能有助于将个人特征与开发活动的特征相匹配,例如代码审查和测试,以及团队组成中的支持经理。然而,自我评估问卷并不是大规模收集多种意见的实际解决办法。相反,自动个性检测虽然克服了这些限制,但基于在非技术语料库上训练的现成解决方案,这可能不容易适用于软件工程(SE)等技术领域。在本文中,我们首先评估性能的通用人格检测工具时,应用到技术语料库的开发人员的电子邮件从Apache软件基金会的公共档案检索。我们观察到预测的准确性普遍较低,工具之间存在总体分歧。其次,我们复制了两个先前的研究,在SE取代的个性检测工具,用于推断开发人员的个性,从拉请求讨论和电子邮件。我们观察到原始结果未得到证实,即,改变原始研究中使用的工具会导致不同的结论。我们的研究结果表明,需要专门针对软件工程领域的个性检测工具。

英文摘要:

Assessing the personality of software engineers may help to match individual traits with the characteristics of development activities such as code review and testing, as well as support managers in team composition. However, self-assessment questionnaires are not a practical solution for collecting multiple observations on a large scale. Instead, automatic personality detection, while overcoming these limitations, is based on off-the-shelf solutions trained on non-technical corpora, which might not be readily applicable to technical domains like Software Engineering (SE). In this paper, we first assess the performance of general-purpose personality detection tools when applied to a technical corpus of developers' emails retrieved from the public archives of the Apache Software Foundation. We observe a general low accuracy of predictions and an overall disagreement among the tools. Second, we replicate two previous research studies in SE by replacing the personality detection tool used to infer developers' personalities from pull-request discussions and emails. We observe that the original results are not confirmed, i.e., changing the tool used in the original study leads to diverging conclusions. Our results suggest a need for personality detection tools specially targeted for the software engineering domain.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑