arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.05348cs.SEcs.HC
收藏

软件工程用户研究招募在Prolific上的经验报告

Software Engineering User Study Recruitment on Prolific: An Experience Report

Brittany Reid, Markus Wagner, Marcelo d'Amorim, Christoph Treude

摘要:

在线参与者招募平台,如Prolific,在研究中越来越受欢迎,因为它们使研究人员能够轻松访问大量的参与者。然而,参与者的质量可能是一个问题;参与者可能会提供不正确的信息以获得更多的研究,给结果增加不必要的噪音。本文详细介绍了我们从Prolific招募参与者进行Node.js编程技能用户研究的经验,旨在帮助其他研究人员进行类似的研究。我们探索了一种方法,招募程序员参与者使用预筛选验证,注意力检查和一系列的编程知识问题。我们收到了680份回复,并确定其中55份符合邀请参加我们用户研究的标准。我们最终通过视频通话与10名参与者进行了用户研究。最后,我们对研究人员提出了一系列建议。

英文摘要:

Online participant recruitment platforms such as Prolific have been gaining popularity in research, as they enable researchers to easily access large pools of participants. However, participant quality can be an issue; participants may give incorrect information to gain access to more studies, adding unwanted noise to results. This paper details our experience recruiting participants from Prolific for a user study requiring programming skills in Node.js, with the aim of helping other researchers conduct similar studies. We explore a method of recruiting programmer participants using prescreening validation, attention checks and a series of programming knowledge questions. We received 680 responses, and determined that 55 met the criteria to be invited to our user study. We ultimately conducted user study sessions via video calls with 10 participants. We conclude this paper with a series of recommendations for researchers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑