arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.12675cs.HC
收藏

Daily Turking:设计Mechanical Turk的纵向日常任务研究

Daily Turking: Designing Longitudinal Daily-task Studies on Mechanical Turk

Henry Turner, Simon Eberz, Ivan Martinovic

摘要:

在本文中,我们提出了我们的系统设计进行纵向日常任务的研究与相同的工人在整个亚马逊机械土耳其。我们实现了这个系统进行研究到触摸动态,并提出我们的经验,挑战和教训,这样做。研究参与者在他们的苹果iOS手机上安装了我们的应用程序,并在31天内每天完成两项任务。每项任务都涉及执行一系列滚动或滑动手势,从中提取移动速度或压力等行为信息。完成日常任务不需要与Mechanical Turk平台进行额外的互动,但可以通过该平台向员工支付报酬。这与员工习惯于在Amazon Mechanical Turk上快速完成一次性任务的典型情况有所不同。这种对平台的非典型使用促使我们评估研究期间与长期员工保留和参与相关的方面,特别是付款时间表(金额和结构随时间的变化)和提醒通知的影响。我们还调查了协调知情同意与工人快速完成任务的愿望的具体问题。我们发现,使用Mechanical Turk平台进行纵向日常任务研究是一种可行的方法,可以增强或取代传统的实验室研究。

英文摘要:

In this paper, we present our system design for conducting longitudinal daily-task studies with the same workers throughout on Amazon Mechanical Turk. We implement this system to conduct a study into touch dynamics, and present our experiences, challenges and lessons learned from doing so. Study participants installed our application on their Apple iOS phones and completed two tasks daily for 31 days. Each task involves performing a series of scrolling or swiping gestures, from which behavioral information such as movement speed or pressure is extracted. The completion of the daily tasks did not require extra interaction with the Mechanical Turk platform, yet paid workers through it. This differs somewhat from the typical rapid completion of one-off tasks that workers are used to on Amazon Mechanical Turk. This atypical use of the platform prompted us to evaluate aspects related to long-term worker retention and engagement over the study period, in particular the impacts of payment schedule (amount and structure over time) and reminder notifications. We also investigate the specific concern of reconciling informed consent with workers' desire to complete tasks quickly. We find that using the Mechanical Turk platform for conducting longitudinal daily task studies is a viable method to augment or replace traditional lab studies.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑