arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1903.07032cs.HC
收藏

TurkScanner:预测微任务的小时工资

TurkScanner: Predicting the Hourly Wage of Microtasks

Susumu Saito, Chun-Wei Chiang, Saiph Savage, Teppei Nakano, Tetsunori Kobayashi, Jeffrey Bigham

摘要:

拥挤的市场里的工人们为谋生而挣扎。其中一个原因是,工人很难准确衡量微任务的小时工资,因此他们最终只能以很少的工资从事劳动。一般来说,工作人员提供的关于任务的信息很少,并且只能依赖于嘈杂的信号,例如任务的文本描述或请求者的评级。这项研究探讨了各种计算方法,用于预测工作时间(从而每小时工资)所需的任务的基础上收集的数据,从其他工人完成人群工作。我们提供以下贡献。(i)一种数据汇集方法,用于收集关于群体工作任务的真实训练数据以及工人完成任务所需的时间;(ii)TurkScanner:一种机器学习方法,可以预测完成任务所需的工作时间(因此可以隐含地提供预期的小时工资)。我们使用84名Amazon Mechanical Turk员工安装的Web浏览器扩展程序收集了9,155条数据记录,并探索了自动和询问员工准确记录工作时间的挑战。TurkScanner使用约150个衍生特征创建,能够在75%的误差内预测所有测试微任务中69.6%的时薪。未来研究的方向包括观察工具对人们工作实践的影响,使这种方法适应请求者工具以更好地设定价格,以及预测工作的其他要素(例如,接受可能性和工作者任务偏好)。

英文摘要:

Workers in crowd markets struggle to earn a living. One reason for this is that it is difficult for workers to accurately gauge the hourly wages of microtasks, and they consequently end up performing labor with little pay. In general, workers are provided with little information about tasks, and are left to rely on noisy signals, such as textual description of the task or rating of the requester. This study explores various computational methods for predicting the working times (and thus hourly wages) required for tasks based on data collected from other workers completing crowd work. We provide the following contributions. (i) A data collection method for gathering real-world training data on crowd-work tasks and the times required for workers to complete them; (ii) TurkScanner: a machine learning approach that predicts the necessary working time to complete a task (and can thus implicitly provide the expected hourly wage). We collected 9,155 data records using a web browser extension installed by 84 Amazon Mechanical Turk workers, and explored the challenge of accurately recording working times both automatically and by asking workers. TurkScanner was created using ~150 derived features, and was able to predict the hourly wages of 69.6% of all the tested microtasks within a 75% error. Directions for future research include observing the effects of tools on people's working practices, adapting this approach to a requester tool for better price setting, and predicting other elements of work (e.g., the acceptance likelihood and worker task preferences.)

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑