我的结果现在有多普遍？在线隐私和安全调查的外部有效性
How Well Do My Results Generalize Now? The External Validity of Online Privacy and Security Surveys
摘要：
隐私和安全研究人员通常依赖于通过亚马逊土耳其机械（MTurk）和Prolific等在线众包平台收集的数据。之前的工作-使用2013年至2017年在美国收集的数据-发现MTurk关于安全和隐私的反应通常代表50岁以下或受过一定大学教育的人。然而，在过去的五年里，在线众包的格局发生了重大变化，随着多产作为一个主要平台的崛起和机器人的出现越来越多。这项工作试图复制有关在线隐私和安全调查的外部有效性的先前结果。我们对MTurk进行了在线调查（n=800），对多产进行了性别平衡调查（n=800），并对多产进行了代表性调查（n=800），并将其与皮尤研究中心进行的概率调查（n=4272）进行了比较。我们发现，MTurk的响应质量在过去五年中有所下降，我们的研究结果并没有复制早期发现的MTurk响应的普遍性。相比之下，我们发现通过Prolific收集的数据通常代表有关用户感知和体验的问题，但不代表有关安全和隐私知识的问题。我们还评估了多产设置，注意力检查问题和统计方法对在线调查外部有效性的影响，并就进行在线隐私和安全调查的最佳实践提出了建议。
英文摘要：
Privacy and security researchers often rely on data collected through online crowdsourcing platforms such as Amazon Mechanical Turk (MTurk) and Prolific. Prior work -- which used data collected in the United States between 2013 and 2017 -- found that MTurk responses regarding security and privacy were generally representative for people under 50 or with some college education. However, the landscape of online crowdsourcing has changed significantly over the last five years, with the rise of Prolific as a major platform and the increasing presence of bots. This work attempts to replicate the prior results about the external validity of online privacy and security surveys. We conduct an online survey on MTurk (n=800), a gender-balanced survey on Prolific (n=800), and a representative survey on Prolific (n=800) and compare the responses to a probabilistic survey conducted by the Pew Research Center (n=4272). We find that MTurk response quality has degraded over the last five years, and our results do not replicate the earlier finding about the generalizability of MTurk responses. By contrast, we find that data collected through Prolific is generally representative for questions about user perceptions and experiences, but not for questions about security and privacy knowledge. We also evaluate the impact of Prolific settings, attention check questions, and statistical methods on the external validity of online surveys, and we develop recommendations about best practices for conducting online privacy and security surveys.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
