简单的调查:受推荐系统启发的响应检索
Simple Surveys: Response Retrieval Inspired by Recommendation Systems
摘要:
在过去的十年中,使用简单的评级和比较调查在社交和数字媒体平台上激增,以推动推荐。这些简单的调查及其利用机器学习算法的推断揭示了用户对电影、歌曲和广告等大量且不断增长的项目的偏好。社会科学家在测量感知、偏好和意见方面有着悠久的历史,通常是在较小的、离散的项目集上进行详尽的评级或排名调查。本文介绍了社会科学应用的简单调查。我们使用四种类型的简单调查进行了实验,以比较个体和总体比较评估的预测准确性:在三种不同的情况下,在2,5和连续点量表上进行成对比较和评级:感知Google街景图像的安全性,艺术品的喜爱性和动物GIF的搞笑性。在不同的背景下,我们发现连续量表评分最能预测个人评估,但消耗的时间和认知努力最多。二元选择调查是快速的,并且在预测综合评估方面表现最好,这对集体决策任务很有用,但对个性化偏好的预测很差,Netflix目前使用它们来推荐电影。相比之下,成对比较在预测个人评估方面表现良好,但在预测总体评估方面表现不佳,尽管它被广泛用于众包思想和集体偏好。我们演示了如何从这些调查结果可以可视化在一个低维空间,揭示了不同的受访者在每种情况下提出的问题的解释。最后,我们反映稀疏,不完整的简单调查和他们的传统调查同行的效率,信息引出和环境中,知道更多的可能是至关重要的社会科学之间的差异。
英文摘要:
In the last decade, the use of simple rating and comparison surveys has proliferated on social and digital media platforms to fuel recommendations. These simple surveys and their extrapolation with machine learning algorithms shed light on user preferences over large and growing pools of items, such as movies, songs and ads. Social scientists have a long history of measuring perceptions, preferences and opinions, often over smaller, discrete item sets with exhaustive rating or ranking surveys. This paper introduces simple surveys for social science application. We ran experiments to compare the predictive accuracy of both individual and aggregate comparative assessments using four types of simple surveys: pairwise comparisons and ratings on 2, 5 and continuous point scales in three distinct contexts: perceived Safety of Google Streetview Images, Likeability of Artwork, and Hilarity of Animal GIFs. Across contexts, we find that continuous scale ratings best predict individual assessments but consume the most time and cognitive effort. Binary choice surveys are quick and perform best to predict aggregate assessments, useful for collective decision tasks, but poorly predict personalized preferences, for which they are currently used by Netflix to recommend movies. Pairwise comparisons, by contrast, perform well to predict personal assessments, but poorly predict aggregate assessments despite being widely used to crowdsource ideas and collective preferences. We demonstrate how findings from these surveys can be visualized in a low-dimensional space that reveals distinct respondent interpretations of questions asked in each context. We conclude by reflecting on differences between sparse, incomplete simple surveys and their traditional survey counterparts in terms of efficiency, information elicited and settings in which knowing less about more may be critical for social science.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。