当羊店:测量羊群效应的产品评级与自然实验
When Sheep Shop: Measuring Herding Effects in Product Ratings with Natural Experiments
摘要:
随着在线购物变得越来越普遍,客户越来越依赖于产品评级网站来做出购买决定。然而,在线评级的可靠性可能会受到所谓的羊群效应的影响:在对产品进行评级时,客户可能会有偏见地跟随其他客户对同一产品的先前评级。这是有问题的,因为它通过偶然的早期评级扭曲了长期客户的看法。对放牧的研究提出了方法上的挑战。特别是,观察性研究受到缺乏反事实的阻碍:简单地将早期与随后的评级相关联是不够的,因为我们无法知道如果第一次评级不同,随后的评级会是什么样子。这里介绍的方法利用了一个接近实验的设置,尽管它是纯粹的观察-一个自然实验。我们的主要方法包括在两个不同的评级网站上研究同一产品,重点关注在一个网站上获得高第一评级的产品,另一个网站上获得低第一评级的产品。这在很大程度上控制了产品的内在质量、广告和生产商身份等混淆因素,并使我们能够隔离第一次评级对后续评级的影响。在一个案例研究中,我们专注于啤酒作为产品,并共同研究两个啤酒评级网站,但我们的方法适用于任何一对网站,其中产品可以匹配。我们在啤酒评级中发现了羊群效应的明显证据。例如,如果啤酒获得非常高的第一评级,则与相同啤酒获得非常低的第一评级的情况相比,其第二评级平均高出标准差的一半。此外,羊群效应往往会持续很长时间,甚至在20个或更多的评级后也很明显。我们的研究结果具有重要意义的设计更好的评级系统。
英文摘要:
As online shopping becomes ever more prevalent, customers rely increasingly on product rating websites for making purchase decisions. The reliability of online ratings, however, is potentially compromised by the so-called herding effect: when rating a product, customers may be biased to follow other customers' previous ratings of the same product. This is problematic because it skews long-term customer perception through haphazard early ratings. The study of herding poses methodological challenges. In particular, observational studies are impeded by the lack of counterfactuals: simply correlating early with subsequent ratings is insufficient because we cannot know what the subsequent ratings would have looked like had the first ratings been different. The methodology introduced here exploits a setting that comes close to an experiment, although it is purely observational---a natural experiment. Our key methodological device consists in studying the same product on two separate rating sites, focusing on products that received a high first rating on one site, and a low first rating on the other. This largely controls for confounds such as a product's inherent quality, advertising, and producer identity, and lets us isolate the effect of the first rating on subsequent ratings. In a case study, we focus on beers as products and jointly study two beer rating sites, but our method applies to any pair of sites across which products can be matched. We find clear evidence of herding in beer ratings. For instance, if a beer receives a very high first rating, its second rating is on average half a standard deviation higher, compared to a situation where the identical beer receives a very low first rating. Moreover, herding effects tend to last a long time and are noticeable even after 20 or more ratings. Our results have important implications for the design of better rating systems.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。