EYEORG：众包Web体验质量测量平台
EYEORG: A Platform For Crowdsourcing Web Quality Of Experience Measurements
摘要：
巨大的努力已经投入到正在进行的战斗，使网页加载速度更快。这一努力最终产生了新的协议（QUIC，SPDY和HTTP/2）以及新颖的内容交付机制。此外，Google和SpeedCurve等公司研究了如何以捕捉人类感知的方式测量“页面加载时间”（PLT）。在本文中，我们提出了Eyeorg，众包网络体验测量质量的平台。Eyeorg克服了招募用户和收集一致的用户感知质量测量的扩展和自动化挑战。我们通过一组100名受信任的参与者来验证Eyeorg的功能。接下来，我们通过三个测量活动展示其功能，每个活动涉及1，000名付费参与者，以1）研究几个PLT指标的质量，2）比较HTTP/1.1和HTTP/2性能，3）评估在线广告和广告拦截器对用户体验的影响。我们发现，常用的，甚至新颖和复杂的PLT指标无法代表PLT的实际人类感知，HTTP/2的性能增益在某些情况下是不可感知的，并且并非所有的广告拦截器都是平等的。
英文摘要：
Tremendous effort has gone into the ongoing battle to make webpages load faster. This effort has culminated in new protocols (QUIC, SPDY, and HTTP/2) as well as novel content delivery mechanisms. In addition, companies like Google and SpeedCurve investigated how to measure "page load time" (PLT) in a way that captures human perception. In this paper we present Eyeorg, a platform for crowdsourcing web quality of experience measurements. Eyeorg overcomes the scaling and automation challenges of recruiting users and collecting consistent user-perceived quality measurements. We validate Eyeorg's capabilities via a set of 100 trusted participants. Next, we showcase its functionalities via three measurement campaigns, each involving 1,000 paid participants, to 1) study the quality of several PLT metrics, 2) compare HTTP/1.1 and HTTP/2 performance, and 3) assess the impact of online advertisements and ad blockers on user experience. We find that commonly used, and even novel and sophisticated PLT metrics fail to represent actual human perception of PLT, that the performance gains from HTTP/2 are imperceivable in some circumstances, and that not all ad blockers are created equal.
机构、总结、中文摘要均由AI分析而来，可能存在错误，请以论文正文为准。
