arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1602.03273cs.DC
收藏

YTrace:大型云和内容提供方的端到端性能诊断

YTrace: End-to-end Performance Diagnosis in Large Cloud and Content Providers

Partha Kanuparthy, Yuchen Dai, Sudhir Pathak, Sambit Samal, Theophilus Benson, Mojgan Ghasemi, P. P. S. Narayan

摘要:

内容提供方构建服务栈以向用户递送内容。内容提供方的重要目标是确保良好的用户体验,因为用户体验对收入有影响。在本文中,我们描述了雅虎的一个名为YTrace的系统,该系统几乎实时的诊断不良用户体验。我们提出了不同的组件YTrace的端到端的多层诊断(仪器,方法和后端系统),并在雅虎的所有用户会话近实时的提供诊断的系统架构。YTrace诊断跨服务和网络层的问题,在端到端的路径,跨越用户主机,互联网,CDN和网络中心,并有三个诊断目标:检测,定位和根本原因分析(包括级联问题)的性能问题,在用户与云会话。YTrace中方法的关键组成部分是捕获和发现因果关系,我们基于仪器API,领域知识和黑盒方法的混合设计。我们展示了三个案例研究,从生产跨越一个大规模的分布式存储系统,一个企业级网络,并在雅虎端到端的视频服务堆栈。最后,我们列出了云和内容提供方中性能诊断的一些开放方向。

英文摘要:

Content providers build serving stacks to deliver content to users. An important goal of a content provider is to ensure good user experience, since user experience has an impact on revenue. In this paper, we describe a system at Yahoo called YTrace that diagnoses bad user experience in near real time. We present the different components of YTrace for end-to-end multi-layer diagnosis (instrumentation, methods and backend system), and the system architecture for delivering diagnosis in near real time across all user sessions at Yahoo. YTrace diagnoses problems across service and network layers in the end-to-end path spanning user host, Internet, CDN and the datacenters, and has three diagnosis goals: detection, localization and root cause analysis (including cascading problems) of performance problems in user sessions with the cloud. The key component of the methods in YTrace is capturing and discovering causality, which we design based on a mix of instrumentation API, domain knowledge and blackbox methods. We show three case studies from production that span a large-scale distributed storage system, a datacenter-wide network, and an end-to-end video serving stack at Yahoo. We end by listing a number of open directions for performance diagnosis in cloud and content providers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑