arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 1006.5059cs.IR
收藏

垂直搜索引擎的容量规划

Capacity Planning for Vertical Search Engines

Claudine Badue, Jussara Almeida, Virgilio Almeida, Ricardo Baeza-Yates, Berthier Ribeiro-Neto, Artur Ziviani, Nivio Ziviani

摘要:

垂直搜索引擎专注于特定的内容片段,例如单个国家的Web或大公司的文档集合。尽管如此,像一般的开放网络搜索引擎,他们是昂贵的维护,昂贵的操作,并难以设计。因此,预测垂直搜索引擎的响应时间通常是通过实验凭经验完成的,需要昂贵的设置。另一种方法是开发一个用于预测性能的搜索引擎模型。然而,只有当它的预测准确时,这种替代方案才有意义。在本文中,我们提出了一种方法来分析垂直搜索引擎的性能。应用所提出的方法,我们提出了一个容量规划模型的基础上,一个规模通常适合于大公司的需求的搜索引擎的搜索网络。该模型是简单的,但相当准确,并在以前的工作相比,考虑了异构索引服务器之间的查询服务时间的不平衡。我们将讨论如何调整模型,以及如何应用模型来预测当CPU和磁盘容量等参数发生变化时对查询响应时间的影响。这允许垂直搜索引擎的管理者先验地确定系统的新配置是否可以将查询响应保持在指定的性能约束下。

英文摘要:

Vertical search engines focus on specific slices of content, such as the Web of a single country or the document collection of a large corporation. Despite this, like general open web search engines, they are expensive to maintain, expensive to operate, and hard to design. Because of this, predicting the response time of a vertical search engine is usually done empirically through experimentation, requiring a costly setup. An alternative is to develop a model of the search engine for predicting performance. However, this alternative is of interest only if its predictions are accurate. In this paper we propose a methodology for analyzing the performance of vertical search engines. Applying the proposed methodology, we present a capacity planning model based on a queueing network for search engines with a scale typically suitable for the needs of large corporations. The model is simple and yet reasonably accurate and, in contrast to previous work, considers the imbalance in query service times among homogeneous index servers. We discuss how we tune up the model and how we apply it to predict the impact on the query response time when parameters such as CPU and disk capacities are changed. This allows a manager of a vertical search engine to determine a priori whether a new configuration of the system might keep the query response under specified performance constraints.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑