arXivDaily arXiv每日学术速递 周一至周五更新
arXiv cs/0503011cs.IR
收藏

洗牌:搜索引擎结果的部分随机排序

Shuffling a Stacked Deck: The Case for Partially Randomized Ranking of Search Engine Results

Sandeep Pandey, Sourashis Roy, Christopher Olston, Junghoo Cho, Soumen Chakrabarti

摘要:

在现代搜索引擎中,网页流行度、PageRank、访问次数和其他衡量网页流行度的指标显著影响搜索结果的排名。人们的假设是,受欢迎程度与质量密切相关,这是一个难以直接衡量的更难以捉摸的概念。不幸的是,流行度和质量之间的相关性是非常弱的新创建的页面,尚未收到许多访问和/或在链接。更糟糕的是,由于新内容的发现主要是通过查询搜索引擎完成的,而且由于用户通常将注意力集中在前几个结果上,新创建的但高质量的页面实际上被"拒之门外",并且可能需要很长时间才能变得流行。我们提出了一个简单而优雅的解决方案:在搜索结果排名方法中引入可控的随机性。这样做为新页面提供了一个证明其价值的机会,尽管显然使用太多的随机性会降低结果质量并取消所获得的任何好处。因此,在估计新页面质量的探索和利用已知高质量的页面之间存在权衡。我们研究这种权衡分析和通过模拟,在经济目标函数的基础上,随着时间的推移摊销的总结果质量。我们发现,适度的随机性会导致搜索结果的改善。

英文摘要:

In-degree, PageRank, number of visits and other measures of Web page popularity significantly influence the ranking of search results by modern search engines. The assumption is that popularity is closely correlated with quality, a more elusive concept that is difficult to measure directly. Unfortunately, the correlation between popularity and quality is very weak for newly-created pages that have yet to receive many visits and/or in-links. Worse, since discovery of new content is largely done by querying search engines, and because users usually focus their attention on the top few results, newly-created but high-quality pages are effectively ``shut out,'' and it can take a very long time before they become popular. We propose a simple and elegant solution to this problem: the introduction of a controlled amount of randomness into search result ranking methods. Doing so offers new pages a chance to prove their worth, although clearly using too much randomness will degrade result quality and annul any benefits achieved. Hence there is a tradeoff between exploration to estimate the quality of new pages and exploitation of pages already known to be of high quality. We study this tradeoff both analytically and via simulation, in the context of an economic objective function based on aggregate result quality amortized over time. We show that a modest amount of randomness leads to improved search results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑