arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1810.02579cs.IR
收藏

C-DLSI:一种面向联邦文本检索的扩展LSI

C-DLSI: An Extended LSI Tailored for Federated Text Retrieval

Qijun Zhu, Dandan Li, Dik Lun Lee

摘要:

随着网络在数据量和地理分布上的扩展,集中式搜索方法变得低效,导致对协作信息检索的兴趣增加,联邦文本检索(FTR)。与现有的集中式信息检索(IR)方法不同,FTR是由多个节点组成的,每个节点本身就是一个完整的搜索引擎。为了处理查询,FTR首先需要识别托管相关文档的有前途的对等体,其次需要从所选对等体中检索最相关的文档。大多数现有的方法只应用传统的IR技术,将每个文本集合作为一个单一的大文档,并利用术语匹配来排名的集合。在本文中,我们形式化的问题,并确定FTR的属性,并分析了扩展LSI的聚类,以适应FTR的可行性,在此基础上提出了一种新的方法称为基于聚类的分布式潜在语义索引(C-DLSI)。C-DLSI通过聚类来区分节点的主题,捕获聚类中的局部LSI空间,并考虑这些LSI空间之间的关系,从而提供对节点更精确的刻画。因此,提出了新的描述符的同行和兼容的本地文本检索。实验结果表明,C-DLSI优于现有的方法。

英文摘要:

As the web expands in data volume and in geographical distribution, centralized search methods become inefficient, leading to increasing interest in cooperative information retrieval, e.g., federated text retrieval (FTR). Different from existing centralized information retrieval (IR) methods, in which search is done on a logically centralized document collection, FTR is composed of a number of peers, each of which is a complete search engine by itself. To process a query, FTR requires firstly the identification of promising peers that host the relevant documents and secondly the retrieval of the most relevant documents from the selected peers. Most of the existing methods only apply traditional IR techniques that treat each text collection as a single large document and utilize term matching to rank the collections. In this paper, we formalize the problem and identify the properties of FTR, and analyze the feasibility of extending LSI with clustering to adapt to FTR, based on which a novel approach called Cluster-based Distributed Latent Semantic Indexing (C-DLSI) is proposed. C-DLSI distinguishes the topics of a peer with clustering, captures the local LSI spaces within the clusters, and consider the relations among these LSI spaces, thus providing more precise characterization of the peer. Accordingly, novel descriptors of the peers and a compatible local text retrieval are proposed. The experimental results show that C-DLSI outperforms existing methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑