迭代残差重标度:对LSI的分析和推广
Iterative Residual Rescaling: An Analysis and Generalization of LSI
摘要:
我们考虑的问题,创建文档表示,其中文档间的相似性度量对应于语义相似性。我们首先提出了一个新的子空间为基础的框架,正式这项任务。使用这个框架,我们得到一个新的分析潜在语义索引(LSI),显示其性能和主题的基本分布的文档的均匀性之间的精确关系。这一分析有助于解释Ando(2000)的迭代残差重标度(IRR)算法所获得的改进:IRR可以补偿分布的非均匀性。我们的框架的另一个好处是,它提供了一个动机良好,有效的方法来自动确定重新缩放因子IRR依赖,导致进一步的改进。一系列的实验在不同的设置和几个评估指标验证了我们的主张。
英文摘要:
We consider the problem of creating document representations in which inter-document similarity measurements correspond to semantic similarity. We first present a novel subspace-based framework for formalizing this task. Using this framework, we derive a new analysis of Latent Semantic Indexing (LSI), showing a precise relationship between its performance and the uniformity of the underlying distribution of documents over topics. This analysis helps explain the improvements gained by Ando's (2000) Iterative Residual Rescaling (IRR) algorithm: IRR can compensate for distributional non-uniformity. A further benefit of our framework is that it provides a well-motivated, effective method for automatically determining the rescaling factor IRR depends on, leading to further improvements. A series of experiments over various settings and with several evaluation metrics validates our claims.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。