切线搜索引擎:改进的相似度搜索和Scalability公式搜索
The Tangent Search Engine: Improved Similarity Metrics and Scalability for Math Formula Search
摘要:
随着世界范围内数据数量和种类的不断增加,Web已经成为数学公式的丰富存储库。这就需要创建一个健壮的、可扩展的数学信息检索系统,用户可以使用单独的公式(按表达式查询)或关键字和公式的组合来搜索数学信息。通常,最能满足用户信息需求的页面包含的表达式只能近似匹配查询公式。对于试图定位或重新找到特定表达式、浏览相似公式或非数学专家的用户,公式的相似性更多地取决于符号的相对位置,而不是深层数学语义。我们提出了最大子树相似性(MSS)度量查询的表达式,产生直观的排名公式的基础上,他们的外观,所表示的类型和符号的相对位置。由于对大型集合中的所有公式应用度量的成本太高,因此我们首先使用元组上的倒排索引检索表达式,该元组对符号对之间的关系进行编码,使用Dice系数对命中进行排名。然后使用MSS对前k个公式进行重新排名。我们的方法在NTCIR-11维基百科公式检索基准上获得了最先进的性能,并且在索引空间和整体检索时间方面都是有效的。其他图形形式的检索系统,包括化学图表,流程图,图形和表格,也可以受益于采用我们的方法。
英文摘要:
With the ever-increasing quantity and variety of data worldwide, the Web has become a rich repository of mathematical formulae. This necessitates the creation of robust and scalable systems for Mathematical Information Retrieval, where users search for mathematical information using individual formulae (query-by-expression) or a combination of keywords and formulae. Often, the pages that best satisfy users' information needs contain expressions that only approximately match the query formulae. For users trying to locate or re-find a specific expression, browse for similar formulae, or who are mathematical non-experts, the similarity of formulae depends more on the relative positions of symbols than on deep mathematical semantics. We propose the Maximum Subtree Similarity (MSS) metric for query-by-expression that produces intuitive rankings of formulae based on their appearance, as represented by the types and relative positions of symbols. Because it is too expensive to apply the metric against all formulae in large collections, we first retrieve expressions using an inverted index over tuples that encode relationships between pairs of symbols, ranking hits using the Dice coefficient. The top-k formulae are then re-ranked using MSS. Our approach obtains state-of-the-art performance on the NTCIR-11 Wikipedia formula retrieval benchmark and is efficient in terms of both index space and overall retrieval time. Retrieval systems for other graphical forms, including chemical diagrams, flowcharts, figures, and tables, may also benefit from adopting our approach.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。