arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1401.6596cs.DScs.IR
收藏

一种新的基于最频繁K字符的字符串距离函数

A Novel String Distance Function based on Most Frequent K Characters

Sadi Evren Seker, Oguz Altun, Uğur Ayan, Cihan Mert

摘要:

本研究的目的是发布一种新的相似性度量,以提高比较操作的速度。新的度量也适用于字符串之间基于距离的操作。大多数简单的计算方法,如字符串长度,计算速度很快,但不能正确表示字符串。另一方面,像保持字符串中所有字符的直方图这样的方法速度较慢,但可以很好地表示某些领域的字符串特征,如自然语言。我们提出了一个新的度量,易于计算和满意的字符串比较。方法构建在哈希函数上,该函数获取任意大小的字符串,并输出最频繁的K个字符及其频率。输出是开放的比较,我们的研究表明,成功率是相当令人满意的文本挖掘操作。

英文摘要:

This study aims to publish a novel similarity metric to increase the speed of comparison operations. Also the new metric is suitable for distance-based operations among strings. Most of the simple calculation methods, such as string length are fast to calculate but does not represent the string correctly. On the other hand the methods like keeping the histogram over all characters in the string are slower but good to represent the string characteristics in some areas, like natural language. We propose a new metric, easy to calculate and satisfactory for string comparison. Method is built on a hash function, which gets a string at any size and outputs the most frequent K characters with their frequencies. The outputs are open for comparison and our studies showed that the success rate is quite satisfactory for the text mining operations.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑