arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1201.2084cs.AIcs.IR
收藏

基于句子的博客文章语义相似性度量

Sentence based semantic similarity measure for blog-posts

National University of Computer & Emerging Sciences(国家计算机与新兴科学大学)

Mehwish Aziz, Muhammad Rafi

摘要:

博客-在线数字日记一样的应用程序在Web 2.0开辟了新的和简单的方式来表达意见,想法,和喜欢不喜欢的每一个互联网用户的世界。毫无疑问,博客圈拥有最大的用户生成内容知识库。这种知识的潜力仍有待探索。从这种新的类型中发现知识是相当困难和具有挑战性的,因为它完全不同于其他流行的Web应用类型,如万维网(WWW)。博客文章不像网络文档,体积小,因此缺乏上下文,包含宽松的语法结构。因此,标准的文本相似性度量无法提供良好的结果。在本文中,专门的要求比较一对博客职位进行了彻底的调查。在此基础上,提出了一种面向句子的博客文章语义相似度度量算法。我们将此算法应用于巴基斯坦的政治博客圈的一个子集上,对政治领域不同问题的博客进行聚类,并识别出有影响力的博客。

英文摘要:

Blogs-Online digital diary like application on web 2.0 has opened new and easy way to voice opinion, thoughts, and like-dislike of every Internet user to the World. Blogosphere has no doubt the largest user-generated content repository full of knowledge. The potential of this knowledge is still to be explored. Knowledge discovery from this new genre is quite difficult and challenging as it is totally different from other popular genre of web-applications like World Wide Web (WWW). Blog-posts unlike web documents are small in size, thus lack in context and contain relaxed grammatical structures. Hence, standard text similarity measure fails to provide good results. In this paper, specialized requirements for comparing a pair of blog-posts is thoroughly investigated. Based on this we proposed a novel algorithm for sentence oriented semantic similarity measure of a pair of blog-posts. We applied this algorithm on a subset of political blogosphere of Pakistan, to cluster the blogs on different issues of political realm and to identify the influential bloggers.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑