arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 1601.00643cs.IR
收藏

基于统计和情感特征的单文本自动文摘方法

Hybrid Approach for Single Text Document Summarization using Statistical and Sentiment Features

Chandra Shekhar Yadav, Aditi Sharan

摘要:

摘要是一种以简洁、等价的方式表示相同信息的方法。这可以分为两种类型抽象和提取类型。我们的工作主要集中在Extractive summarization。摘要提取的一般方法是将句子视为一个实体,根据一些指示性特征对每个句子进行评分,以确定句子的质量并将其包含在摘要中。根据分数对句子进行排序,并考虑前n个句子进行总结。大多数统计特征被用于对句子进行评分。我们提出了一个混合模型的一个单一的文本文档摘要。该混合模型是一种基于抽取的方法,它是统计和语义技术的结合。混合模型依赖于统计度量的线性组合:句子位置,TF-IDF,聚合相似度,质心和语义度量。我们的想法,包括情感分析的显着句子提取的概念,情感起着重要的作用,有效地传达任何信息的沟通,因此,它可以发挥至关重要的作用,在文本文档摘要。为了进行比较,我们生成了五个系统摘要建议的工作,MEAD系统,微软系统,OPINOSIS系统和人类生成的摘要,并使用ROUGE评分进行评估。

英文摘要:

Summarization is a way to represent same information in concise way with equal sense. This can be categorized in two type Abstractive and Extractive type. Our work is focused around Extractive summarization. A generic approach to extractive summarization is to consider sentence as an entity, score each sentence based on some indicative features to ascertain the quality of sentence for inclusion in summary. Sort the sentences on the score and consider top n sentences for summarization. Mostly statistical features have been used for scoring the sentences. We are proposing a hybrid model for a single text document summarization. This hybrid model is an extraction based approach, which is combination of Statistical and semantic technique. The hybrid model depends on the linear combination of statistical measures : sentence position, TF-IDF, Aggregate similarity, centroid, and semantic measure. Our idea to include sentiment analysis for salient sentence extraction is derived from the concept that emotion plays an important role in communication to effectively convey any message hence, it can play a vital role in text document summarization. For comparison we have generated five system summaries Proposed Work, MEAD system, Microsoft system, OPINOSIS system, and Human generated summary, and evaluation is done using ROUGE score.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑