arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2303.07957cs.AI
收藏

Instagram社交网络帖子的自动摘要结合语义和统计方法

Automatic summarisation of Instagram social network posts Combining semantic and statistical approaches

Technical and Vocational University(技术与职业大学);Iran University of Science and Technology(伊朗科技大学)

Kazem Taghandiki, Mohammad Hassan Ahmadi, Elnaz Rezaei Ehsan

摘要:

互联网上诸如文章、网页、书籍、社交网络帖子等的数据和文本文档的激增已经在标题为“自动文本摘要”的文本处理的各个领域中产生了根本性的挑战。人工处理和汇总大量文本数据对于人类用户来说是一个非常困难、昂贵、耗时和不可能的过程。文本摘要系统分为提取和抽象两类。摘要抽取方法是从文本文档的重要句子中抽取出文档的最终摘要,而不对摘要进行任何修改。在这种方法中,可以重复一系列句子并干扰代词。然而,在抽象摘要方法中,文本文档的最终摘要是从同一文档或其他文档的句子和单词的含义和重要性中提取的。进行的许多工作都使用提取方法或摘要来总结收集的Web文档,其中每一个都有优点和缺点,在相似性或大小方面获得的结果。在这项工作中,开发了一个爬虫程序,通过适当的预处理从Instagram社交网络中提取流行的文本帖子,并结合了一组提取和抽象算法,以展示如何使用每种抽象算法。对社交网络Instagram上820个流行文本帖子的观察显示了所提出的系统的准确性(80%)。

英文摘要:

The proliferation of data and text documents such as articles, web pages, books, social network posts, etc. on the Internet has created a fundamental challenge in various fields of text processing under the title of "automatic text summarisation". Manual processing and summarisation of large volumes of textual data is a very difficult, expensive, time-consuming and impossible process for human users. Text summarisation systems are divided into extractive and abstract categories. In the extractive summarisation method, the final summary of a text document is extracted from the important sentences of the same document without any modification. In this method, it is possible to repeat a series of sentences and to interfere with pronouns. However, in the abstract summarisation method, the final summary of a textual document is extracted from the meaning and significance of the sentences and words of the same document or other documents. Many of the works carried out have used extraction methods or abstracts to summarise the collection of web documents, each of which has advantages and disadvantages in the results obtained in terms of similarity or size. In this work, a crawler has been developed to extract popular text posts from the Instagram social network with appropriate preprocessing, and a set of extraction and abstraction algorithms have been combined to show how each of the abstraction algorithms can be used. Observations made on 820 popular text posts on the social network Instagram show the accuracy (80%) of the proposed system.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑