arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2303.02105cs.DC
收藏

OSS中的Sherlock:一种基于内容的对象存储系统搜索新方法

Sherlock in OSS: A Novel Approach of Content-Based Searching in Object Storage System

Jannatun Noor, Rizwanul Haque Ratul, Mir Rownak Ali Uday, Joyanta Jyoti Mondal, Md. Sadiqul Islam Sakif, A. B. M. Alim Al Islam

AI总结:

本文提出Sherlock,一种基于内容的对象存储搜索架构,通过分类、模型提取和Elasticsearch实现内容搜索,并在OpenStack Swift上验证其有效性。

摘要:

云中的对象存储系统(OSS)承诺提供可扩展性、持久性、可用性和并发性。然而,开源OSS并没有一种特定的方法让用户和管理员在不涉及整个云基础设施的情况下,基于对象存储中包含的数据进行搜索。因此,在本文中,我们提出了Sherlock,一种新颖的基于内容的搜索(CoBS)架构,用于从图像和文档中提取附加信息。这里,我们将附加信息存储在启用Elasticsearch的数据库中,这有助于我们基于其内容搜索所需的数据。该方法分两个连续阶段工作。首先,数据将被上传到分类器,该分类器将确定数据类型并将其发送到特定模型以处理该数据。在此,上传的图像被发送到我们训练好的模型进行目标检测,而文档则被发送用于关键词提取。接下来,提取的信息被发送到Elasticsearch,从而实现基于内容的搜索。由于模型的精度对搜索的正确性至关重要,我们使用全面的数据集(用于多媒体数据的Microsoft COCO数据集和用于文档数据的SemEval2017数据集)训练我们的模型。此外,我们通过对一个名为OpenStack Swift的开源OSS进行实际部署来测试我们设计的架构。我们将图像以不同分段上传到我们实现的数据库中,以评估我们提出的模型在真实Swift对象存储中的有效性。

英文摘要:

Object Storage Systems (OSS) inside a cloud promise scalability, durability, availability, and concurrency. However, open-source OSS does not have a specific approach to letting users and administrators search based on the data, which is contained inside the object storage, without involving the entire cloud infrastructure. Therefore, in this paper, we propose Sherlock, a novel Content-Based Searching (CoBS) architecture to extract additional information from images and documents. Here, we store the additional information in an Elasticsearch-enabled database, which helps us to search for our desired data based on its contents. This approach works in two sequential stages. First, the data will be uploaded to a classifier that will determine the data type and send it to the specific model for the data. Here, the images that are being uploaded are sent to our trained model for object detection, and the documents are sent for keyword extraction. Next, the extracted information is sent to Elasticsearch, which enables searching based on the contents. Because the precision of the models is so fundamental to the search's correctness, we train our models with comprehensive datasets (Microsoft COCO Dataset for multimedia data and SemEval2017 Dataset for document data). Furthermore, we put our designed architecture to the test with a real-world implementation of an open-source OSS called OpenStack Swift. We upload images into the dataset of our implementation in various segments to find out the efficacy of our proposed model in real-life Swift object storage.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑