arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2006.01294cs.DBcs.AI
收藏

NEMA:大型网络管理数据库的自动集成

NEMA: Automatic Integration of Large Network Management Databases

University of Massachusetts, Amherst(马萨诸塞大学阿默斯特分校);Cisco(思科)

Fubao Wu, Han Hee Song, Jiangtao Yin, Lixin Gao, Mario Baldi, Narendra Anand

摘要:

网络管理,无论是故障分析,故障预测,性能监控和改进,通常涉及大量的数据来自不同的来源。为了有效地集成和管理这些数据源,自动找到它们的模式或本体之间的语义匹配是至关重要的。现有的数据库匹配方法主要分为两类。一种是基于模式属性(如字段名、数据类型、约束和模式结构)的模式级匹配。网络管理数据库包含大量表(例如,网络产品、事件、安全警报和日志),这些信息来自不同的部门和组,具有不统一的字段名称和架构特征。通过这些模式属性来匹配它们是不可靠的。另一类是基于实例级的匹配,使用一般的字符串相似性技术,这是不适用于大型网络管理数据库的匹配。在本文中,我们开发了一个匹配技术,大型网络MANNETWORK数据库(NEMA)部署的实例级匹配有效的数据集成和连接。我们设计的数值和非数值字段的匹配指标和分数,并提出匹配这些字段的算法。通过在大型网络管理数据库中进行基于地面真值字段对的实验,对NEMA的有效性和效率进行了评估。我们对包含1,458个字段的大型数据库进行了测量,每个字段包含超过1000万条记录,结果显示NEMA的准确率高达95%。与基线方法相比,它实现了2%-10%的精度和5倍-14倍的加速。

英文摘要:

Network management, whether for malfunction analysis, failure prediction, performance monitoring and improvement, generally involves large amounts of data from different sources. To effectively integrate and manage these sources, automatically finding semantic matches among their schemas or ontologies is crucial. Existing approaches on database matching mainly fall into two categories. One focuses on the schema-level matching based on schema properties such as field names, data types, constraints and schema structures. Network management databases contain massive tables (e.g., network products, incidents, security alert and logs) from different departments and groups with nonuniform field names and schema characteristics. It is not reliable to match them by those schema properties. The other category is based on the instance-level matching using general string similarity techniques, which are not applicable for the matching of large network management databases. In this paper, we develop a matching technique for large NEtwork MAnagement databases (NEMA) deploying instance-level matching for effective data integration and connection. We design matching metrics and scores for both numerical and non-numerical fields and propose algorithms for matching these fields. The effectiveness and efficiency of NEMA are evaluated by conducting experiments based on ground truth field pairs in large network management databases. Our measurement on large databases with 1,458 fields, each of which contains over 10 million records, reveals that the accuracies of NEMA are up to 95%. It achieves 2%-10% higher accuracy and 5x-14x speedup over baseline methods.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑