一种基于上下文、语义和句法线索的异构文本数据集新型多维参考模型
A Novel Multidimensional Reference Model For Heterogeneous Textual Datasets Using Context, Semantic And Syntactic Clues
AI总结:
针对异构文本数据多维术语覆盖不足问题,提出基于语言学类别(上下文、语义、句法)的新型多维参考模型MRM,通过索引检查提升覆盖率,优于单维模型。
摘要:
随着技术的发展和新设备的普及,它们产生了海量的数据。其中,80%的数据是非结构化的,其余20%是结构化和半结构化的。产生的数据以异构格式存在,且不遵循任何标准。在异构(结构化、半结构化和非结构化)数据中,文本数据如今被工业界用于预测和可视化未来挑战。由于词汇和语义匹配问题,从中提取有用信息对利益相关者来说极具挑战性。已有少数研究通过使用本体和语义工具来解决这一问题,但所提工作的主要局限性在于对多维术语的覆盖不足。为解决此问题,本研究旨在利用语言学类别为异构文本数据集生成一种新型多维参考模型。该模型重点关注上下文、语义和句法线索等类别及其得分。MRM的主要贡献在于,它基于语言学类别的索引(如同义词、反义词、正式词、词汇词序和共现)对每个标记与每个术语进行检查。实验表明,在覆盖率、语言学类别和异构数据集方面,MRM的百分比优于最先进的单维参考模型。
英文摘要:
With the advent of technology and use of latest devices, they produces voluminous data. Out of it, 80% of the data are unstructured and remaining 20% are structured and semi-structured. The produced data are in heterogeneous format and without following any standards. Among heterogeneous (structured, semi-structured and unstructured) data, textual data are nowadays used by industries for prediction and visualization of future challenges. Extracting useful information from it is really challenging for stakeholders due to lexical and semantic matching. Few studies have been solving this issue by using ontologies and semantic tools, but the main limitations of proposed work were the less coverage of multidimensional terms. To solve this problem, this study aims to produce a novel multidimensional reference model using linguistics categories for heterogeneous textual datasets. The categories such context, semantic and syntactic clues are focused along with their score. The main contribution of MRM is that it checks each tokens with each term based on indexing of linguistic categories such as synonym, antonym, formal, lexical word order and co-occurrence. The experiments show that the percentage of MRM is better than the state-of-the-art single dimension reference model in terms of more coverage, linguistics categories and heterogeneous datasets.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。