BanglaAutoKG:基于语义神经图过滤的孟加拉语知识图谱自动构建
BanglaAutoKG: Automatic Bangla Knowledge Graph Construction with Semantic Neural Graph Filtering
AI总结:
针对孟加拉语知识图谱稀缺问题,提出BanglaAutoKG框架,利用多语言LLMs、翻译词典、预训练BERT及GNN语义过滤器,从任意孟加拉语文本自动构建语义丰富的知识图谱。
摘要:
知识图谱(KGs)在信息处理和推理应用中已被证明是必不可少的,因为它们链接相关实体并提供上下文丰富的信息,支持高效的信息检索和知识发现;以非常有效的方式呈现信息流。尽管孟加拉语在全球广泛使用,但由于缺乏全面的数据集、编码器、NER(命名实体识别)模型、POS(词性标注)器和词形还原器,孟加拉语在KGs中的代表性相对较低,阻碍了该语言的高效信息处理和推理应用。为了解决孟加拉语KG稀缺问题,我们提出了BanglaAutoKG,这是一个开创性框架,能够从任何孟加拉语文本自动构建孟加拉语KG。我们利用多语言LLMs理解各种语言,并普遍关联实体和关系。通过使用翻译词典识别英文对应词并从预训练BERT模型中提取词特征,我们构建了基础KG。为了减少噪声并使词嵌入与我们的目标对齐,我们采用基于图的多项式滤波器。最后,我们实现了基于GNN的语义过滤器,提升了上下文理解并修剪不必要的边,最终形成确定的KG。实证结果和案例研究证明了我们模型的普遍有效性,能够从任何文本自主构建语义丰富的KG。
英文摘要:
Knowledge Graphs (KGs) have proven essential in information processing and reasoning applications because they link related entities and give context-rich information, supporting efficient information retrieval and knowledge discovery; presenting information flow in a very effective manner. Despite being widely used globally, Bangla is relatively underrepresented in KGs due to a lack of comprehensive datasets, encoders, NER (named entity recognition) models, POS (part-of-speech) taggers, and lemmatizers, hindering efficient information processing and reasoning applications in the language. Addressing the KG scarcity in Bengali, we propose BanglaAutoKG, a pioneering framework that is able to automatically construct Bengali KGs from any Bangla text. We utilize multilingual LLMs to understand various languages and correlate entities and relations universally. By employing a translation dictionary to identify English equivalents and extracting word features from pre-trained BERT models, we construct the foundational KG. To reduce noise and align word embeddings with our goal, we employ graph-based polynomial filters. Lastly, we implement a GNN-based semantic filter, which elevates contextual understanding and trims unnecessary edges, culminating in the formation of the definitive KG. Empirical findings and case studies demonstrate the universal effectiveness of our model, capable of autonomously constructing semantically enriched KGs from any text.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。