arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2406.09320cs.IRcs.CL
收藏

高棉语语义搜索引擎(KSE):数字信息访问与文档检索

Khmer Semantic Search Engine (KSE): Digital Information Access and Document Retrieval

Institute of Technology of Cambodia (ITC)(柬埔寨理工学院)

Nimol Thuon

AI总结:

提出首个高棉语语义搜索引擎 KSE,结合关键词词典、本体和排序三种语义匹配框架及数据准备工具,提升高棉语文档与在线资源检索准确率。

摘要:

搜索引擎流程对于文档内容检索至关重要。对于高棉语文档而言,需要一种有效的工具来提取关键关键词并促进准确搜索。尽管每天都会产生大量高棉语内容,但由于缺乏有效的语义搜索工具,柬埔寨人在查找所需文档时面临困难。即使是 Google 在高棉语内容上也无法提供高准确率。语义搜索引擎通过采用先进算法理解各种内容类型来改进搜索结果。随着报告、文章和社交媒体反馈等高棉语数字内容的增加,增强的搜索能力变得必不可少。本研究提出了首个高棉语语义搜索引擎(KSE),旨在改进传统高棉语搜索方法。该工具利用语义匹配技术和经过正式标注的语义内容,从用户查询中提取有意义的关键词,执行精确匹配,并提供最佳匹配的离线文档和在线 URL。我们提出了三种语义搜索框架:基于关键词词典的语义搜索、基于本体的语义搜索和基于排序的语义搜索。此外,我们还开发了用于数据准备的工具,包括文档添加和人工关键词提取。为评估性能,我们创建了一个真值数据集,并解决了与搜索和语义搜索相关的问题。研究结果表明,理解搜索词的语义可以带来显著更准确的结果。

英文摘要:

The search engine process is crucial for document content retrieval. For Khmer documents, an effective tool is needed to extract essential keywords and facilitate accurate searches. Despite the daily generation of significant Khmer content, Cambodians struggle to find necessary documents due to the lack of an effective semantic searching tool. Even Google does not deliver high accuracy for Khmer content. Semantic search engines improve search results by employing advanced algorithms to understand various content types. With the rise in Khmer digital content such as reports, articles, and social media feedback enhanced search capabilities are essential. This research proposes the first Khmer Semantic Search Engine (KSE), designed to enhance traditional Khmer search methods. Utilizing semantic matching techniques and formally annotated semantic content, our tool extracts meaningful keywords from user queries, performs precise matching, and provides the best matching offline documents and online URLs. We propose three semantic search frameworks: semantic search based on a keyword dictionary, semantic search based on ontology, and semantic search based on ranking. Additionally, we developed tools for data preparation, including document addition and manual keyword extraction. To evaluate performance, we created a ground truth dataset and addressed issues related to searching and semantic search. Our findings demonstrate that understanding search term semantics can lead to significantly more accurate results.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑