arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2302.07010cs.IRcs.AI
收藏

综合数据工程技术提高多语言信息检索模型性能

Enhancing Model Performance in Multilingual Information Retrieval with Comprehensive Data Engineering Techniques

Netease Inc.(网易公司)

Qi Zhang, Zijian Yang, Yilun Huang, Ze Chen, Zijian Cai, Kangxu Wang, Jiewen Zheng, Jiarong He, Jin Gao

摘要:

在本文中,我们提出了我们的解决方案,跨语言的连续体(MIRACL)的WSDM杯2023 \footnote{https://project-miracl.github.io/}的多语言信息检索的挑战。我们的解决方案专注于增强排名阶段,在此阶段,我们使用MIRACL数据集对预训练的基于多语言transformer的模型进行微调。我们的模型改进主要是通过各种数据工程技术来实现的,包括收集额外的相关训练数据、数据增强和负采样。我们的微调模型有效地确定查询和文档之间的语义相关性,从而显着提高多语言信息检索过程的效率。最后,我们的团队很高兴在这场具有挑战性的比赛中取得了令人瞩目的成绩,在惊喜语言赛道中获得了第二名,得分为0.835,在已知语言赛道中获得了第三名,在最终排行榜上的16种已知语言中,平均nDCG@10得分为0.716。

英文摘要:

In this paper, we present our solution to the Multilingual Information Retrieval Across a Continuum of Languages (MIRACL) challenge of WSDM CUP 2023\footnote{https://project-miracl.github.io/}. Our solution focuses on enhancing the ranking stage, where we fine-tune pre-trained multilingual transformer-based models with MIRACL dataset. Our model improvement is mainly achieved through diverse data engineering techniques, including the collection of additional relevant training data, data augmentation, and negative sampling. Our fine-tuned model effectively determines the semantic relevance between queries and documents, resulting in a significant improvement in the efficiency of the multilingual information retrieval process. Finally, Our team is pleased to achieve remarkable results in this challenging competition, securing 2nd place in the Surprise-Languages track with a score of 0.835 and 3rd place in the Known-Languages track with an average nDCG@10 score of 0.716 across the 16 known languages on the final leaderboard.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑