arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2402.04357cs.IR
收藏

构建面向 ClueWeb22-B 语料库的检索系统

Building Retrieval Systems for the ClueWeb22-B Corpus

Harshit Mehrotra, Jamie Callan, Zhen Fan

AI总结:

针对 ClueWeb22-B 英文语料构建稀疏与稠密检索及神经重排序基线,供社区对比与训练评估,已部署于卡内基梅隆大学集群。

摘要:

ClueWeb22 数据集包含近 100 亿篇文档,于 2022 年发布,旨在支持学术界和工业界的研究。本项目的目标是为该数据集的英文部分(“超级头部”子集,即类别 B)构建检索基线系统。这些基线可供研究社区用于对比各自系统,并生成数据以训练/评估新的检索与排序算法。本报告涵盖了为该数据集实现的稀疏与稠密两阶段检索,以及神经重排序器。这些系统作为服务部署在卡内基梅隆大学的一个集群上。

英文摘要:

The ClueWeb22 dataset containing nearly 10 billion documents was released in 2022 to support academic and industry research. The goal of this project was to build retrieval baselines for the English section of the "super head" part (category B) of this dataset. These baselines can then be used by the research community to compare their systems and also to generate data to train/evaluate new retrieval and ranking algorithms. The report covers sparse and dense first stage retrievals as well as neural rerankers that were implemented for this dataset. These systems are available as a service on a Carnegie Mellon University cluster.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑