arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2204.03096cs.IR
收藏

从小事到大事:用于医学系统性综述文献检索的种子研究合集

From Little Things Big Things Grow: A Collection with Seed Studies for Medical Systematic Review Literature Search

Shuai Wang, Harrisen Scells, Justin Clark, Bevan Koopman, Guido Zuccon

摘要:

医学系统综述查询制定是一项由训练有素的信息专家完成的高度复杂的任务。复杂性来自于对冗长的布尔查询的依赖,布尔查询表达了一个详细的研究问题。为了帮助查询公式,信息专家使用一组样本文件,称为“种子研究”,查询公式之前。种子研究有助于在全面评估检索到的研究之前验证查询的有效性。除了使用种子之外,特定的IR方法可以利用种子研究来指导自动查询公式化和新的检索模型。迄今为止,工作的一个主要限制是这些方法通过回顾性使用纳入研究(即,相关性评估)。然而,我们发现伪种子研究并不代表信息专家使用的真实种子研究。因此,我们提供了一个测试集合与真实世界的种子研究,用于协助制定查询。为了支持我们的收集,我们提供了一个分析,以前不可能的,种子研究如何影响检索和执行几个实验,使用种子研究为基础的方法,比较使用种子研究与伪种子研究的有效性。我们在http://github.com/ielab/sysrev-seed-collection上提供我们的测试集以及所有实验和分析的结果

英文摘要:

Medical systematic review query formulation is a highly complex task done by trained information specialists. Complexity comes from the reliance on lengthy Boolean queries, which express a detailed research question. To aid query formulation, information specialists use a set of exemplar documents, called `seed studies', prior to query formulation. Seed studies help verify the effectiveness of a query prior to the full assessment of retrieved studies. Beyond this use of seeds, specific IR methods can exploit seed studies for guiding both automatic query formulation and new retrieval models. One major limitation of work to date is that these methods exploit `pseudo seed studies' through retrospective use of included studies (i.e., relevance assessments). However, we show pseudo seed studies are not representative of real seed studies used by information specialists. Hence, we provide a test collection with real world seed studies used to assist with the formulation of queries. To support our collection, we provide an analysis, previously not possible, on how seed studies impact retrieval and perform several experiments using seed-study based methods to compare the effectiveness of using seed studies versus pseudo seed studies. We make our test collection and the results of all of our experiments and analysis available at http://github.com/ielab/sysrev-seed-collection

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑