研究数据集的可用性是健康和生命科学研究再现性和科学进步的关键。由于这些数据的异质性和复杂性,研究数据管理系统要克服的主要挑战是为用户的搜索查询提供最佳答案。在2016年bioCADDIE数据集检索挑战赛的背景下,我们研究了一种新的排名管道,以改善生物医学实验中使用的数据集的搜索。我们的系统包括一个基于词嵌入的查询扩展模型,一个考虑到查询词相关性的相似性度量算法,以及一个提高匹配查询约束的数据集排名的数据集分类方法。该系统进行了评估,使用语料库与800k数据集和21个注释的用户查询。与其他挑战参与者相比,我们的系统提供了具有竞争力的结果。在正式运行中,它在参与者中实现了最高的infAP,比参与者最好的提交的infAP中位数高出22.3%。总体而言,如果考虑使用每个参与者的最佳官方度量的聚合度量,则其排名前2。查询扩展方法对系统的性能产生了积极的影响,将我们的基线分别提高到infAP和infNDCG指标的+5.0%和+3.4%。我们的相似性度量算法似乎是鲁棒的,特别是与Divergence From Randomness框架相比,在不同的训练条件下具有较小的性能变化。最后,结果分类对系统的性能没有显著影响。我们相信,我们的解决方案可用于增强生物医学数据集管理系统。特别是,数据驱动的查询扩展方法的使用可以是生物医学术语复杂性的替代方案。
英文摘要:
Availability of research datasets is keystone for health and life science study reproducibility and scientific progress. Due to the heterogeneity and complexity of these data, a main challenge to be overcome by research data management systems is to provide users with the best answers for their search queries. In the context of the 2016 bioCADDIE Dataset Retrieval Challenge, we investigate a novel ranking pipeline to improve the search of datasets used in biomedical experiments. Our system comprises a query expansion model based on word embeddings, a similarity measure algorithm that takes into consideration the relevance of the query terms, and a dataset categorisation method that boosts the rank of datasets matching query constraints. The system was evaluated using a corpus with 800k datasets and 21 annotated user queries. Our system provides competitive results when compared to the other challenge participants. In the official run, it achieved the highest infAP among the participants, being +22.3% higher than the median infAP of the participant's best submissions. Overall, it is ranked at top 2 if an aggregated metric using the best official measures per participant is considered. The query expansion method showed positive impact on the system's performance increasing our baseline up to +5.0% and +3.4% for the infAP and infNDCG metrics, respectively. Our similarity measure algorithm seems to be robust, in particular compared to Divergence From Randomness framework, having smaller performance variations under different training conditions. Finally, the result categorization did not have significant impact on the system's performance. We believe that our solution could be used to enhance biomedical dataset management systems. In particular, the use of data driven query expansion methods could be an alternative to the complexity of biomedical terminologies.
Exposing Query Identification for Search Transparency
Carnegie Mellon University(卡内基梅隆大学);Microsoft(微软);University College London(伦敦大学学院);Mila Quebec Artificial Intelligence Institute(米拉魁北克人工智能研究所);Max Planck Institute for Security and Privacy(马克斯·普朗克安全与隐私研究所)
Query expansion techniques for information retrieval: A survey
随着网络规模的不断扩大,在互联网上对由少数关键字组成的查询进行相关信息抽取已成为一个巨大的挑战。查询扩展(QE)在提高Internet上的搜索性能方面起着至关重要的作用。在这里,用户的初始查询通过添加具有类似意义的附加有意义的术语来重新表述。作为信息检索(IR)的一部分,QE长期以来一直受到研究者的关注。它在个性化社会文档、问答、跨语言信息检索、信息过滤和多媒体信息检索等领域具有重要影响力。由于TREC(Text信息检索Conference)和CLEF(Conference and Labs of the Evaluation Forum)等专门的信息检索会议的召开,QE的研究得到了进一步的重视。本文从核心技术、使用的数据源、加权和排名方法、用户参与和应用等方面对1960年至2017年IR中的QE技术进行了调查,并指出了相似性和差异性。