数据集搜索:一项调查
Dataset search: a survey
摘要:
从数据中产生价值需要能够找到,访问和理解数据集。有许多努力正在鼓励数据共享和重用,从科学出版商要求作者提交数据和手稿到数据市场,开放数据门户和数据社区。谷歌最近发布了一项数据集搜索服务,允许用户通过关键字查询发现存储在各种在线存储库中的数据。这些发展预示着一个围绕数据集搜索或检索的新兴研究领域,该领域广泛涵盖有助于将用户数据需求与数据集集合相匹配的框架、方法和工具。在这里,我们调查的研究和商业系统在数据集检索的艺术状态。我们确定了是什么使数据集搜索本身成为一个研究领域,具有独特的挑战和方法,并突出了开放的问题。我们从数据集搜索所借鉴的相关领域,包括信息检索,数据库,以实体为中心的和表格搜索,以确定可能的路径来解决这些开放的问题,以及立即采取下一步措施,将该领域向前发展。
英文摘要:
Generating value from data requires the ability to find, access and make sense of datasets. There are many efforts underway to encourage data sharing and reuse, from scientific publishers asking authors to submit data alongside manuscripts to data marketplaces, open data portals and data communities. Google recently beta released a search service for datasets, which allows users to discover data stored in various online repositories via keyword queries. These developments foreshadow an emerging research field around dataset search or retrieval that broadly encompasses frameworks, methods and tools that help match a user data need against a collection of datasets. Here, we survey the state of the art of research and commercial systems in dataset retrieval. We identify what makes dataset search a research field in its own right, with unique challenges and methods and highlight open problems. We look at approaches and implementations from related areas dataset search is drawing upon, including information retrieval, databases, entity-centric and tabular search in order to identify possible paths to resolve these open problems as well as immediate next steps that will take the field forward.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。