arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2108.09275cs.IRcs.LG
收藏

科学数据集和分析管道推荐系统

A Recommender System for Scientific Datasets and Analysis Pipelines

Concordia University(康考迪亚大学);Child Mind Institute(儿童心智研究所)

Mandana Mazaheri, Gregory Kiar, Tristan Glatard

摘要:

为了开放科学的利益,科学数据集和分析管道越来越多地被公开共享。然而,缺乏可靠地识别哪些管道和数据集可以适当地一起使用的机制。鉴于高质量公共数据集和管道的数量不断增加,缺乏明确的兼容性威胁到这些资源的可查找性和可重用性。我们研究了协同过滤系统的可行性,以推荐管道和数据集的基础上,从以前的执行出处记录。我们使用从加拿大开放神经科学平台(Canadian Open Neuroscience Platform)提取的数据集和管道来评估我们的系统,该平台是开放神经科学的国家倡议。我们的系统(AUC $=0.83$)提供的建议明显优于机会,并优于领域专家使用他们以前的知识以及管道和数据集描述(AUC $=0.63$)提出的建议。特别是,领域专家往往忽略了低层次的技术方面的管道数据集的交互,如预处理的水平,这是由基于出处的系统捕获。基于出处的管道和数据集管理器是可行的,有利于开放科学资源的共享和利用。未来的工作将集中在收集更全面的出处跟踪,并在生产中部署该系统。

英文摘要:

Scientific datasets and analysis pipelines are increasingly being shared publicly in the interest of open science. However, mechanisms are lacking to reliably identify which pipelines and datasets can appropriately be used together. Given the increasing number of high-quality public datasets and pipelines, this lack of clear compatibility threatens the findability and reusability of these resources. We investigate the feasibility of a collaborative filtering system to recommend pipelines and datasets based on provenance records from previous executions. We evaluate our system using datasets and pipelines extracted from the Canadian Open Neuroscience Platform, a national initiative for open neuroscience. The recommendations provided by our system (AUC$=0.83$) are significantly better than chance and outperform recommendations made by domain experts using their previous knowledge as well as pipeline and dataset descriptions (AUC$=0.63$). In particular, domain experts often neglect low-level technical aspects of a pipeline-dataset interaction, such as the level of pre-processing, which are captured by a provenance-based system. We conclude that provenance-based pipeline and dataset recommenders are feasible and beneficial to the sharing and usage of open-science resources. Future work will focus on the collection of more comprehensive provenance traces, and on deploying the system in production.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑