KGLiDS:一个用于数据科学语义抽象、链接与自动化的平台
KGLiDS: A Platform for Semantic Abstraction, Linking, and Automation of Data Science
AI总结:
本文提出 KGLiDS 平台,利用机器学习与知识图谱抽象、链接数据科学工件语义,支持数据发现、清洗、转换及 AutoML 等自动化任务,并在性能和准确率上优于现有系统。
摘要:
近年来,我们看到学术界和工业界对应用数据科学技术分析大量数据的兴趣日益增长。在此过程中,产生了大量工件(数据集、流水线脚本等)。然而,目前尚无系统性尝试来全面收集并利用这些工件中隐含包含的所有知识与经验。相反,数据科学家需要从同事那里恢复信息和专业知识,或者通过反复试错来学习。因此,本文提出了一个可扩展平台 KGLiDS,该平台利用机器学习和知识图谱技术来抽象并捕获数据科学工件的语义及其联系。基于这些信息,KGLiDS 支持多种下游应用,例如数据发现和流水线自动化。我们的综合评估涵盖数据发现、数据清洗、转换和 AutoML 中的用例。结果表明,与最先进系统相比,KGLiDS 速度显著更快、内存占用更低,同时达到相当或更好的准确率。
英文摘要:
In recent years, we have witnessed the growing interest from academia and industry in applying data science technologies to analyze large amounts of data. In this process, a myriad of artifacts (datasets, pipeline scripts, etc.) are created. However, there has been no systematic attempt to holistically collect and exploit all the knowledge and experiences that are implicitly contained in those artifacts. Instead, data scientists recover information and expertise from colleagues or learn via trial and error. Hence, this paper presents a scalable platform, KGLiDS, that employs machine learning and knowledge graph technologies to abstract and capture the semantics of data science artifacts and their connections. Based on this information, KGLiDS enables various downstream applications, such as data discovery and pipeline automation. Our comprehensive evaluation covers use cases in data discovery, data cleaning, transformation, and AutoML. It shows that KGLiDS is significantly faster with a lower memory footprint than the state-of-the-art systems while achieving comparable or better accuracy.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。