数据科学:潜力与挑战
Progressive Data Science: Potential and Challenges
摘要:
数据科学需要耗时的迭代手动活动。特别是,数据选择、预处理、转换和挖掘等活动高度依赖于迭代的试错过程,通过提供有关更改影响的快速反馈,可以大大加快速度。渐进式数据科学的思想是以渐进的方式计算变化的结果,快速返回结果的第一近似值,并允许迭代改进,直到收敛到最终结果。使用户能够与中间结果交互允许早期检测错误或次优选择、对管道的修改的指导定义及其快速评估。在本文中,我们讨论了在数据科学管道的不同步骤中出现的渐进性挑战。我们描述了管道中每个步骤的变化如何影响后续步骤,并概述了为什么渐进式数据科学将有助于使流程更有效。计算由变化产生的结果的渐进近似值会带来许多研究挑战,特别是如果变化是在管道的早期步骤中进行的。我们讨论了这些挑战,并概述了迈向进步的第一步,我们认为,这最终将有助于显着加快整个数据科学过程。
英文摘要:
Data science requires time-consuming iterative manual activities. In particular, activities such as data selection, preprocessing, transformation, and mining, highly depend on iterative trial-and-error processes that could be sped-up significantly by providing quick feedback on the impact of changes. The idea of progressive data science is to compute the results of changes in a progressive manner, returning a first approximation of results quickly and allow iterative refinements until converging to a final result. Enabling the user to interact with the intermediate results allows an early detection of erroneous or suboptimal choices, the guided definition of modifications to the pipeline and their quick assessment. In this paper, we discuss the progressiveness challenges arising in different steps of the data science pipeline. We describe how changes in each step of the pipeline impact the subsequent steps and outline why progressive data science will help to make the process more effective. Computing progressive approximations of outcomes resulting from changes creates numerous research challenges, especially if the changes are made in the early steps of the pipeline. We discuss these challenges and outline first steps towards progressiveness, which, we argue, will ultimately help to significantly speed-up the overall data science process.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。