用COMANTICS揭示数据管理的语义
Revealing the Semantics of Data Wrangling Scripts With COMANTICS
摘要:
数据工作者通常试图理解各种场景中的数据争用脚本的语义,例如代码调试、重用和维护。然而,由于程序设计语言、函数和参数的多样性,对于新手数据工作者来说,理解这些是具有挑战性的。基于观察,输入和输出表之间的差异高度相关的数据转换的类型,我们概述了一个设计空间,包括103个特征来描述表的差异。然后,我们开发了COMANTICS,这是一个三步流水线,可以自动检测数据转换脚本的语义。第一步关注于检测每行争用代码的表差异。其次,我们将一个基于特征的组件和一个基于连体卷积神经网络的组件用于检测变换类型。第三,我们通过采用“槽填充”策略来获得每个数据转换的参数。我们设计实验来评估COMANTICS的性能。此外,我们评估其灵活性,在不同的领域使用三个示例应用程序。
英文摘要:
Data workers usually seek to understand the semantics of data wrangling scripts in various scenarios, such as code debugging, reusing, and maintaining. However, the understanding is challenging for novice data workers due to the variety of programming languages, functions, and parameters. Based on the observation that differences between input and output tables highly relate to the type of data transformation, we outline a design space including 103 characteristics to describe table differences. Then, we develop COMANTICS, a three-step pipeline that automatically detects the semantics of data transformation scripts. The first step focuses on the detection of table differences for each line of wrangling code. Second, we incorporate a characteristic-based component and a Siamese convolutional neural network-based component for the detection of transformation types. Third, we derive the parameters of each data transformation by employing a "slot filling" strategy. We design experiments to evaluate the performance of COMANTICS. Further, we assess its flexibility using three example applications in different domains.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。