数据分析中的信息传递的程序设计
Anfrage-getriebener Wissenstransfer zur Unterstuetzung von Datenanalysten
摘要:
在大型组织中,多个数据科学家团队必须集成来自异构数据源的数据,为数据分析任务做准备。编写有效的分析查询需要数据科学家深入了解数据源的存在、语义和使用上下文。一旦收集到这些知识,这些知识就会在特定的数据科学家团队中非正式地共享,但通常既不会正式化,也不会与其他团队共享。潜在的协同作用仍未得到利用。因此,我们引入了一种新的方法,扩展了数据管理系统与额外的知识共享功能,以促进用户的协作,而不改变既定的数据分析工作流程。从查询日志中提取相关的集体知识,以支持数据源发现和增量数据集成。提取的知识是形式化的,并在查询时提供。
英文摘要:
In larger organizations, multiple teams of data scientists have to integrate data from heterogeneous data sources as preparation for data analysis tasks. Writing effective analytical queries requires data scientists to have in-depth knowledge of the existence, semantics, and usage context of data sources. Once gathered, such knowledge is informally shared within a specific team of data scientists, but usually is neither formalized nor shared with other teams. Potential synergies remain unused. We therefore introduce a novel approach which extends data management systems with additional knowledge-sharing capabilities to facilitate user collaboration without altering established data analysis workflows. Relevant collective knowledge from the query log is extracted to support data source discovery and incremental data integration. Extracted knowledge is formalized and provided at query time.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。