arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2209.00946cs.DBcs.LG
收藏

AnaMeta:一个面向多维数据分析任务共享的字段元数据知识表格理解数据集

AnaMeta: A Table Understanding Dataset of Field Metadata Knowledge Shared by Multi-dimensional Data Analysis Tasks

Microsoft Research(微软研究院);The University of Hong Kong(香港大学);University of Illinois at Urbana-Champaign(伊利诺伊大学厄巴纳-香槟分校);University of Waterloo(滑铁卢大学);Peking University(北京大学)

Xinyi He, Mengyu Zhou, Mingjie Zhou, Jialiang Xu, Xiao Lv, Tianle Li, Yijia Shao, Shi Han, Zejian Yuan, Dongmei Zhang

AI总结:

本文提出AnaMeta数据集(467k表格,四种字段元数据标签)及KDF多编码器框架,通过融合分布与知识信息提升表格模型元数据理解,并设计四种接口将字段元数据融入下游分析任务。

摘要:

表格数据分析每天都在各个领域中进行。它需要对字段语义的准确理解,以便正确操作表格字段并发现日常分析中的常见模式。在本文中,我们介绍了AnaMeta数据集,这是一个包含467k张表格的集合,带有四种常用字段元数据的派生监督标签:度量/维度二分法、常见字段角色、语义字段类型和默认聚合函数。我们评估了广泛的模型作为推断元数据的基准。我们还提出了一个多编码器框架,称为KDF,它通过融合分布和知识信息来提高表格模型的元数据理解能力。此外,我们提出了四种接口,用于将字段元数据融入下游分析任务中。

英文摘要:

Tabular data analysis is performed every day across various domains. It requires an accurate understanding of field semantics to correctly operate on table fields and find common patterns in daily analysis. In this paper, we introduce the AnaMeta dataset, a collection of 467k tables with derived supervision labels for four types of commonly used field metadata: measure/dimension dichotomy, common field roles, semantic field type, and default aggregation function. We evaluate a wide range of models for inferring metadata as the benchmark. We also propose a multi-encoder framework, called KDF, which improves the metadata understanding capability of tabular models by incorporating distribution and knowledge information. Furthermore, we propose four interfaces for incorporating field metadata into downstream analysis tasks.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑