ACCIO:通过聚合的对比学习增强表格理解
ACCIO: Table Understanding Enhanced via Contrastive Learning with Aggregations
AI总结:
本文提出ACCIO,通过对比学习将原始表格与透视摘要配对训练编码器,增强表格理解,在列类型注释任务上宏F1达91.1,与最先进方法相当。
摘要:
近年来,利用自然语言模型进行表格理解的关注度日益增长。然而,大多数相关工作倾向于直接学习表格的结构。正如人类通过比较句子来提高对句子的理解一样,他们也可以通过比较表格来增强理解。基于这一想法,本文介绍了ACCIO,一种通过聚合的对比学习增强表格理解的新方法,通过对比学习将原始表格与其透视摘要进行对比,从而增强表格理解。ACCIO训练一个编码器,使这些表格对在表示空间中更接近。通过列类型注释的验证,ACCIO取得了具有竞争力的性能,宏F1分数达到91.1,与最先进的方法相当。这项工作首次尝试利用表格对进行表格嵌入,有望在表格理解方面取得重大进展。我们的代码可在https://github.com/whnhch/ACCIO/获取。
英文摘要:
The attention to table understanding using recent natural language models has been growing. However, most related works tend to focus on learning the structure of the table directly. Just as humans improve their understanding of sentences by comparing them, they can also enhance their understanding by comparing tables. With this idea, in this paper, we introduce ACCIO, tAble understanding enhanCed via Contrastive learnIng with aggregatiOns, a novel approach to enhancing table understanding by contrasting original tables with their pivot summaries through contrastive learning. ACCIO trains an encoder to bring these table pairs closer together. Through validation via column type annotation, ACCIO achieves competitive performance with a macro F1 score of 91.1 compared to state-of-the-art methods. This work represents the first attempt to utilize pairs of tables for table embedding, promising significant advancements in table comprehension. Our code is available at https://github.com/whnhch/ACCIO/.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。