arXivDaily arXiv每日学术速递 周一至周五更新
北美退伍军人节(Veterans Day),12 日无更新
arXiv 2411.03356cs.LGcs.AI
收藏

利用LLM驱动的合成数据生成增强表格表示

Enhancing Table Representations with LLM-powered Synthetic Data Generation

University of Delaware(特拉华大学);Capital One(第一资本金融公司)

Dayu Yang, Natawut Monaikul, Amanda Ding, Bozhao Tan, Kishore Mosaliganti, Giri Iyengar

AI总结:

针对表格表示学习中数据质量不足的问题,提出利用LLM代码生成与数据操作能力构建合成数据流水线,生成大规模数据集以增强表格表示,并在表格推荐任务上验证了其有效性。

摘要:

在数据驱动决策的时代,准确的表格级表示和高效的表格推荐系统对于改善表格管理、发现和分析变得越来越关键。然而,现有的表格数据表示方法常常面临局限性,主要原因是它们侧重于单元格级任务,并且缺乏高质量的训练数据。为了解决这些挑战,我们首先在数据驱动企业的数据转换活动背景下,对表格相似性提出了清晰的定义。该定义作为合成数据生成的基础,而合成数据生成需要一个定义明确的数据生成过程。在此基础上,我们提出了一种新颖的合成数据生成流水线,该流水线利用大型语言模型(LLM)的代码生成和数据操作能力,创建了一个专为表格级表示学习量身定制的大规模合成数据集。通过手动验证和在表格推荐任务上的性能比较,我们证明了我们的流水线生成的合成数据与我们所提出的表格相似性定义一致,并且显著增强了表格表示,从而提升了推荐性能。

英文摘要:

In the era of data-driven decision-making, accurate table-level representations and efficient table recommendation systems are becoming increasingly crucial for improving table management, discovery, and analysis. However, existing approaches to tabular data representation often face limitations, primarily due to their focus on cell-level tasks and the lack of high-quality training data. To address these challenges, we first formulate a clear definition of table similarity in the context of data transformation activities within data-driven enterprises. This definition serves as the foundation for synthetic data generation, which require a well-defined data generation process. Building on this, we propose a novel synthetic data generation pipeline that harnesses the code generation and data manipulation capabilities of Large Language Models (LLMs) to create a large-scale synthetic dataset tailored for table-level representation learning. Through manual validation and performance comparisons on the table recommendation task, we demonstrate that the synthetic data generated by our pipeline aligns with our proposed definition of table similarity and significantly enhances table representations, leading to improved recommendation performance.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑