arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2502.08856cs.LG
收藏

生成模型在表格交通数据上的系统性评估

A Systematic Evaluation of Generative Models on Tabular Transportation Data

University of Texas at Dallas(德克萨斯大学达拉斯分校);University of California, Santa Cruz(加利福尼亚大学圣克鲁兹分校);Benedict College(本尼迪克特学院)

Chengen Wang, Alvaro Cardenas, Gurcan Comert, Murat Kantarcioglu

AI总结:

本文以纽约市出租车数据为案例,系统性评估常用表格数据生成模型在交通数据上的性能,提出基于图的新型指标和改进隐私指标,发现现有模型表现不及预期且合成与真实数据存在显著差距,强调需开发针对交通领域特征的生成模型。

摘要:

大规模交通数据的共享有利于交通规划和政策制定。然而,这也引发了重大的安全和隐私问题,因为数据可能包含可识别的个人信息,例如个人的家庭位置。为解决这些问题,基于真实交通数据的合成数据生成提供了一种有前景的解决方案,既能保护隐私又能潜在保留数据效用。尽管存在多种合成数据生成技术,但它们往往未针对交通数据的独特特征进行定制,例如数据集中所有出行形成的交通网络的固有结构。在本文中,我们以纽约市出租车数据为案例研究,对广泛使用的表格数据生成模型的性能进行系统性评估。除了分布相似性、覆盖率和隐私保护等传统指标外,我们还提出了一种专门针对交通数据的新型基于图的指标。该指标评估真实和合成交通网络之间的相似性,为它们的结构和功能对齐提供潜在的更深入见解。我们还引入了一种改进的隐私指标,以解决常用指标的局限性。我们的实验结果表明,现有的表格数据生成模型往往无法像文献中声称的那样持续表现良好,尤其是在应用于交通数据用例时。此外,我们的新型图指标揭示了合成数据与真实数据之间的显著差距。这项工作强调了开发专门定制的生成模型的潜在需求,以利用交通等新兴领域的独特特征。

英文摘要:

The sharing of large-scale transportation data is beneficial for transportation planning and policymaking. However, it also raises significant security and privacy concerns, as the data may include identifiable personal information, such as individuals' home locations. To address these concerns, synthetic data generation based on real transportation data offers a promising solution that allows privacy protection while potentially preserving data utility. Although there are various synthetic data generation techniques, they are often not tailored to the unique characteristics of transportation data, such as the inherent structure of transportation networks formed by all trips in the datasets. In this paper, we use New York City taxi data as a case study to conduct a systematic evaluation of the performance of widely used tabular data generative models. In addition to traditional metrics such as distribution similarity, coverage, and privacy preservation, we propose a novel graph-based metric tailored specifically for transportation data. This metric evaluates the similarity between real and synthetic transportation networks, providing potentially deeper insights into their structural and functional alignment. We also introduced an improved privacy metric to address the limitations of the commonly-used one. Our experimental results reveal that existing tabular data generative models often fail to perform as consistently as claimed in the literature, particularly when applied to transportation data use cases. Furthermore, our novel graph metric reveals a significant gap between synthetic and real data. This work underscores the potential need to develop generative models specifically tailored to take advantage of the unique characteristics of emerging domains, such as transportation.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑