群体合成中罕见特征组合的预测:深度生成建模的应用
Prediction of rare feature combinations in population synthesis: Application of deep generative modelling
摘要:
在群体综合应用中,当考虑具有多个属性的群体时,一个基本问题是估计特征属性的稀有组合。毫不奇怪,要可靠地表示这种多变量分布的稀疏区域,特别是原始样本中不存在的属性组合,是非常困难的。在文献中,这通常被称为采样零点,迄今为止还没有提出系统的解决方案。本文提出了两种来自深度生成模型家族的机器学习算法,用于解决人口合成问题,并特别关注采样零的问题。具体来说,我们引入了Wasserstein生成对抗网络(WGAN)和变分自动编码器(VAE),并将这些算法用于大规模人口合成应用。该模型实现了丹麦旅游调查的功能空间超过60个变量。该模型进行了验证,在交叉验证计划和一组新的指标的抽样零问题的评估。结果表明,这些模型是如何能够恢复采样零点,同时保持真正不可能的组合,结构零点,在一个相对较低的水平估计。特别地,对于低维实验,VAE,边际采样器和完全随机采样器分别产生5%,21%和26%,更多的结构零点由WGAN产生,而对于高维情况下,这些数字分别上升到44%,2217%和170440%。这项研究直接支持基于代理的系统的开发,特别是在需要详细的社会经济或地理代表性的情况下。
英文摘要:
In population synthesis applications, when considering populations with many attributes, a fundamental problem is the estimation of rare combinations of feature attributes. Unsurprisingly, it is notably more difficult to reliably representthe sparser regions of such multivariate distributions and in particular combinations of attributes which are absent from the original sample. In the literature this is commonly known as sampling zeros for which no systematic solution has been proposed so far. In this paper, two machine learning algorithms, from the family of deep generative models,are proposed for the problem of population synthesis and with particular attention to the problem of sampling zeros. Specifically, we introduce the Wasserstein Generative Adversarial Network (WGAN) and the Variational Autoencoder(VAE), and adapt these algorithms for a large-scale population synthesis application. The models are implemented on a Danish travel survey with a feature-space of more than 60 variables. The models are validated in a cross-validation scheme and a set of new metrics for the evaluation of the sampling-zero problem is proposed. Results show how these models are able to recover sampling zeros while keeping the estimation of truly impossible combinations, the structural zeros, at a comparatively low level. Particularly, for a low dimensional experiment, the VAE, the marginal sampler and the fully random sampler generate 5%, 21% and 26%, respectively, more structural zeros per sampling zero generated by the WGAN, while for a high dimensional case, these figures escalate to 44%, 2217% and 170440%, respectively. This research directly supports the development of agent-based systems and in particular cases where detailed socio-economic or geographical representations are required.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。