arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2101.12252econ.EMcs.LG
收藏

高斯过程潜类别选择模型

Gaussian Process Latent Class Choice Models

American University of Beirut(贝鲁特美国大学);DTU Technical University of Denmark(丹麦技术大学)

Georges Sfeir, Filipe Rodrigues, Maya Abou-Zeid

AI总结:

提出高斯过程-潜类别选择模型(GP-LCCM),通过EM算法联合估计参数,在保持可解释性的同时更灵活地表示异质性,提升了预测能力。

摘要:

我们提出了一种高斯过程-潜类别选择模型(GP-LCCM),将非参数类的概率机器学习整合到离散选择模型(DCMs)中。高斯过程是基于核的算法,通过对潜在函数而非参数假设先验来结合专家知识,使其在处理非线性问题时更加灵活。通过在LCCM结构中整合高斯过程,我们旨在改善未观测异质性的离散表示。所提出的模型使用GPs将个体概率性地分配到行为同质的聚类(潜类别)中,并同时依靠随机效用模型估计特定类别的选择模型。此外,我们推导并实现了期望最大化(EM)算法,分别依靠拉普拉斯近似和基于梯度的数值优化方法,联合估计/推断GP核函数的超参数和特定类别的选择参数。该模型在两个不同的方式选择应用中进行了测试,并与不同的LCCM基准进行了比较。结果表明,GP-LCCM允许更复杂和灵活的异质性表示,并改善了样本内拟合和样本外预测能力。此外,在特定类别的选择模型层面保持了行为和经济学上的可解释性,同时仍可实现潜类别的局部解释,尽管GPs的非参数特性降低了模型的透明度。

英文摘要:

We present a Gaussian Process - Latent Class Choice Model (GP-LCCM) to integrate a non-parametric class of probabilistic machine learning within discrete choice models (DCMs). Gaussian Processes (GPs) are kernel-based algorithms that incorporate expert knowledge by assuming priors over latent functions rather than priors over parameters, which makes them more flexible in addressing nonlinear problems. By integrating a Gaussian Process within a LCCM structure, we aim at improving discrete representations of unobserved heterogeneity. The proposed model would assign individuals probabilistically to behaviorally homogeneous clusters (latent classes) using GPs and simultaneously estimate class-specific choice models by relying on random utility models. Furthermore, we derive and implement an Expectation-Maximization (EM) algorithm to jointly estimate/infer the hyperparameters of the GP kernel function and the class-specific choice parameters by relying on a Laplace approximation and gradient-based numerical optimization methods, respectively. The model is tested on two different mode choice applications and compared against different LCCM benchmarks. Results show that GP-LCCM allows for a more complex and flexible representation of heterogeneity and improves both in-sample fit and out-of-sample predictive power. Moreover, behavioral and economic interpretability is maintained at the class-specific choice model level while local interpretation of the latent classes can still be achieved, although the non-parametric characteristic of GPs lessens the transparency of the model.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑