arXivDaily arXiv每日学术速递 周一至周五更新
arXiv周末暂无论文更新,休息一下吧,周末愉快~~
arXiv 2312.14724cs.CVstat.ML
收藏

离散选择建模中的图像:应对多模态输入中的数据同构性

Images in Discrete Choice Modeling: Addressing Data Isomorphism in Multi-Modality Inputs

École Polytechnique Fédérale de Lausanne (EPFL)(洛桑联邦理工学院)

Brian Sifringer, Alexandre Alahi

AI总结:

本文研究离散选择模型中图像与表格数据的同构问题,提出架构调整与数据源缓解两种方法,实验表明后者更有效,以维护模型参数可解释性。

摘要:

本文探讨了离散选择建模(DCM)与机器学习的交叉领域,重点关注将图像数据整合到DCM的效用函数中及其对模型可解释性的影响。我们研究了在DCM框架内嵌入与传统的表格输入共享同构信息的高维图像数据所带来的后果。我们的研究揭示,当共现关系存在时,神经网络(NN)组件会从图像中学习并复制表格变量的表示,从而损害DCM参数的可解释性。我们提出并评估了两种应对这一挑战的方法:通过架构设计调整来隔离冗余信息,以及通过源信息掩码和修复来缓解同构信息。我们在一个半合成数据集上进行的实验表明,虽然架构修改的结果不明确,但在数据源直接进行缓解是维护DCM可解释参数完整性的更有效策略。本文最后总结了我们的发现在实际应用中的适用性,并讨论了对结合复杂数据模态的混合建模未来研究的影响。通过使用MIT道德机器数据集,我们实现了对表格和图像数据一致性的完全控制,并利用学习多项Logit(L-MNL)框架将两种输入合并到一个选择模型中。

英文摘要:

This paper explores the intersection of Discrete Choice Modeling (DCM) and machine learning, focusing on the integration of image data into DCM's utility functions and its impact on model interpretability. We investigate the consequences of embedding high-dimensional image data that shares isomorphic information with traditional tabular inputs within a DCM framework. Our study reveals that neural network (NN) components learn and replicate tabular variable representations from images when co-occurrences exist, thereby compromising the interpretability of DCM parameters. We propose and benchmark two methodologies to address this challenge: architectural design adjustments to segregate redundant information, and isomorphic information mitigation through source information masking and inpainting. Our experiments, conducted on a semi-synthetic dataset, demonstrate that while architectural modifications prove inconclusive, direct mitigation at the data source shows to be a more effective strategy in maintaining the integrity of DCM's interpretable parameters. The paper concludes with insights into the applicability of our findings in real-world settings and discusses the implications for future research in hybrid modeling that combines complex data modalities. Full control of tabular and image data congruence is attained by using the MIT moral machine dataset, and both inputs are merged into a choice model by deploying the Learning Multinomial Logit (L-MNL) framework.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑