arXivDaily arXiv每日学术速递 周一至周五更新
​通知:联邦节假日调休:哥伦布日 / 原住民日(Columbus Day / Indigenous Peoples' Day),今日(13日)无更新。
arXiv 2507.21432cs.CLcs.AI

面向出行方式选择行为的本地可部署微调因果大语言模型

Towards Locally Deployable Fine-Tuned Causal Large Language Models for Mode Choice Behaviour

Laboratory of Innovations in Transportation (LiTrans), Toronto Metropolitan University, Canada(交通创新实验室(LiTrans)、多伦多 Metropolitan 大学)

Tareq Alsaleh, Bilal Farooq

AI总结:

本研究提出LiTransMC,首个本地可部署的微调因果大语言模型,用于出行方式选择预测,在准确性和分布校准上超越专有模型及经典方法,实现预测与可解释性的结合。

摘要:

本研究探讨了采用开放获取、本地可部署的因果大语言模型(LLMs)进行出行方式选择预测,并介绍了LiTransMC,这是首个为此任务开发的微调因果大语言模型。我们系统性地在三个陈述偏好和显示偏好数据集上对十一个开放获取的大语言模型(参数规模1B至12B)进行了基准测试,测试了396种配置,生成了超过79,000个出行方式选择决策。除了预测准确性,我们还使用BERTopic进行主题建模和一种新颖的解释强度指数来评估模型生成的推理,首次提供了关于LLMs如何根据行为理论阐述决策因素的结构化分析。LiTransMC采用参数高效和损失掩蔽策略进行微调,取得了0.6845的加权F1分数和0.000245的詹森-香农散度,超越了未调优的本地模型和更大的专有系统(包括具有高级人物推断和基于嵌入加载的GPT-4o),同时在同一数据集上优于离散选择模型和机器学习分类器等经典出行方式选择方法。这种双重改进,即高瞬时准确率和近乎完美的分布校准,证明了创建集预测与可解释性于一体的专业化、本地可部署LLMs的可行性。通过将结构化行为预测与自然语言推理相结合,这项工作释放了对话式、多任务交通模型的潜力,能够支持基于智能体的模拟、政策测试和行为洞察生成。这些发现为将通用LLMs转化为交通研究和政策制定的专业化、可解释工具开辟了道路,同时通过本地部署维护隐私、降低成本并扩大访问范围。

英文摘要:

This study investigates the adoption of open-access, locally deployable causal large language models (LLMs) for travel mode choice prediction and introduces LiTransMC, the first fine-tuned causal LLM developed for this task. We systematically benchmark eleven open-access LLMs (1-12B parameters) across three stated and revealed preference datasets, testing 396 configurations and generating over 79,000 mode choice decisions. Beyond predictive accuracy, we evaluate models generated reasoning using BERTopic for topic modelling and a novel Explanation Strength Index, providing the first structured analysis of how LLMs articulate decision factors in alignment with behavioural theory. LiTransMC, fine-tuned using parameter efficient and loss masking strategy, achieved a weighted F1 score of 0.6845 and a Jensen-Shannon Divergence of 0.000245, surpassing both untuned local models and larger proprietary systems, including GPT-4o with advanced persona inference and embedding-based loading, while also outperforming classical mode choice methods such as discrete choice models and machine learning classifiers for the same dataset. This dual improvement, i.e., high instant-level accuracy and near-perfect distributional calibration, demonstrates the feasibility of creating specialist, locally deployable LLMs that integrate prediction and interpretability. Through combining structured behavioural prediction with natural language reasoning, this work unlocks the potential for conversational, multi-task transport models capable of supporting agent-based simulations, policy testing, and behavioural insight generation. These findings establish a pathway for transforming general purpose LLMs into specialized and explainable tools for transportation research and policy formulation, while maintaining privacy, reducing cost, and broadening access through local deployment.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑