arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2201.12626cs.CVcs.AI
收藏

行人过街预测器的跨数据集泛化评估

Assessing Cross-dataset Generalization of Pedestrian Crossing Predictors

Institut VEDECOM(VEDECOM研究所);MINES ParisTech(巴黎高等矿业学院);Université PSL(巴黎文理研究大学)

Joseph Gesnouin, Steve Pechberti, Bogdan Stanciulescu, Fabien Moutarde

摘要:

行人过街预测一直是一个活跃的研究课题,产生了许多新的算法解决方案。虽然随着时间的推移,由于新的公开基准和标准化评估程序,衡量这些解决方案的总体进展往往越来越成熟,但了解现有预测因素对未知数据的反应如何仍然是一个悬而未决的问题。这种评估是必要的,因为可用的交叉行为预测器应设置为在各种不同的交叉口工作,而不会由于预测错误而影响行人安全。为此,我们进行了一项基于直接跨数据集评估的研究。我们的实验表明,当前最先进的行人行为预测器在交叉数据集评估中的泛化能力很差,无论它们在直接训练测试集评估设置中的鲁棒性如何。根据我们的观察,我们认为行人过街预测的未来,例如可靠和可推广的实现,不应该是定制模型,用很少的可用数据进行训练,并在经典的火车测试场景中进行测试,并愿意推断他们在现实生活中的行为。它应该是关于在跨数据集环境中评估模型,同时考虑域转移下的不确定性估计。

英文摘要:

Pedestrian crossing prediction has been a topic of active research, resulting in many new algorithmic solutions. While measuring the overall progress of those solutions over time tends to be more and more established due to the new publicly available benchmark and standardized evaluation procedures, knowing how well existing predictors react to unseen data remains an unanswered question. This evaluation is imperative as serviceable crossing behavior predictors should be set to work in various scenarii without compromising pedestrian safety due to misprediction. To this end, we conduct a study based on direct cross-dataset evaluation. Our experiments show that current state-of-the-art pedestrian behavior predictors generalize poorly in cross-dataset evaluation scenarii, regardless of their robustness during a direct training-test set evaluation setting. In the light of what we observe, we argue that the future of pedestrian crossing prediction, e.g. reliable and generalizable implementations, should not be about tailoring models, trained with very little available data, and tested in a classical train-test scenario with the will to infer anything about their behavior in real life. It should be about evaluating models in a cross-dataset setting while considering their uncertainty estimates under domain shift.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑