arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2203.03057cs.CVcs.LGcs.RO
收藏

社会-内隐:重新思考轨迹预测评估和隐式最大似然估计的有效性

Social-Implicit: Rethinking Trajectory Prediction Evaluation and The Effectiveness of Implicit Maximum Likelihood Estimation

The University of Texas at Austin(德克萨斯大学奥斯汀分校);KAUST(阿卜杜拉国王科技大学)

Abduallah Mohamed, Deyao Zhu, Warren Vu, Mohamed Elhoseiny, Christian Claudel

摘要:

N次最佳(BoN)平均位移误差(ADE)/最终位移误差(FDE)是用于评估轨迹预测模型的最常用指标。然而,BoN没有量化整个生成的样本,导致对模型的预测质量和性能的不完整看法。我们提出了一个新的度量,平均马氏距离(AMD)来解决这个问题。AMD是量化整个生成的样本与地面实况的接近程度的度量。我们还引入了平均最大特征值(AMV)度量,该度量量化了预测的总体分布。我们的指标进行了验证经验表明,ADE/FDE是不敏感的分布偏移,给出了一个有偏见的准确性,不像AMD/AMV指标。我们介绍了使用隐式最大似然估计(IMLE)作为传统的生成模型的替代训练我们的模型,社会隐式。IMLE训练机制与AMD/AMV的目标一致,即预测接近地面实况的轨迹,并具有紧密的分布。Social-Implicit是一个内存高效的深度模型,只有5.8K个参数,实时的运行约580 Hz,并取得了有竞争力的结果。这个问题的交互式演示可以在https://www.abduallahmohamed.com/social-implicit-amdamv-adefde-demo上看到。代码可在https://github.com/abduallahmohamed/Social-Implicit上获得。

英文摘要:

Best-of-N (BoN) Average Displacement Error (ADE)/ Final Displacement Error (FDE) is the most used metric for evaluating trajectory prediction models. Yet, the BoN does not quantify the whole generated samples, resulting in an incomplete view of the model's prediction quality and performance. We propose a new metric, Average Mahalanobis Distance (AMD) to tackle this issue. AMD is a metric that quantifies how close the whole generated samples are to the ground truth. We also introduce the Average Maximum Eigenvalue (AMV) metric that quantifies the overall spread of the predictions. Our metrics are validated empirically by showing that the ADE/FDE is not sensitive to distribution shifts, giving a biased sense of accuracy, unlike the AMD/AMV metrics. We introduce the usage of Implicit Maximum Likelihood Estimation (IMLE) as a replacement for traditional generative models to train our model, Social-Implicit. IMLE training mechanism aligns with AMD/AMV objective of predicting trajectories that are close to the ground truth with a tight spread. Social-Implicit is a memory efficient deep model with only 5.8K parameters that runs in real time of about 580Hz and achieves competitive results. Interactive demo of the problem can be seen at https://www.abduallahmohamed.com/social-implicit-amdamv-adefde-demo . Code is available at https://github.com/abduallahmohamed/Social-Implicit .

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑