基于情景记忆植入NDT的车辆行为预测
Vehicle Behavior Prediction by Episodic-Memory Implanted NDT
AI总结:
提出情景记忆植入神经决策树eMem-NDT,通过层次聚类和记忆原型匹配实现可解释的车辆行为预测,在BLVD和LOKI数据集上取得优于其他方法的性能。
摘要:
在自动驾驶中,预测目标车辆的行为(左转、停车等)对于自动驾驶车辆做出安全决策和避免事故至关重要。现有的基于深度学习的方法表现出了出色且准确的性能,但其黑盒性质使得在实际应用中难以令人信任。在本研究中,我们通过情景记忆植入神经决策树(Episodic Memory implanted Neural Decision Tree,缩写为eMem-NDT)探索目标车辆行为预测的可解释性。eMem-NDT的结构是通过对车辆行为描述的文本嵌入进行层次聚类来构建的。eMem-NDT是预训练深度学习模型的神经支撑部分,通过将深度模型的soft-max层替换为eMem-NDT,在神经决策树上对训练数据中历史车辆行为特征的记忆原型进行分组和对齐。eMem-NDT的每个叶节点由神经网络建模,用于对齐行为记忆原型。通过eMem-NDT,我们利用自下而上的记忆原型匹配(Memory Prototype Matching,MPM)(搜索合适的叶节点及其到根节点的链接)和自上而下的叶链接聚合(Leaf Link Aggregation,LLA)(获取特定实例下车辆未来行为的概率)来推断车辆行为预测中的每个实例。我们在BLVD和LOKI数据集上验证了eMem-NDT,结果表明我们的模型在具有清晰可解释性的同时,能够获得优于其他方法的性能。代码可在https://github.com/JWFangit/eMem-NDT获取。
英文摘要:
In autonomous driving, predicting the behavior (turning left, stopping, etc.) of target vehicles is crucial for the self-driving vehicle to make safe decisions and avoid accidents. Existing deep learning-based methods have shown excellent and accurate performance, but the black-box nature makes it untrustworthy to apply them in practical use. In this work, we explore the interpretability of behavior prediction of target vehicles by an Episodic Memory implanted Neural Decision Tree (abbrev. eMem-NDT). The structure of eMem-NDT is constructed by hierarchically clustering the text embedding of vehicle behavior descriptions. eMem-NDT is a neural-backed part of a pre-trained deep learning model by changing the soft-max layer of the deep model to eMem-NDT, for grouping and aligning the memory prototypes of the historical vehicle behavior features in training data on a neural decision tree. Each leaf node of eMem-NDT is modeled by a neural network for aligning the behavior memory prototypes. By eMem-NDT, we infer each instance in behavior prediction of vehicles by bottom-up Memory Prototype Matching (MPM) (searching the appropriate leaf node and the links to the root node) and top-down Leaf Link Aggregation (LLA) (obtaining the probability of future behaviors of vehicles for certain instances). We validate eMem-NDT on BLVD and LOKI datasets, and the results show that our model can obtain a superior performance to other methods with clear explainability. The code is available at https://github.com/JWFangit/eMem-NDT.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。