S2O:一种连接主观感受与客观评价的集成式驾驶决策性能评估方法
S2O: An Integrated Driving Decision-making Performance Evaluation Method Bridging Subjective Feeling to Objective Evaluation
AI总结:
提出 S2O 集成驾驶决策评估方法,通过修正安全、效率等基础模型并结合分段线性拟合与 SVM 分类器,将主观感受转化为客观评价,在 D2E 数据集上误差降低 32.55%。
摘要:
自动驾驶决策是迈向智能交通系统的关键模块之一,如何全面且精确地评估驾驶性能是一项重大挑战。有偏差的评估会误导并阻碍决策的修改与开发。当前的规划评估指标包括偏离真实驾驶员轨迹的程度以及客观驾驶体验指标。前一类指标并不一定能表明良好的驾驶性能,因为人类驾驶员也会犯错,且已被证明在交互式闭环系统中是无效的。另一方面,现有的客观驾驶体验模型仅考虑有限的因素,缺乏全面性。并且各种因素的整合机制依赖于直观经验,缺乏精确性。在本研究中,我们提出了 S2O,一种连接主观人类感受与客观评价的新型集成决策评估方法。首先,建立了安全、时间效率、舒适度和能效这四种驾驶因素的修正基础模型,以涵盖常见的驾驶因素。然后基于对人类评分分布规律的分析,设计了一个分段线性拟合模型结合互补的 SVM 分段分类器,以通过客观驾驶因素项来表达人类的主观评分。实验在 D2E 数据集上进行,该数据集包含约 1,000 个驾驶案例和 40,000 个人类评分。结果显示,在百分比尺度下,S2O 相对真实值的平均绝对误差为 4.58。与基线相比,评估误差降低了 32.55%。在 SUMO 平台上的实现证明了在线评估的实时效率,对三种自动驾驶规划算法的性能评估验证证明了其可行性。
英文摘要:
Autonomous driving decision-making is one of the critical modules towards intelligent transportation systems, and how to evaluate the driving performance comprehensively and precisely is a crucial challenge. A biased evaluation misleads and hinders decision-making modification and development. Current planning evaluation metrics include deviation from the real driver trajectory and objective driving experience indicators. The former category does not necessarily indicate good driving performance since human drivers also make errors and has been proven to be ineffective in interactive close-loop systems. On the other hand, existing objective driving experience models only consider limited factors, lacking comprehensiveness. And the integration mechanism of various factors relies on intuitive experience, lacking precision. In this research, we propose S2O, a novel integrated decision-making evaluation method bridging subjective human feeling to objective evaluation. First, modified fundamental models of four kinds of driving factors which are safety, time efficiency, comfort, and energy efficiency are established to cover common driving factors. Then based on the analysis of human rating distribution regularity, a segmental linear fitting model in conjunction with a complementary SVM segment classifier is designed to express human's subjective rating by objective driving factor terms. Experiments are conducted on the D2E dataset, which includes approximately 1,000 driving cases and 40,000 human rating scores. Results show that S2O achieves a mean absolute error of 4.58 to ground truth under a percentage scale. Compared with baselines, the evaluation error is reduced by 32.55%. Implementation on the SUMO platform proves the real-time efficiency of online evaluation, and validation on performance evaluation of three autonomous driving planning algorithms proves the feasibility.
机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。