arXivDaily arXiv每日学术速递 周一至周五更新
arXiv 2104.13889cs.HC
收藏

通过智能可穿戴设备检测驾驶员状态和行为

Driver State and Behavior Detection Through Smart Wearables

Arash Tavakoli, Shashwat Kumar, Mehdi Boukhechba, Arsalan Heydarian

摘要:

将驾驶员、车内和外部环境的情境线索整合到车辆的决策中是半自动车辆安全的核心。已经开发了多个系统用于向车辆提供背景,这些系统通常依赖于捕获驾驶员的身体和环境状态的视频流。虽然视频流是丰富的信息源,但是它们提供上下文的能力在某些情况下可能是具有挑战性的,诸如低照度环境(例如,夜间驾驶),并且它们具有高度的隐私侵入性。在这项研究中,我们通过智能手表利用被动传感对驾驶环境的元素进行分类。具体来说,通过使用从自然驾驶研究中的15名参与者收集的数据,并通过使用随机森林等多种机器学习算法,我们对驾驶员的活动进行分类(例如,使用电话和吃饭),外部事件(例如,通过交叉路口和改变车道),以及外部道路属性(例如,在城市中驾驶与在高速公路上驾驶),通过10倍交叉验证,平均F1得分分别为94.55、98.27和97.86%。我们的研究结果显示了通过智能可穿戴设备检索的多模态数据在现实驾驶场景中提供上下文的适用性,并为未来自动驾驶汽车更好地共享自主性和隐私感知驾驶数据收集,分析和反馈铺平了道路。

英文摘要:

Integrating driver, in-cabin, and outside environment's contextual cues into the vehicle's decision making is the centerpiece of semi-automated vehicle safety. Multiple systems have been developed for providing context to the vehicle, which often rely on video streams capturing drivers' physical and environmental states. While video streams are a rich source of information, their ability in providing context can be challenging in certain situations, such as low illuminance environments (e.g., night driving), and they are highly privacy-intrusive. In this study, we leverage passive sensing through smartwatches for classifying elements of driving context. Specifically, through using the data collected from 15 participants in a naturalistic driving study, and by using multiple machine learning algorithms such as random forest, we classify driver's activities (e.g., using phone and eating), outside events (e.g., passing intersection and changing lane), and outside road attributes (e.g., driving in a city versus a highway) with an average F1 score of 94.55, 98.27, and 97.86 % respectively, through 10-fold cross-validation. Our results show the applicability of multimodal data retrieved through smart wearable devices in providing context in real-world driving scenarios and pave the way for a better shared autonomy and privacy-aware driving data-collection, analysis, and feedback for future autonomous vehicles.

机构、总结、中文摘要均由AI分析而来,可能存在错误,请以论文正文为准。

↑