Haptic guidance in a shared steering assistance system has drawn significant attention in intelligent vehicle fields, owing to its mutual communication ability for vehicle control. By exerting continuous torque on the steering wheel, both the driver and support system can share lateral control of the vehicle. However, current haptic guidance steering systems demonstrate some deficiencies in assisting lane changing. This study explored a new steering interaction method, including the design and evaluation of an intention-based haptic shared steering system. Such an intention-based method can support both lane keeping and lane changing assistance, by detecting a driver lane change intention. By using a deep learning-based method to model a driver decision timing regarding lane crossing, an adaptive gain control method was proposed for realizing a steering control system. An intention consistency method was proposed to detect whether the driver and the system were acting towards the same target trajectories and to accurately capture the driver intention. A driving simulator experiment was conducted to test the system performance. Participants were required to perform six trials with assistive methods and one trial without assistance. The results demonstrated that the supporting system decreased the lane departure risk in the lane keeping tasks and could support a fast and stable lane changing maneuver.
Haptic shared control is expected to achieve a smooth collaboration between humans and automated systems, because haptics facilitate mutual communication. A methodology for sharing a given task is important to achieve effective shared control. Therefore, the appropriate cooperative relationship between a human operator and automated system should be considered. This paper proposes a methodology to evaluate the cooperative status between the operator and the automated system in the haptic shared control of a steering operation using a pseudo-power pair of torque from each agent and the vehicle …
Corpy & Co., Inc.（Corpy公司）；The University of Tokyo（东京大学）
Driver distraction is a well-known cause for traffic collisions worldwide. Studies have indicated that shared steering control, which actively provides haptic guidance torque on the steering wheel, effectively improves the performance of distracted drivers. Recently, adaptive shared steering control based on the physiological status of the driver has been developed, although its effect on distracted driver behavior remains unclear. To this end, a high-fidelity driving simulator experiment was conducted involving 18 participants performing double lane changes. The experimental conditions compri…
University of North Carolina at Charlotte（北卡罗来纳大学夏洛特分校）；University of Michigan（密歇根大学）
Communication and cooperation among team members can be enhanced significantly with physical interaction. Successful collaboration requires the integration of the individual partners' intentions into a shared action plan, which may involve a continuous negotiation of intentions and roles. This paper presents an adaptive haptic shared control framework wherein a human driver and an automation system are physically connected through a motorized steering wheel. By virtue of haptic feedback, the driver and automation system can monitor each other actions and can still intuitively express their con…
Technical University of Munich（慕尼黑工业大学）；Imperial College London（帝国理工学院）；University of Bayreuth（拜罗伊特大学）
Intuitive and efficient physical human-robot collaboration relies on the mutual observability of the human and the robot, i.e. the two entities being able to interpret each other's intentions and actions. This is remedied by a myriad of methods involving human sensing or intention decoding, as well as human-robot turn-taking and sequential task planning. However, the physical interaction establishes a rich channel of communication through forces, torques and haptics in general, which is often overlooked in industrial implementations of human-robot interaction. In this work, we investigate the …
Lane-change is a fundamental driving behavior and highly associated with various types of collisions, such as rear-end collisions, sideswipe collisions, and angle collisions and the increased risk of a traffic crash. This study investigates effectiveness of different features categories combination in lane-changing intention prediction. Studies related to lane-changing intention prediction have been selected followed by strict standards. Then the meta-analysis was employed to not only evaluate the effectiveness of different features categories combination in lane-changing intention but also ca…
The thesis presents contributions made to the evaluation and design of a haptic guidance system on improving driving performance in cases of normal and degraded visual information, which are based on behavior experiments, modeling and numerical simulations. The effect of shared control on driver behavior in cases of normal and degraded visual information has been successfully evaluated experimentally and numerically. The evaluation results indicate that the proposed haptic guidance system is capable of providing reliable haptic information, and is effective on improving lane following performa…
Institute of Industrial Science, The University of Tokyo（东京大学工业科学研究所）；Technical University of Darmstadt（达姆施塔特工业大学）
Shared steering control has been developed to reduce driver workload while keeping the driver in the control loop. A driver could integrate visual sensory information from the road ahead and haptic sensory information from the steering wheel to achieve better driving performance. Previous studies suggest that, compared with adaptive automation authority, fixed automation authority is not always appropriate with respect to human factors. This paper focuses on designing an adaptive shared steering control system via sEMG (surface electromyography) measurement from the forearm of the driver, and …
This paper proposes a framework to recognize driving intentions and to predict driving behaviors of lane changing on the highway by using externally sensable traffic data from the host-vehicle. The framework consists of a driving characteristic estimator and a driving behavior predictor. A driver's implicit driving characteristic information is uniquely determined and detected by proposed the online-estimator. Neural-network based behavior predictor is developed and validated by testing with the real naturalistic traffic data from Next Generation Simulation (NGSIM), which demonstrates the effe…
Institute of Industrial Science, The University of Tokyo（东京大学生产技术研究所）
For the optimum design of a driver-automation shared control system, an understanding of driver behavior based on measurements and modeling is crucial early in the development process. This paper presents a driver model through a weighting process of visual guidance from the road ahead and haptic guidance from a steering system for a lane-following task. The proposed weighting process describes the interaction of a driver with the haptic guidance steering and the driver reliance on it. A driving simulator experiment is conducted to identify the model parameters for driving manually and with ha…
An Intention-driven Lane Change Framework Considering Heterogeneous Dynamic Cooperation in Mixed-traffic Environment
Intelligent Transportation Thrust, Systems Hub, The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）智能交通研究所，系统中心）；Guangdong Provincial Key Lab of Integrated Communication, Sensing and Computation for Ubiquitous Internet of Things（广东省集成通信、感知与计算 ubiquitous internet of things 关键实验室）；Robotics and Autonomous Systems Thrust, Systems Hub, The Hong Kong University of Science and Technology (Guangzhou)（香港科学与技术大学（广州）机器人与自主系统研究所）
Machine Learning-Based Vehicle Intention Trajectory Recognition and Prediction for Autonomous Driving
University of Southern California（南加州大学）；Virginia Tech（弗吉尼亚理工大学）；Miami University（迈阿密大学）；Northern Arizona University（北亚利桑那大学）；Northeastern University（东北大学）
Haptic feedback is an important component of creating an immersive mixed reality experience. Traditionally, haptic forces are rendered in response to the user's interactions with the virtual environment. In this work, we explore the idea of rendering haptic forces in a proactive manner, with the explicit intention to influence the user's behavior through compelling haptic forces. To this end, we present a framework for active haptic guidance in mixed reality, using one or more robotic haptic proxies to influence user behavior and deliver a safer and more immersive virtual experience. We provid…
The ability to estimate human intentions and interact with human drivers intelligently is crucial for autonomous vehicles to successfully achieve their objectives. In this paper, we propose a game theoretic planning algorithm that models human opponents with an iterative reasoning framework and estimates human latent cognitive states through probabilistic inference and active learning. By modeling the interaction as a partially observable Markov decision process with adaptive state and action spaces, our algorithm is able to accomplish real-time lane changing tasks in a realistic driving simul…
Socially-Aware Autonomous Driving: Inferring Yielding Intentions for Safer Interactions
School of Mechanical and Aerospace Engineering, Queen’s University Belfast（女王大学贝尔法斯特机械与航空航天工程学院）；Department of Mechanical and Industrial Engineering, Concordia University（Concordia大学机械与工业工程系）；State Key Laboratory of Advanced Design and Manufacturing Technology for Vehicle, College of Mechanical and Vehicle Engineering, Hunan University（湖南大学车辆先进设计与制造技术国家重点实验室，机械与车辆工程学院）；James Watt School of Engineering, University of Glasgow（格拉斯哥大学詹姆斯·瓦特工程学院）
The recently advanced robotics technology enables robots to assist users in their daily lives. Haptic guidance (HG) improves users' task performance through physical interaction between robots and users. It can be classified into optimal action-based HG (OAHG), which assists users with an optimal action, and user prediction-based HG (UPHG), which assists users with their next predicted action. This study aims to understand the difference between OAHG and UPHG and propose a combined HG (CombHG) that achieves optimal performance by complementing each HG type, which has important implications for…
Accurately forecasting the future movements of surrounding vehicles is essential for safe and efficient operations of autonomous driving cars. This task is difficult because a vehicle's moving trajectory is greatly determined by its driver's intention, which is often hard to estimate. By leveraging attention mechanisms along with long short-term memory (LSTM) networks, this work learns the relation between a driver's intention and the vehicle's changing positions relative to road infrastructures, and uses it to guide the prediction. Different from other state-of-the-art solutions, our work tre…
Rendering accurate multisensory feedback is critical to ensure natural user behavior in driving simulators. In this work, we present a virtual reality (VR)-based Vehicle-in-the-Loop (ViL) simulator that provides visual, vestibular, and haptic feedback to drivers in high speed driving conditions. Designing our simulator around a four-wheel steer-by-wire vehicle enables us to emulate the dynamics of a vehicle traveling significantly faster than the test vehicle and to transmit corresponding haptic steering feedback to the driver. By scaling the speed of the test vehicle through a combination of …
Linking Behaviour and Perception to Evaluate Meaningful Human Control over Partially Automated Driving
Centre for Meaningful Human Control（有意义的人控中心）；Department of Cognitive Robotics（认知机器人学系）；Department of Transport & Planning（交通与规划系）；Department of Intelligent Systems（智能系统系）；Delft University of Technology（代尔夫特理工大学）
For autonomous vehicles integrating onto roadways with human traffic participants, it requires understanding and adapting to the participants' intention and driving styles by responding in predictable ways without explicit communication. This paper proposes a reinforcement learning based negotiation-aware motion planning framework, which adopts RL to adjust the driving style of the planner by dynamically modifying the prediction horizon length of the motion planner in real time adaptively w.r.t the event of a change in environment, typically triggered by traffic participants' switch of intents…
University of Surrey（萨里大学）；University of Warwick（华威大学）；Warwick Manufacturing Group（华威制造集团）
Autonomous driving decision-making is a challenging task due to the inherent complexity and uncertainty in traffic. For example, adjacent vehicles may change their lane or overtake at any time to pass a slow vehicle or to help traffic flow. Anticipating the intention of surrounding vehicles, estimating their future states and integrating them into the decision-making process of an automated vehicle can enhance the reliability of autonomous driving in complex driving scenarios. This paper proposes a Prediction-based Deep Reinforcement Learning (PDRL) decision-making model that considers the man…
This paper addresses the shared lateral control for both lane-keeping and obstacle avoidance tasks of a driver steering assist system (DSAS). In this work, we propose a novel approach to deal with the interactions between the human (driver) and the machine (DSAS) by introducing into the vehicle system a fictive nonlinear term representing the driver activity. In this way, the actions of the DSAS are computed according to the driver behaviors (actions and intentions). Based on Takagi-Sugeno control technique together with Lyapunov stability tools, the designed controller is able to handle a lar…
University of Oxford（牛津大学）；Umeå University（于默奥大学）；University of Nottingham（诺丁汉大学）；Oxford Robotics Institute（牛津机器人研究所）
In commentary driving, drivers verbalise their observations, assessments and intentions. By speaking out their thoughts, both learning and expert drivers are able to create a better understanding and awareness of their surroundings. In the intelligent vehicle context, automated driving commentary can provide intelligible explanations about driving actions, thereby assisting a driver or an end-user during driving operations in challenging and safety-critical scenarios. In this paper, we conducted a field study in which we deployed a research vehicle in an urban environment to obtain data. While…
Pride and Prejudice: Toward an Information-Theoretic Framework for Mutually Communicative Driver Behavior Modeling
State Key Laboratory of Automotive Chassis Integration and Bionics, Jilin University（吉林大学汽车底盘集成与仿生国家重点实验室）；Beijing National Research Center for Information Science and Technology, Tsinghua University（清华大学北京信息科学与技术国家研究中心）；Department of Engineering, Brock University（布鲁克大学工程系）；Department of Automatics, Federal University of Lavras（拉夫拉斯联邦大学自动化系）
