Modeling Drivers' Risk Perception via Attention to Improve Driving Assistance
0
Sign in to get full access
Overview
- The paper proposes a framework to model drivers' risk perception by analyzing their visual attention.
- This information can be used to improve driving assistance systems and make them more personalized.
- The model uses deep learning to predict drivers' risk perception from eye-tracking data and driving behavior.
Plain English Explanation
The researchers developed a system that aims to understand how drivers perceive risk on the road. They did this by tracking where drivers look (internal link) and how they respond to different driving situations.
The key idea is that by analyzing a driver's visual attention and behavior, the system can learn to predict how that driver perceives and responds to risk. This personalized risk model can then be used to improve driving assistance technologies, making them better tailored to individual drivers' needs and tendencies (internal link).
For example, if the system knows a driver tends to underestimate risk in certain scenarios, it could provide more proactive warnings or interventions to keep that driver safe (internal link). Overall, the goal is to create driving assistance that is responsive to each driver's unique risk perception.
Technical Explanation
The paper describes a deep learning model that predicts drivers' risk perception from eye-tracking data and driving behavior. The model takes in visual attention maps and vehicle dynamics as input, and outputs a risk score indicating the driver's level of perceived risk (internal link).
The authors conducted experiments where participants drove in a simulated environment while their eye movements and vehicle data were recorded. This dataset was used to train and evaluate the risk perception model. The results showed the model could accurately predict drivers' risk assessments based on their visual attention patterns and driving actions.
Critical Analysis
The paper provides a promising approach to modeling individual drivers' risk perception, which could lead to more personalized and responsive driving assistance systems. However, the research was conducted in a simulated environment, so further validation is needed to ensure the findings translate to real-world driving conditions.
Additionally, the paper does not deeply explore potential biases or limitations in the model. For example, the model may struggle to accurately capture risk perception for novice or distracted drivers, or in complex, rapidly changing traffic situations. Continued research is needed to address these challenges and refine the approach.
Conclusion
This research demonstrates the potential to leverage eye-tracking and driving behavior data to build personalized models of risk perception. By understanding how individual drivers perceive and respond to risk, driving assistance technologies can be designed to better support each user's needs and tendencies. While further work is needed, this study represents an important step towards more intelligent and adaptive driver support systems.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Modeling Drivers' Risk Perception via Attention to Improve Driving Assistance
Abhijat Biswas, John Gideon, Kimimasa Tamura, Guy Rosman
Advanced Driver Assistance Systems (ADAS) alert drivers during safety-critical scenarios but often provide superfluous alerts due to a lack of consideration for drivers' knowledge or scene awareness. Modeling these aspects together in a data-driven way is challenging due to the scarcity of critical scenario data with in-cabin driver state and world state recorded together. We explore the benefits of driver modeling in the context of Forward Collision Warning (FCW) systems. Working with real-world video dataset of on-road FCW deployments, we collect observers' subjective validity rating of the deployed alerts. We also annotate participants' gaze-to-objects and extract 3D trajectories of the ego vehicle and other vehicles semi-automatically. We generate a risk estimate of the scene and the drivers' perception in a two step process: First, we model the movement of vehicles in a given scenario as a joint trajectory forecasting problem. Then, we reason about the drivers' risk perception of the scene by counterfactually modifying the input to the forecasting model to represent the drivers' actual observations of vehicles in the scene. The difference in these behaviours gives us an estimate of driver behaviour that accounts for their actual (inattentive) observations and their downstream effect on overall scene risk. We compare both a learned scene representation as well as a more traditional ``worse-case'' deceleration model to achieve the future trajectory forecast. Our experiments show that using this risk formulation to generate FCW alerts may lead to improved false positive rate of FCWs and improved FCW timing.
Read more9/10/2024
👁️
0
Towards Context-Aware Modeling of Situation Awareness in Conditionally Automated Driving
Lilit Avetisyan, X. Jessie Yang, Feng Zhou
Maintaining adequate situation awareness (SA) is crucial for the safe operation of conditionally automated vehicles (AVs), which requires drivers to regain control during takeover (TOR) events. This study developed a predictive model for real-time assessment of driver SA using multimodal data (e.g., galvanic skin response, heart rate and eye tracking data, and driver characteristics) collected in a simulated driving environment. Sixty-seven participants experienced automated driving scenarios with TORs, with conditions varying in risk perception and the presence of automation errors. A LightGBM (Light Gradient Boosting Machine) model trained on the top 12 predictors identified by SHAP (SHapley Additive exPlanations) achieved promising performance with RMSE=0.89, MAE=0.71, and Corr=0.78. These findings have implications towards context-aware modeling of SA in conditionally automated driving, paving the way for safer and more seamless driver-AV interactions.
Read more5/14/2024
0
Hierarchical Learned Risk-Aware Planning Framework for Human Driving Modeling
Nathan Ludlow, Yiwei Lyu, John Dolan
This paper presents a novel approach to modeling human driving behavior, designed for use in evaluating autonomous vehicle control systems in a simulation environments. Our methodology leverages a hierarchical forward-looking, risk-aware estimation framework with learned parameters to generate human-like driving trajectories, accommodating multiple driver levels determined by model parameters. This approach is grounded in multimodal trajectory prediction, using a deep neural network with LSTM-based social pooling to predict the trajectories of surrounding vehicles. These trajectories are used to compute forward-looking risk assessments along the ego vehicle's path, guiding its navigation. Our method aims to replicate human driving behaviors by learning parameters that emulate human decision-making during driving. We ensure that our model exhibits robust generalization capabilities by conducting simulations, employing real-world driving data to validate the accuracy of our approach in modeling human behavior. The results reveal that our model effectively captures human behavior, showcasing its versatility in modeling human drivers in diverse highway scenarios.
Read more5/13/2024
🔮
0
Risk-Aware Vehicle Trajectory Prediction Under Safety-Critical Scenarios
Qingfan Wang, Dongyang Xu, Gaoyuan Kuang, Chen Lv, Shengbo Eben Li, Bingbing Nie
Trajectory prediction is significant for intelligent vehicles to achieve high-level autonomous driving, and a lot of relevant research achievements have been made recently. Despite the rapid development, most existing studies solely focused on normal safe scenarios while largely neglecting safety-critical scenarios, particularly those involving imminent collisions. This oversight may result in autonomous vehicles lacking the essential predictive ability in such situations, posing a significant threat to safety. To tackle these, this paper proposes a risk-aware trajectory prediction framework tailored to safety-critical scenarios. Leveraging distinctive hazardous features, we develop three core risk-aware components. First, we introduce a risk-incorporated scene encoder, which augments conventional encoders with quantitative risk information to achieve risk-aware encoding of hazardous scene contexts. Next, we incorporate endpoint-risk-combined intention queries as prediction priors in the decoder to ensure that the predicted multimodal trajectories cover both various spatial intentions and risk levels. Lastly, an auxiliary risk prediction task is implemented for the ultimate risk-aware prediction. Furthermore, to support model training and performance evaluation, we introduce a safety-critical trajectory prediction dataset and tailored evaluation metrics. We conduct comprehensive evaluations and compare our model with several SOTA models. Results demonstrate the superior performance of our model, with a significant improvement in most metrics. This prediction advancement enables autonomous vehicles to execute correct collision avoidance maneuvers under safety-critical scenarios, eventually enhancing road traffic safety.
Read more7/19/2024