Integrated Scenario-based Analysis: A data-driven approach to support automated driving systems development and safety evaluation
0
Sign in to get full access
Overview
- This paper presents an integrated scenario-based analysis approach to support the development and safety evaluation of automated driving systems (ADS).
- The approach leverages naturalistic driving datasets to systematically generate representative and diverse traffic scenarios for ADS testing and validation.
- The authors propose a data-driven methodology to identify critical traffic scenarios and assess the safety of the intended functionality (SOTIF) of ADS.
Plain English Explanation
The paper describes a new way to help develop and test self-driving car systems. The key idea is to use real-world driving data to create realistic traffic scenarios that can be used to evaluate the safety and performance of self-driving car technologies.
Automated driving systems (ADS) are the core technologies that power self-driving cars. These systems need to be thoroughly tested to ensure they can handle a wide range of driving situations safely.
Naturalistic driving datasets provide a rich source of real-world driving data that can be used to create representative traffic scenarios. The authors propose a data-driven method to analyze this data and identify critical traffic situations that pose challenges for ADS.
By generating interactive traffic scenarios based on the identified critical situations, the researchers can systematically test the safety of the intended functionality (SOTIF) of ADS. This helps ensure the self-driving systems can handle a diverse range of real-world driving conditions safely.
Technical Explanation
The paper presents an integrated scenario-based analysis approach to support the development and safety evaluation of automated driving systems (ADS). The key elements of the approach include:
-
Naturalistic Driving Data Analysis: The researchers leverage naturalistic driving datasets to systematically identify critical traffic scenarios that pose challenges for ADS.
-
Scenario Generation: Based on the identified critical scenarios, the authors propose a data-driven methodology to generate representative and diverse traffic scenarios for ADS testing and validation.
-
Safety of the Intended Functionality (SOTIF) Assessment: The generated scenarios are used to assess the safety of the intended functionality (SOTIF) of ADS, ensuring they can handle a wide range of real-world driving conditions.
The integrated approach leverages statistical modeling techniques to analyze naturalistic driving data and systematically generate representative traffic scenarios for comprehensive ADS testing and evaluation.
Critical Analysis
The paper presents a comprehensive and data-driven approach to support the development and safety assessment of automated driving systems. The authors acknowledge the limitations of existing scenario-based testing methods and propose an integrated framework that addresses these shortcomings.
One potential limitation of the approach is the reliance on naturalistic driving datasets, which may not capture the full diversity of traffic scenarios that ADS may encounter in real-world deployment. The authors mention the need to complement the data-driven scenario generation with expert domain knowledge and additional data sources to ensure the completeness of the testing process.
Furthermore, the paper does not provide a detailed discussion of the specific algorithms and techniques used for scenario generation and SOTIF assessment. Additional information on the implementation details and the validation of the proposed methods would be beneficial for researchers and practitioners interested in replicating or building upon this work.
Overall, the integrated scenario-based analysis approach presented in this paper offers a promising direction for supporting the development and safety evaluation of automated driving systems. The authors' emphasis on leveraging naturalistic driving data and systematically generating representative traffic scenarios is a valuable contribution to the field.
Conclusion
This paper introduces an integrated scenario-based analysis approach to support the development and safety evaluation of automated driving systems (ADS). By leveraging naturalistic driving datasets and employing data-driven techniques, the authors propose a comprehensive methodology to identify critical traffic scenarios, generate representative and diverse scenarios, and assess the safety of the intended functionality (SOTIF) of ADS.
This integrated approach has the potential to significantly enhance the development and safety evaluation of self-driving car technologies, ensuring they can reliably and safely navigate a wide range of real-world driving conditions. The authors' emphasis on data-driven methods and systematic scenario generation represents an important step forward in the field of automated driving systems.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Integrated Scenario-based Analysis: A data-driven approach to support automated driving systems development and safety evaluation
Gibran Ali, Kaye Sullivan, Eileen Herbers, Vicki Williams, Dustin Holley, Jacobo Antona-Makoshi, Kevin Kefauver
Several scenario-based frameworks exist to aid in vehicle system development and safety assurance. However, there is a need for approaches that combine different types of datasets that offer varying levels of case severity, data richness, and representativeness. This study presents an integrated scenario-based analysis approach that encompasses scenario definition, fusion, parametrization, and test case generation. For this process, ten years of fatal and non-fatal national crash data from the United States are combined with over 34 million miles of naturalistic driving data. An illustrative example scenario, turns at intersection, is chosen to demonstrate this approach. First, scenario definitions are established from both record-based and continuous time series data. Second, a frequency analysis is performed to understand how often events from the same scenario occur at different severities across datasets. Third, an analysis is performed to show the key factors relevant to the scenario and the distribution of various parameters. Finally, a method to combine both types of data into representative test case scenarios is presented. These techniques improve scenario representativeness in two major ways: first, they populate an entire spectrum of cases ranging from routine events to fatal crashes; and second, they provide context-rich, multi-year data by combining large-scale national and naturalistic datasets.
Read more7/30/2024
0
An Approach to Systematic Data Acquisition and Data-Driven Simulation for the Safety Testing of Automated Driving Functions
Leon Eisemann, Mirjam Fehling-Kaschek, Henrik Gommel, David Hermann, Marvin Klemp, Martin Lauer, Benjamin Lickert, Florian Luettner, Robin Moss, Nicole Neis, Maria Pohle, Simon Romanski, Daniel Stadler, Alexander Stolz, Jens Ziehn, Jingxing Zhou
With growing complexity and criticality of automated driving functions in road traffic and their operational design domains (ODD), there is increasing demand for covering significant proportions of development, validation, and verification in virtual environments and through simulation models. If, however, simulations are meant not only to augment real-world experiments, but to replace them, quantitative approaches are required that measure to what degree and under which preconditions simulation models adequately represent reality, and thus, using their results accordingly. Especially in R&D areas related to the safety impact of the open world, there is a significant shortage of real-world data to parameterize and/or validate simulations - especially with respect to the behavior of human traffic participants, whom automated driving functions will meet in mixed traffic. We present an approach to systematically acquire data in public traffic by heterogeneous means, transform it into a unified representation, and use it to automatically parameterize traffic behavior models for use in data-driven virtual validation of automated driving functions.
Read more5/6/2024
0
Model-based generation of representative rear-end crash scenarios across the full severity range using pre-crash data
Jian Wu, Carol Flannagan, Ulrich Sander, Jonas Bargman
Generating representative rear-end crash scenarios is crucial for safety assessments of Advanced Driver Assistance Systems (ADAS) and Automated Driving systems (ADS). However, existing methods for scenario generation face challenges such as limited and biased in-depth crash data and difficulties in validation. This study sought to overcome these challenges by combining naturalistic driving data and pre-crash kinematics data from rear-end crashes. The combined dataset was weighted to create a representative dataset of rear-end crash characteristics across the full severity range in the United States. Multivariate distribution models were built for the combined dataset, and a driver behavior model for the following vehicle was created by combining two existing models. Simulations were conducted to generate a set of synthetic rear-end crash scenarios, which were then weighted to create a representative synthetic rear-end crash dataset. Finally, the synthetic dataset was validated by comparing the distributions of parameters and the outcomes (Delta-v, the total change in vehicle velocity over the duration of the crash event) of the generated crashes with those in the original combined dataset. The synthetic crash dataset can be used for the safety assessments of ADAS and ADS and as a benchmark when evaluating the representativeness of scenarios generated through other methods.
Read more6/26/2024
🤿
0
Scene-Extrapolation: Generating Interactive Traffic Scenarios
Maximilian Zipfl, Barbara Schutt, J. Marius Zollner
Verifying highly automated driving functions can be challenging, requiring identifying relevant test scenarios. Scenario-based testing will likely play a significant role in verifying these systems, predominantly occurring within simulation. In our approach, we use traffic scenes as a starting point (seed-scene) to address the individuality of various highly automated driving functions and to avoid the problems associated with a predefined test traffic scenario. Different highly autonomous driving functions, or their distinct iterations, may display different behaviors under the same operating conditions. To make a generalizable statement about a seed-scene, we simulate possible outcomes based on various behavior profiles. We utilize our lightweight simulation environment and populate it with rule-based and machine learning behavior models for individual actors in the scenario. We analyze resulting scenarios using a variety of criticality metrics. The density distributions of the resulting criticality values enable us to make a profound statement about the significance of a particular scene, considering various eventualities.
Read more4/29/2024