Scene-Extrapolation: Generating Interactive Traffic Scenarios
2404.17224
0
0
🤿
Abstract
Verifying highly automated driving functions can be challenging, requiring identifying relevant test scenarios. Scenario-based testing will likely play a significant role in verifying these systems, predominantly occurring within simulation. In our approach, we use traffic scenes as a starting point (seed-scene) to address the individuality of various highly automated driving functions and to avoid the problems associated with a predefined test traffic scenario. Different highly autonomous driving functions, or their distinct iterations, may display different behaviors under the same operating conditions. To make a generalizable statement about a seed-scene, we simulate possible outcomes based on various behavior profiles. We utilize our lightweight simulation environment and populate it with rule-based and machine learning behavior models for individual actors in the scenario. We analyze resulting scenarios using a variety of criticality metrics. The density distributions of the resulting criticality values enable us to make a profound statement about the significance of a particular scene, considering various eventualities.
Create account to get full access
Overview
- Verifying highly automated driving functions is challenging, requiring identifying relevant test scenarios.
- Scenario-based testing within simulation is likely to play a significant role in verifying these systems.
- This approach uses traffic scenes as a starting point (seed-scene) to address the individuality of various highly automated driving functions and avoid problems with predefined test scenarios.
- Different highly autonomous driving functions may display different behaviors under the same operating conditions.
- The approach simulates possible outcomes based on various behavior profiles, utilizing a lightweight simulation environment and rule-based and machine learning behavior models for individual actors.
- The resulting scenarios are analyzed using a variety of criticality metrics, and the density distributions of the criticality values enable making a profound statement about the significance of a particular scene, considering various eventualities.
Plain English Explanation
Highly automated driving systems, such as self-driving cars, can be challenging to verify and test. These systems need to be able to handle a wide range of driving scenarios, and it's not feasible to test every possible situation in the real world. This approach uses a simulation-based method to address this challenge.
The researchers start with a "seed-scene" – a real-world traffic scene that serves as a starting point. They then simulate how different highly automated driving functions (or variations of the same function) might behave in that scene. This allows them to understand how the same situation can play out differently for different systems.
To simulate these scenarios, the researchers use a lightweight simulation environment and populate it with models of individual actors (like other vehicles, pedestrians, etc.) that can behave in rule-based or machine learning-based ways. They then analyze the resulting scenarios using various "criticality" metrics, which help them understand how risky or dangerous each simulated outcome might be.
By looking at the distribution of these criticality values, the researchers can make conclusions about the significance of the original seed-scene. This allows them to identify traffic situations that are particularly challenging or important to test, without having to exhaustively simulate every possible scenario.
Technical Explanation
The key idea behind this approach is to use real-world traffic scenes as a starting point (the "seed-scene") for testing highly automated driving functions, rather than relying on predefined test scenarios. This is motivated by the fact that different highly autonomous driving functions, or their distinct iterations, may display different behaviors under the same operating conditions.
To simulate possible outcomes based on various behavior profiles, the researchers utilize a lightweight simulation environment and populate it with rule-based and machine learning behavior models for individual actors in the scenario. This allows them to explore a wide range of potential scenarios arising from the same seed-scene.
The resulting scenarios are then analyzed using a variety of criticality metrics, which provide insights into the significance of the original seed-scene. By looking at the density distributions of the criticality values, the researchers can make a profound statement about the various eventualities that could occur in that particular traffic situation.
Critical Analysis
The researchers acknowledge that their approach relies on the accuracy and comprehensiveness of the behavior models used to populate the simulation environment. If these models do not adequately capture the full range of possible behaviors, the simulated scenarios may not reflect the true complexity of real-world driving situations.
Additionally, the selection of the initial seed-scenes may introduce biases, as the researchers may inadvertently choose scenes that are not representative of the broader set of driving scenarios. Further research could explore methods to systematically identify a diverse set of seed-scenes that cover a wide range of driving conditions and challenges.
Another potential limitation is the choice and weighting of the criticality metrics used to analyze the simulated scenarios. Different metrics may prioritize different aspects of safety and risk, and the researchers may need to carefully consider which metrics are most relevant for their specific use case.
Conclusion
This research proposes a novel approach to verifying highly automated driving functions using simulation-based testing. By starting with real-world traffic scenes as seed-scenes and simulating a wide range of potential scenarios, the researchers can gain insights into the behavior and safety of these systems under various operating conditions.
The ability to identify and focus on the most significant and challenging traffic situations is a crucial step in ensuring the reliable and safe deployment of highly automated driving technologies. While the approach has some limitations, it represents an important step forward in addressing the complexities of verifying these complex systems.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Causality-based Transfer of Driving Scenarios to Unseen Intersections
Christoph Glasmacher, Michael Schuldes, Sleiman El Masri, Lutz Eckstein
0
0
Scenario-based testing of automated driving functions has become a promising method to reduce time and cost compared to real-world testing. In scenario-based testing automated functions are evaluated in a set of pre-defined scenarios. These scenarios provide information about vehicle behaviors, environmental conditions, or road characteristics using parameters. To create realistic scenarios, parameters and parameter dependencies have to be fitted utilizing real-world data. However, due to the large variety of intersections and movement constellations found in reality, data may not be available for certain scenarios. This paper proposes a methodology to systematically analyze relations between parameters of scenarios. Bayesian networks are utilized to analyze causal dependencies in order to decrease the amount of required data and to transfer causal patterns creating unseen scenarios. Thereby, infrastructural influences on movement patterns are investigated to generate realistic scenarios on unobserved intersections. For evaluation, scenarios and underlying parameters are extracted from the inD dataset. Movement patterns are estimated, transferred and checked against recorded data from those initially unseen intersections.
4/3/2024
🛸
ChatScene: Knowledge-Enabled Safety-Critical Scenario Generation for Autonomous Vehicles
Jiawei Zhang, Chejian Xu, Bo Li
0
0
We present ChatScene, a Large Language Model (LLM)-based agent that leverages the capabilities of LLMs to generate safety-critical scenarios for autonomous vehicles. Given unstructured language instructions, the agent first generates textually described traffic scenarios using LLMs. These scenario descriptions are subsequently broken down into several sub-descriptions for specified details such as behaviors and locations of vehicles. The agent then distinctively transforms the textually described sub-scenarios into domain-specific languages, which then generate actual code for prediction and control in simulators, facilitating the creation of diverse and complex scenarios within the CARLA simulation environment. A key part of our agent is a comprehensive knowledge retrieval component, which efficiently translates specific textual descriptions into corresponding domain-specific code snippets by training a knowledge database containing the scenario description and code pairs. Extensive experimental results underscore the efficacy of ChatScene in improving the safety of autonomous vehicles. For instance, the scenarios generated by ChatScene show a 15% increase in collision rates compared to state-of-the-art baselines when tested against different reinforcement learning-based ego vehicles. Furthermore, we show that by using our generated safety-critical scenarios to fine-tune different RL-based autonomous driving models, they can achieve a 9% reduction in collision rates, surpassing current SOTA methods. ChatScene effectively bridges the gap between textual descriptions of traffic scenarios and practical CARLA simulations, providing a unified way to conveniently generate safety-critical scenarios for safety testing and improvement for AVs.
5/24/2024
Towards a Completeness Argumentation for Scenario Concepts
Christoph Glasmacher, Hendrik Weber, Lutz Eckstein
0
0
Scenario-based testing has become a promising approach to overcome the complexity of real-world traffic for safety assurance of automated vehicles. Within scenario-based testing, a system under test is confronted with a set of predefined scenarios. This set shall ensure more efficient testing of an automated vehicle operating in an open context compared to real-world testing. However, the question arises if a scenario catalog can cover the open context sufficiently to allow an argumentation for sufficiently safe driving functions and how this can be proven. Within this paper, a methodology is proposed to argue a sufficient completeness of a scenario concept using a goal structured notation. Thereby, the distinction between completeness and coverage is discussed. For both, methods are proposed for a streamlined argumentation and regarding evidence. These methods are applied to a scenario concept and the inD dataset to prove the usability.
4/3/2024
New!Deep Reinforcement Learning for Adverse Garage Scenario Generation
Kai Li
0
0
Autonomous vehicles need to travel over 11 billion miles to ensure their safety. Therefore, the importance of simulation testing before real-world testing is self-evident. In recent years, the release of 3D simulators for autonomous driving, represented by Carla and CarSim, marks the transition of autonomous driving simulation testing environments from simple 2D overhead views to complex 3D models. During simulation testing, experimenters need to build static scenes and dynamic traffic flows, pedestrian flows, and other experimental elements to construct experimental scenarios. When building static scenes in 3D simulators, experimenters often need to manually construct 3D models, set parameters and attributes, which is time-consuming and labor-intensive. This thesis proposes an automated program generation framework. Based on deep reinforcement learning, this framework can generate different 2D ground script codes, on which 3D model files and map model files are built. The generated 3D ground scenes are displayed in the Carla simulator, where experimenters can use this scene for navigation algorithm simulation testing.
7/2/2024