A Joint Approach Towards Data-Driven Virtual Testing for Automated Driving: The AVEAS Project
2405.06286
0
0
๐งช
Abstract
With growing complexity and responsibility of automated driving functions in road traffic and growing scope of their operational design domains, there is increasing demand for covering significant parts of development, validation, and verification via virtual environments and simulation models. If, however, simulations are meant not only to augment real-world experiments, but to replace them, quantitative approaches are required that measure to what degree and under which preconditions simulation models adequately represent reality, and thus allow their usage for virtual testing of driving functions. Especially in research and development areas related to the safety impacts of the open world, there is a significant shortage of real-world data to parametrize and/or validate simulations - especially with respect to the behavior of human traffic participants, whom automated vehicles will meet in mixed traffic. This paper presents the intermediate results of the German AVEAS research project (www.aveas.org) which aims at developing methods and metrics for the harmonized, systematic, and scalable acquisition of real-world data for virtual verification and validation of advanced driver assistance systems and automated driving, and establishing an online database following the FAIR principles.
Create account to get full access
Overview
- Automated driving functions are becoming more complex and prevalent on our roads
- This increases the need to thoroughly test and validate these systems in virtual environments and simulation models
- However, there is a shortage of real-world data to properly parametrize and validate these simulations, especially regarding the behavior of human drivers
- This paper presents the intermediate results of a research project aiming to develop methods and metrics for acquiring real-world data to support virtual testing of advanced driver assistance systems and automated driving
Plain English Explanation
As self-driving cars and advanced driver assistance systems become more advanced and widespread, there is a growing need to thoroughly test and validate these technologies in virtual environments and simulations. This is critical for ensuring the safety and reliability of these systems. However, one of the key challenges is that there is a lack of real-world data available to properly set up and validate these simulations, particularly when it comes to modeling the behavior of human drivers that self-driving cars will encounter on the roads.
This research project is working to address this issue by developing new methods and metrics for systematically collecting real-world data that can be used to enhance the accuracy and realism of simulation models. By having access to high-quality, representative data on driver behavior, traffic patterns, and other real-world conditions, the researchers hope to enable more rigorous virtual testing and validation of automated driving technologies before they are deployed on public roads.
Technical Explanation
The paper outlines the ongoing work of the German AVEAS research project, which aims to develop new methods and metrics for systematically acquiring real-world data to support the virtual verification and validation of advanced driver assistance systems (ADAS) and automated driving technologies.
A key challenge identified is the significant shortage of real-world data, especially with regard to the behavior of human traffic participants that self-driving cars will need to interact with in mixed traffic environments. Without access to representative data on driver behavior, traffic patterns, and other real-world conditions, it is difficult to accurately parameterize and validate simulation models to a degree that would allow them to reliably replace physical testing.
To address this, the AVEAS project is working to establish an online database of real-world driving data following the FAIR (Findable, Accessible, Interoperable, Reusable) principles. By developing harmonized methods and metrics for systematically collecting, storing, and sharing this data, the researchers hope to enable more comprehensive and scalable virtual testing of automated driving functions.
Critical Analysis
The researchers acknowledge that the work presented in this paper represents only intermediate results, suggesting that there is still more research and development required to fully realize the project's goals. One potential limitation is the challenge of ensuring the collected data is truly representative of the wide range of real-world driving conditions and scenarios that automated vehicles will need to navigate.
Additionally, while the focus on establishing a centralized, standardized database of driving data is a valuable approach, there may be concerns around privacy, security, and data ownership that would need to be carefully addressed. Maintaining the trust and consent of human drivers contributing their data will be crucial.
Overall, the AVEAS project represents an important step towards enabling more comprehensive virtual testing of automated driving technologies. However, continued research, collaboration, and stakeholder engagement will be necessary to fully realize the potential of this approach and ensure the safety and reliability of self-driving cars on our roads.
Conclusion
This research project is working to address a critical gap in the development and testing of automated driving technologies: the lack of real-world data to properly parameterize and validate simulation models. By developing new methods and metrics for systematically collecting and sharing this data, the researchers aim to enable more comprehensive virtual testing of ADAS and automated driving functions before they are deployed in the real world.
While the work presented in this paper represents only intermediate results, the overall approach holds promise for enhancing the safety and reliability of self-driving cars through more rigorous simulation-based testing and validation. As the project continues to progress, it will be important to address potential challenges around privacy, security, and data representativeness to ensure the broader adoption and implementation of these techniques.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
An Approach to Systematic Data Acquisition and Data-Driven Simulation for the Safety Testing of Automated Driving Functions
Leon Eisemann, Mirjam Fehling-Kaschek, Henrik Gommel, David Hermann, Marvin Klemp, Martin Lauer, Benjamin Lickert, Florian Luettner, Robin Moss, Nicole Neis, Maria Pohle, Simon Romanski, Daniel Stadler, Alexander Stolz, Jens Ziehn, Jingxing Zhou
0
0
With growing complexity and criticality of automated driving functions in road traffic and their operational design domains (ODD), there is increasing demand for covering significant proportions of development, validation, and verification in virtual environments and through simulation models. If, however, simulations are meant not only to augment real-world experiments, but to replace them, quantitative approaches are required that measure to what degree and under which preconditions simulation models adequately represent reality, and thus, using their results accordingly. Especially in R&D areas related to the safety impact of the open world, there is a significant shortage of real-world data to parameterize and/or validate simulations - especially with respect to the behavior of human traffic participants, whom automated driving functions will meet in mixed traffic. We present an approach to systematically acquire data in public traffic by heterogeneous means, transform it into a unified representation, and use it to automatically parameterize traffic behavior models for use in data-driven virtual validation of automated driving functions.
5/6/2024
๐
Diagnosing and Predicting Autonomous Vehicle Operational Safety Using Multiple Simulation Modalities and a Virtual Environment
Joe Beck, Shean Huff, Subhadeep Chakraborty
0
0
Even as technology and performance gains are made in the sphere of automated driving, safety concerns remain. Vehicle simulation has long been seen as a tool to overcome the cost associated with a massive amount of on-road testing for development and discovery of safety critical edge-cases. However, purely software-based vehicle models may leave a large realism gap between their real-world counterparts in terms of dynamic response, and highly realistic vehicle-in-the-loop (VIL) simulations that encapsulate a virtual world around a physical vehicle may still be quite expensive to produce and similarly time intensive as on-road testing. In this work, we demonstrate an AV simulation test bed that combines the realism of vehicle-in-the-loop (VIL) simulation with the ease of implementation of model-in-the-loop (MIL) simulation. The setup demonstrated in this work allows for response diagnosis for the VIL simulations. By observing causal links between virtual weather and lighting conditions that surround the virtual depiction of our vehicle, the vision-based perception model and controller of Openpilot, and the dynamic response of our physical vehicle under test, we can draw conclusions regarding how the perceived environment contributed to vehicle response. Conversely, we also demonstrate response prediction for the MIL setup, where the need for a physical vehicle is not required to draw richer conclusions around the impact of environmental conditions on AV performance than could be obtained with VIL simulation alone. These combine for a simulation setup with accurate real-world implications for edge-case discovery that is both cost effective and time efficient to implement.
5/14/2024
AI-augmented Automation for Real Driving Prediction: an Industrial Use Case
Romina Eramo, Hamzeh Eyal Salman, Matteo Spezialetti, Darko Stern, Pierre Quinton, Antonio Cicchetti
0
0
The risen complexity of automotive systems requires new development strategies and methods to master the upcoming challenges. Traditional methods need thus to be changed by an increased level of automation, and a faster continuous improvement cycle. In this context, current vehicle performance tests represent a very time-consuming and expensive task due to the need to perform the tests in real driving conditions. As a consequence, agile/iterative processes like DevOps are largely hindered by the necessity of triggering frequent tests. This paper reports on a practical experience of developing an AI-augmented solution based on Machine Learning and Model-based Engineering to support continuous vehicle development and testing. In particular, historical data collected in real driving conditions is leveraged to synthesize a high-fidelity driving simulator and hence enable performance tests in virtual environments. Based on this practical experience, this paper also proposes a conceptual framework to support predictions based on real driving behavior.
4/4/2024
Towards Collaborative Autonomous Driving: Simulation Platform and End-to-End System
Genjia Liu, Yue Hu, Chenxin Xu, Weibo Mao, Junhao Ge, Zhengxiang Huang, Yifan Lu, Yinda Xu, Junkai Xia, Yafei Wang, Siheng Chen
0
0
Vehicle-to-everything-aided autonomous driving (V2X-AD) has a huge potential to provide a safer driving solution. Despite extensive researches in transportation and communication to support V2X-AD, the actual utilization of these infrastructures and communication resources in enhancing driving performances remains largely unexplored. This highlights the necessity of collaborative autonomous driving: a machine learning approach that optimizes the information sharing strategy to improve the driving performance of each vehicle. This effort necessitates two key foundations: a platform capable of generating data to facilitate the training and testing of V2X-AD, and a comprehensive system that integrates full driving-related functionalities with mechanisms for information sharing. From the platform perspective, we present V2Xverse, a comprehensive simulation platform for collaborative autonomous driving. This platform provides a complete pipeline for collaborative driving. From the system perspective, we introduce CoDriving, a novel end-to-end collaborative driving system that properly integrates V2X communication over the entire autonomous pipeline, promoting driving with shared perceptual information. The core idea is a novel driving-oriented communication strategy. Leveraging this strategy, CoDriving improves driving performance while optimizing communication efficiency. We make comprehensive benchmarks with V2Xverse, analyzing both modular performance and closed-loop driving performance. Experimental results show that CoDriving: i) significantly improves the driving score by 62.49% and drastically reduces the pedestrian collision rate by 53.50% compared to the SOTA end-to-end driving method, and ii) achieves sustaining driving performance superiority over dynamic constraint communication conditions.
4/16/2024