Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving

Read original: arXiv:2407.04070 - Published 7/8/2024 by Sergio. Mart'in Serrano, Rub'en Izquierdo, Iv'an Garc'ia Daza, Miguel 'Angel Sotelo, D. Fern'andez Llorca
Total Score

0

Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • Examines the behavioral gap between human-vehicle interactions in real and virtual reality (VR) scenarios for autonomous driving
  • Investigates how VR can be used to assess and model human behavior in autonomous vehicle interactions
  • Aims to improve the design and testing of autonomous vehicles by understanding human behaviors in a safe and controlled VR environment

Plain English Explanation

The paper looks at the differences in how people behave when interacting with autonomous vehicles in the real world versus in a virtual reality (VR) simulation. The researchers wanted to see if VR could be used as a tool to study and model human behaviors in autonomous vehicle interactions. This is important because it can help improve the design and testing of autonomous vehicles, allowing researchers to understand how people might react in different scenarios without putting them in real danger on the roads.

The key idea is that VR can provide a safe and controlled environment to observe human behaviors that would be difficult or risky to study in the real world, such as how pedestrians, cyclists, or other drivers might interact with self-driving cars. By comparing the behaviors observed in VR to those in real-life situations, the researchers can identify any "gaps" or differences. This information can then feed back into the development of better autonomous vehicle systems that are designed to work seamlessly with human users.

Technical Explanation

The paper describes a study that compared human behaviors in real-world and VR-based scenarios involving interactions with autonomous vehicles. The researchers developed a VR simulation that recreated various traffic scenarios, such as pedestrians crossing the road or cyclists riding alongside autonomous cars.

They then recruited participants to experience these scenarios in both the real world and the VR environment. By tracking the participants' movements, gaze patterns, and other behaviors, the researchers were able to identify differences between how people acted in the real versus virtual settings. This allowed them to assess the "behavioral gap" between the two environments.

The insights from this study can be used to enhance the design and testing of autonomous vehicles by providing a better understanding of how humans are likely to interact with self-driving cars in real-world conditions. The VR simulations can also be used to diagnose and predict the operational safety of autonomous vehicles by modeling various edge cases and scenarios that would be difficult or dangerous to test in the physical world.

Critical Analysis

The paper acknowledges that while VR can provide a valuable tool for studying human-vehicle interactions, there may be inherent limitations in how well the virtual environment can replicate real-world conditions and behaviors. For example, the sensory experience and physical cues in VR may not fully capture the complexity of real-world situations, which could affect how participants respond.

Additionally, the study focused on relatively simple traffic scenarios and did not explore more complex human-machine interactions that may arise in autonomous driving, such as the use of external human-machine interfaces (eHMIs) or other communication cues. Further research would be needed to understand how the behavioral gap might change in more nuanced and realistic autonomous driving situations.

The paper also does not delve into the potential ethical implications of using VR as a proxy for real-world testing, such as the risk of over-reliance on simulations or the potential for bias in the virtual environment. These are important considerations as the use of VR in autonomous vehicle development continues to evolve.

Conclusion

This study demonstrates the potential for using virtual reality as a tool to assess and model human behaviors in the context of autonomous vehicle interactions. By identifying the "behavioral gap" between real-world and VR-based scenarios, the researchers have provided insights that can inform the design and testing of autonomous vehicles to better account for how humans are likely to interact with them.

However, the findings also highlight the need for further research to fully understand the limitations and ethical considerations of relying on VR simulations, as well as the complexities of human-machine interactions in more realistic autonomous driving situations. As the development of autonomous vehicles continues, the integration of VR-based assessment and modeling will likely play an increasingly important role in creating safer and more user-friendly self-driving technologies.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving
Total Score

0

Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving

Sergio. Mart'in Serrano, Rub'en Izquierdo, Iv'an Garc'ia Daza, Miguel 'Angel Sotelo, D. Fern'andez Llorca

In the field of autonomous driving research, the use of immersive virtual reality (VR) techniques is widespread to enable a variety of studies under safe and controlled conditions. However, this methodology is only valid and consistent if the conduct of participants in the simulated setting mirrors their actions in an actual environment. In this paper, we present a first and innovative approach to evaluating what we term the behavioural gap, a concept that captures the disparity in a participant's conduct when engaging in a VR experiment compared to an equivalent real-world situation. To this end, we developed a digital twin of a pre-existed crosswalk and carried out a field experiment (N=18) to investigate pedestrian-autonomous vehicle interaction in both real and simulated driving conditions. In the experiment, the pedestrian attempts to cross the road in the presence of different driving styles and an external Human-Machine Interface (eHMI). By combining survey-based and behavioural analysis methodologies, we develop a quantitative approach to empirically assess the behavioural gap, as a mechanism to validate data obtained from real subjects interacting in a simulated VR-based environment. Results show that participants are more cautious and curious in VR, affecting their speed and decisions, and that VR interfaces significantly influence their actions.

Read more

7/8/2024

Cross-cultural analysis of pedestrian group behaviour influence on crossing decisions in interactions with autonomous vehicles
Total Score

0

Cross-cultural analysis of pedestrian group behaviour influence on crossing decisions in interactions with autonomous vehicles

Sergio Mart'in Serrano, 'Oscar M'endez Blanco, Stewart Worrall, Miguel 'Angel Sotelo, David Fern'andez-Llorca

Understanding cultural backgrounds is crucial for the seamless integration of autonomous driving into daily life as it ensures that systems are attuned to diverse societal norms and behaviours, enhancing acceptance and safety in varied cultural contexts. In this work, we investigate the impact of co-located pedestrians on crossing behaviour, considering cultural and situational factors. To accomplish this, a full-scale virtual reality (VR) environment was created in the CARLA simulator, enabling the identical experiment to be replicated in both Spain and Australia. Participants (N=30) attempted to cross the road at an urban crosswalk alongside other pedestrians exhibiting conservative to more daring behaviours, while an autonomous vehicle (AV) approached with different driving styles. For the analysis of interactions, we utilized questionnaires and direct measures of the moment when participants entered the lane. Our findings indicate that pedestrians tend to cross the same traffic gap together, even though reckless behaviour by the group reduces confidence and makes the situation perceived as more complex. Australian participants were willing to take fewer risks than Spanish participants, adopting more cautious behaviour when it was uncertain whether the AV would yield.

Read more

8/7/2024

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions
Total Score

0

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions

Erica Weng, Kenta Mukoya, Deva Ramanan, Kris Kitani

Autonomous vehicles (AVs) require comprehensive and reliable pedestrian trajectory data to ensure safe operation. However, obtaining data of safety-critical scenarios such as jaywalking and near-collisions, or uncommon agents such as children, disabled pedestrians, and vulnerable road users poses logistical and ethical challenges. This paper evaluates a Virtual Reality (VR) system designed to collect pedestrian trajectory and body pose data in a controlled, low-risk environment. We substantiate the usefulness of such a system through semi-structured interviews with professionals in the AV field, and validate the effectiveness of the system through two empirical studies: a first-person user evaluation involving 62 participants, and a third-person evaluative survey involving 290 respondents. Our findings demonstrate that the VR-based data collection system elicits realistic responses for capturing pedestrian data in safety-critical or uncommon vehicle-pedestrian interaction scenarios.

Read more

7/11/2024

TRAVERSE: Traffic-Responsive Autonomous Vehicle Experience & Rare-event Simulation for Enhanced safety
Total Score

0

TRAVERSE: Traffic-Responsive Autonomous Vehicle Experience & Rare-event Simulation for Enhanced safety

Sandeep Thalapanane, Sandip Sharan Senthil Kumar, Guru Nandhan Appiya Dilipkumar Peethambari, Sourang SriHari, Laura Zheng, Julio Poveda, Ming C. Lin

Data for training learning-enabled self-driving cars in the physical world are typically collected in a safe, normal environment. Such data distribution often engenders a strong bias towards safe driving, making self-driving cars unprepared when encountering adversarial scenarios like unexpected accidents. Due to a dearth of such adverse data that is unrealistic for drivers to collect, autonomous vehicles can perform poorly when experiencing such rare events. This work addresses much-needed research by having participants drive a VR vehicle simulator going through simulated traffic with various types of accidental scenarios. It aims to understand human responses and behaviors in simulated accidents, contributing to our understanding of driving dynamics and safety. The simulation framework adopts a robust traffic simulation and is rendered using the Unity Game Engine. Furthermore, the simulation framework is built with portable, light-weight immersive driving simulator hardware, lowering the resource barrier for studies in autonomous driving research. Keywords: Rare Events, Traffic Simulation, Autonomous Driving, Virtual Reality, User Studies

Read more

7/15/2024