Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions

Read original: arXiv:2310.05882 - Published 7/11/2024 by Erica Weng, Kenta Mukoya, Deva Ramanan, Kris Kitani
Total Score

0

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper evaluates a virtual reality (VR) system for collecting safety-critical data on vehicle-pedestrian interactions.
  • The researchers aimed to understand how well a VR environment can replicate real-world pedestrian behavior in dangerous traffic situations.
  • The study involved participants navigating a VR street crossing scenario and comparing their behaviors to data from previous real-world studies.

Plain English Explanation

The researchers wanted to see if a virtual reality (VR) system could be used to safely study how pedestrians behave around vehicles in dangerous situations. In the real world, it would be too risky to have pedestrians purposefully walk in front of cars to collect data. So the researchers created a VR environment that simulated a street crossing scenario, and had participants navigate through it while their behaviors were recorded.

By comparing the VR data to data from previous real-world studies, the researchers could evaluate how well the VR system was able to replicate actual pedestrian behavior. This is important because if the VR system can accurately capture these safety-critical interactions, it could provide a useful tool for studying pedestrian behavior without putting anyone in harm's way. The findings from this research could then help inform the design of safer roads and autonomous vehicles.

Technical Explanation

The paper describes an experiment where participants were placed in a virtual reality (VR) environment that simulated a street crossing scenario. The VR system used a head-mounted display and motion tracking to provide participants with an immersive, first-person experience of navigating the virtual street.

The researchers recorded various behavioral metrics as the participants crossed the street, such as their walking speed, head movements, and gap acceptance (the time they waited before crossing). These VR-based measurements were then compared to data from previous real-world studies on pedestrian behavior in similar safety-critical situations.

The goal was to assess the extent to which the VR system was able to elicit pedestrian behaviors that aligned with real-world observations. If the VR environment was successful in replicating these safety-critical interactions, it could provide a valuable tool for studying pedestrian behavior without the risks associated with real-world experiments.

Critical Analysis

The paper provides a thorough evaluation of the VR system's ability to capture realistic pedestrian behavior. The researchers acknowledge that there may be differences between the virtual and real-world environments that could impact participant behavior, such as the lack of physical risk or sensory cues in the VR setting.

Additionally, the study only involved a relatively small sample size of participants, which limits the generalizability of the findings. Further research with larger and more diverse participant pools would be needed to fully validate the VR system's capabilities.

Another potential limitation is the extent to which the specific virtual street crossing scenario used in the experiment reflects the wide range of real-world situations that pedestrians may encounter. Expanding the VR environment to include more complex or dynamic traffic scenarios could help assess the system's broader applicability.

Despite these caveats, the paper presents a promising approach for using VR technology to study safety-critical vehicle-pedestrian interactions in a controlled and ethical manner. The findings suggest that VR can be a valuable tool for transportation safety research, with further development and validation.

Conclusion

This study demonstrates the potential of virtual reality (VR) systems to serve as a safe and effective platform for studying pedestrian behavior in safety-critical vehicle interactions. By comparing participant behaviors in the VR environment to real-world data, the researchers were able to evaluate the extent to which the VR system could replicate realistic pedestrian decision-making and crossing actions.

The findings suggest that VR can be a useful tool for transportation safety research, as it allows researchers to collect valuable data on these critical interactions without exposing participants to actual physical risk. This knowledge can then inform the design of safer road infrastructure and autonomous vehicle systems, ultimately contributing to improved safety for vulnerable road users.

Overall, this paper provides an important step towards leveraging immersive technologies like VR to advance our understanding of human behavior in transportation scenarios and support the development of more robust safety solutions.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions
Total Score

0

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions

Erica Weng, Kenta Mukoya, Deva Ramanan, Kris Kitani

Autonomous vehicles (AVs) require comprehensive and reliable pedestrian trajectory data to ensure safe operation. However, obtaining data of safety-critical scenarios such as jaywalking and near-collisions, or uncommon agents such as children, disabled pedestrians, and vulnerable road users poses logistical and ethical challenges. This paper evaluates a Virtual Reality (VR) system designed to collect pedestrian trajectory and body pose data in a controlled, low-risk environment. We substantiate the usefulness of such a system through semi-structured interviews with professionals in the AV field, and validate the effectiveness of the system through two empirical studies: a first-person user evaluation involving 62 participants, and a third-person evaluative survey involving 290 respondents. Our findings demonstrate that the VR-based data collection system elicits realistic responses for capturing pedestrian data in safety-critical or uncommon vehicle-pedestrian interaction scenarios.

Read more

7/11/2024

JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions
Total Score

0

JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions

Kenta Mukoya, Erica Weng, Rohan Choudhury, Kris Kitani

Developing autonomous vehicles that can safely interact with pedestrians requires large amounts of pedestrian and vehicle data in order to learn accurate pedestrian-vehicle interaction models. However, gathering data that include crucial but rare scenarios - such as pedestrians jaywalking into heavy traffic - can be costly and unsafe to collect. We propose a virtual reality human-in-the-loop simulator, JaywalkerVR, to obtain vehicle-pedestrian interaction data to address these challenges. Our system enables efficient, affordable, and safe collection of long-tail pedestrian-vehicle interaction data. Using our proposed simulator, we create a high-quality dataset with vehicle-pedestrian interaction data from safety critical scenarios called CARLA-VR. The CARLA-VR dataset addresses the lack of long-tail data samples in commonly used real world autonomous driving datasets. We demonstrate that models trained with CARLA-VR improve displacement error and collision rate by 10.7% and 4.9%, respectively, and are more robust in rare vehicle-pedestrian scenarios.

Read more

7/9/2024

🏷️

Total Score

0

Evaluation of Pedestrian Safety in a High-Fidelity Simulation Environment Framework

Lin Ma, Longrui Chen, Yan Zhang, Mengdi Chu, Wenjie Jiang, Jiahao Shen, Chuxuan Li, Yifeng Shi, Nairui Luo, Jirui Yuan, Guyue Zhou, Jiangtao Gong

Pedestrians' safety is a crucial factor in assessing autonomous driving scenarios. However, pedestrian safety evaluation is rarely considered by existing autonomous driving simulation platforms. This paper proposes a pedestrian safety evaluation method for autonomous driving, in which not only the collision events but also the conflict events together with the characteristics of pedestrians are fully considered. Moreover, to apply the pedestrian safety evaluation system, we construct a high-fidelity simulation framework embedded with pedestrian safety-critical characteristics. We demonstrate our simulation framework and pedestrian safety evaluation with a comparative experiment with two kinds of autonomous driving perception algorithms -- single-vehicle perception and vehicle-to-infrastructure (V2I) cooperative perception. The results show that our framework can evaluate different autonomous driving algorithms with detailed and quantitative pedestrian safety indexes. To this end, the proposed simulation method and framework can be used to access different autonomous driving algorithms and evaluate pedestrians' safety performance in future autonomous driving simulations, which can inspire more pedestrian-friendly autonomous driving algorithms.

Read more

7/31/2024

Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving
Total Score

0

Behavioural gap assessment of human-vehicle interaction in real and virtual reality-based scenarios in autonomous driving

Sergio. Mart'in Serrano, Rub'en Izquierdo, Iv'an Garc'ia Daza, Miguel 'Angel Sotelo, D. Fern'andez Llorca

In the field of autonomous driving research, the use of immersive virtual reality (VR) techniques is widespread to enable a variety of studies under safe and controlled conditions. However, this methodology is only valid and consistent if the conduct of participants in the simulated setting mirrors their actions in an actual environment. In this paper, we present a first and innovative approach to evaluating what we term the behavioural gap, a concept that captures the disparity in a participant's conduct when engaging in a VR experiment compared to an equivalent real-world situation. To this end, we developed a digital twin of a pre-existed crosswalk and carried out a field experiment (N=18) to investigate pedestrian-autonomous vehicle interaction in both real and simulated driving conditions. In the experiment, the pedestrian attempts to cross the road in the presence of different driving styles and an external Human-Machine Interface (eHMI). By combining survey-based and behavioural analysis methodologies, we develop a quantitative approach to empirically assess the behavioural gap, as a mechanism to validate data obtained from real subjects interacting in a simulated VR-based environment. Results show that participants are more cautious and curious in VR, affecting their speed and decisions, and that VR interfaces significantly influence their actions.

Read more

7/8/2024