JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions

Read original: arXiv:2407.04843 - Published 7/9/2024 by Kenta Mukoya, Erica Weng, Rohan Choudhury, Kris Kitani
Total Score

0

JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

• This paper presents a virtual reality (VR) system called JaywalkerVR for collecting safety-critical interactions between pedestrians and vehicles.

• The researchers developed JaywalkerVR to study how pedestrians behave in dangerous roadside situations, which is difficult to do safely in the real world.

• JaywalkerVR allows researchers to create realistic virtual environments and simulate hazardous scenarios, enabling them to gather valuable data on pedestrian behavior and decision-making.

Plain English Explanation

The researchers created a VR system called JaywalkerVR to study how pedestrians behave in dangerous roadside situations, which can be difficult and unsafe to study in the real world. JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions

With JaywalkerVR, researchers can build realistic virtual environments and simulate hazardous scenarios, like a car approaching a pedestrian who is about to cross the street. This allows them to gather valuable data on how pedestrians make decisions and react in these high-risk situations, without putting anyone in actual danger.

The goal is to better understand pedestrian behavior and decision-making processes, which could help improve the safety of roads and vehicles, especially as autonomous vehicles become more common. Metaverse for Safer Roadways: An Immersive Digital Twin Framework

Technical Explanation

The JaywalkerVR system uses a head-mounted display (HMD) and hand controllers to immerse participants in a virtual environment. Participants are placed in various roadside scenarios, such as approaching a crosswalk or navigating a busy intersection.

The researchers designed the virtual environments to be highly realistic, with accurate road layouts, traffic patterns, and environmental details. They also incorporated real-time physics simulations to ensure the movements and interactions of the virtual vehicles and pedestrians are believable.

During the experiments, the researchers collected data on the participants' decision-making, including their crossing behavior, reaction times, and risk-taking tendencies. This data can help researchers better understand the behavioral gap between human and vehicle interaction in real-world settings.

The researchers also developed a pedestrian animation controller to simulate realistic pedestrian movements and interactions within the virtual environments, further enhancing the realism and validity of the system.

Critical Analysis

The researchers acknowledge several limitations of the JaywalkerVR system. For example, the virtual environments, while highly realistic, may not fully capture the sensory and emotional experiences of real-world roadside situations. Additionally, the participants' behavior in the virtual world may not perfectly reflect their actions in the physical world.

The researchers also note that the data collected from JaywalkerVR experiments could be used to diagnose and predict the operational safety of autonomous vehicles, but caution that further validation and testing would be necessary to ensure the reliability and generalizability of such applications.

Conclusion

The JaywalkerVR system provides a valuable tool for researchers to study pedestrian behavior and decision-making in dangerous roadside situations, which are difficult and unsafe to investigate in the real world. By creating realistic virtual environments, the researchers can gather important data that can inform the development of safer transportation systems, particularly as autonomous vehicles become more prevalent. While the system has some limitations, it represents a significant advancement in the field of transportation safety research.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions
Total Score

0

JaywalkerVR: A VR System for Collecting Safety-Critical Pedestrian-Vehicle Interactions

Kenta Mukoya, Erica Weng, Rohan Choudhury, Kris Kitani

Developing autonomous vehicles that can safely interact with pedestrians requires large amounts of pedestrian and vehicle data in order to learn accurate pedestrian-vehicle interaction models. However, gathering data that include crucial but rare scenarios - such as pedestrians jaywalking into heavy traffic - can be costly and unsafe to collect. We propose a virtual reality human-in-the-loop simulator, JaywalkerVR, to obtain vehicle-pedestrian interaction data to address these challenges. Our system enables efficient, affordable, and safe collection of long-tail pedestrian-vehicle interaction data. Using our proposed simulator, we create a high-quality dataset with vehicle-pedestrian interaction data from safety critical scenarios called CARLA-VR. The CARLA-VR dataset addresses the lack of long-tail data samples in commonly used real world autonomous driving datasets. We demonstrate that models trained with CARLA-VR improve displacement error and collision rate by 10.7% and 4.9%, respectively, and are more robust in rare vehicle-pedestrian scenarios.

Read more

7/9/2024

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions
Total Score

0

Evaluating a VR System for Collecting Safety-Critical Vehicle-Pedestrian Interactions

Erica Weng, Kenta Mukoya, Deva Ramanan, Kris Kitani

Autonomous vehicles (AVs) require comprehensive and reliable pedestrian trajectory data to ensure safe operation. However, obtaining data of safety-critical scenarios such as jaywalking and near-collisions, or uncommon agents such as children, disabled pedestrians, and vulnerable road users poses logistical and ethical challenges. This paper evaluates a Virtual Reality (VR) system designed to collect pedestrian trajectory and body pose data in a controlled, low-risk environment. We substantiate the usefulness of such a system through semi-structured interviews with professionals in the AV field, and validate the effectiveness of the system through two empirical studies: a first-person user evaluation involving 62 participants, and a third-person evaluative survey involving 290 respondents. Our findings demonstrate that the VR-based data collection system elicits realistic responses for capturing pedestrian data in safety-critical or uncommon vehicle-pedestrian interaction scenarios.

Read more

7/11/2024

TRAVERSE: Traffic-Responsive Autonomous Vehicle Experience & Rare-event Simulation for Enhanced safety
Total Score

0

TRAVERSE: Traffic-Responsive Autonomous Vehicle Experience & Rare-event Simulation for Enhanced safety

Sandeep Thalapanane, Sandip Sharan Senthil Kumar, Guru Nandhan Appiya Dilipkumar Peethambari, Sourang SriHari, Laura Zheng, Julio Poveda, Ming C. Lin

Data for training learning-enabled self-driving cars in the physical world are typically collected in a safe, normal environment. Such data distribution often engenders a strong bias towards safe driving, making self-driving cars unprepared when encountering adversarial scenarios like unexpected accidents. Due to a dearth of such adverse data that is unrealistic for drivers to collect, autonomous vehicles can perform poorly when experiencing such rare events. This work addresses much-needed research by having participants drive a VR vehicle simulator going through simulated traffic with various types of accidental scenarios. It aims to understand human responses and behaviors in simulated accidents, contributing to our understanding of driving dynamics and safety. The simulation framework adopts a robust traffic simulation and is rendered using the Unity Game Engine. Furthermore, the simulation framework is built with portable, light-weight immersive driving simulator hardware, lowering the resource barrier for studies in autonomous driving research. Keywords: Rare Events, Traffic Simulation, Autonomous Driving, Virtual Reality, User Studies

Read more

7/15/2024

🏷️

Total Score

0

Evaluation of Pedestrian Safety in a High-Fidelity Simulation Environment Framework

Lin Ma, Longrui Chen, Yan Zhang, Mengdi Chu, Wenjie Jiang, Jiahao Shen, Chuxuan Li, Yifeng Shi, Nairui Luo, Jirui Yuan, Guyue Zhou, Jiangtao Gong

Pedestrians' safety is a crucial factor in assessing autonomous driving scenarios. However, pedestrian safety evaluation is rarely considered by existing autonomous driving simulation platforms. This paper proposes a pedestrian safety evaluation method for autonomous driving, in which not only the collision events but also the conflict events together with the characteristics of pedestrians are fully considered. Moreover, to apply the pedestrian safety evaluation system, we construct a high-fidelity simulation framework embedded with pedestrian safety-critical characteristics. We demonstrate our simulation framework and pedestrian safety evaluation with a comparative experiment with two kinds of autonomous driving perception algorithms -- single-vehicle perception and vehicle-to-infrastructure (V2I) cooperative perception. The results show that our framework can evaluate different autonomous driving algorithms with detailed and quantitative pedestrian safety indexes. To this end, the proposed simulation method and framework can be used to access different autonomous driving algorithms and evaluate pedestrians' safety performance in future autonomous driving simulations, which can inspire more pedestrian-friendly autonomous driving algorithms.

Read more

7/31/2024