The OPNV Data Collection: A Dataset for Infrastructure-Supported Perception Research with Focus on Public Transportation

Read original: arXiv:2407.08261 - Published 7/12/2024 by Marcel Vosshans, Alexander Baumann, Matthias Drueppel, Omar Ait-Aider, Ralf Woerner, Youcef Mezouar, Thao Dang, Markus Enzweiler
Total Score

0

The OPNV Data Collection: A Dataset for Infrastructure-Supported Perception Research with Focus on Public Transportation

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents the OPNV (Open Public Transportation Network and Vehicles) dataset, a comprehensive dataset for infrastructure-supported perception research in the context of public transportation.
  • The dataset includes data from various sensors installed on public transportation vehicles and infrastructure, providing a rich source of information for researchers working on collaborative perception systems.
  • The data covers both urban and rural environments, enabling the study of a wide range of scenarios relevant to the development of advanced transportation solutions.

Plain English Explanation

The OPNV dataset is a collection of data gathered from sensors installed on public transportation vehicles and infrastructure. This dataset is designed to help researchers develop advanced perception systems for autonomous and connected transportation solutions.

The dataset includes information from a variety of sensors, such as cameras, LiDAR, and GPS, which can be used to understand the surrounding environment, detect objects, and track the movement of vehicles and people. By having access to this data, researchers can explore how different perception technologies can be combined and coordinated to improve the safety and efficiency of public transportation systems.

The dataset covers both urban and rural areas, allowing researchers to study a diverse range of scenarios that public transportation systems may encounter. This breadth of data can help identify challenges and opportunities for improving the reliability and responsiveness of transportation services, ultimately benefiting both operators and passengers.

Technical Explanation

The OPNV dataset is a comprehensive collection of sensor data from public transportation vehicles and infrastructure, designed to support research on infrastructure-supported perception for autonomous and connected transportation systems. The dataset includes data from a range of sensors, including cameras, LiDAR, and GPS, which can be used to study various aspects of transportation operations, such as vehicle detection, object tracking, and environmental understanding.

The dataset covers both urban and rural environments, providing researchers with a diverse set of scenarios to explore. This breadth of data can help identify the unique challenges and requirements for perception systems in different transportation contexts, such as dealing with varying road conditions, traffic patterns, and infrastructure configurations.

By having access to the OPNV dataset, researchers can investigate how different perception technologies, such as collaborative perception datasets for autonomous driving and vehicle-to-vehicle multi-modal perception, can be integrated and coordinated to improve the overall performance and reliability of public transportation systems. This can lead to advancements in areas like collective perception for autonomous driving, collaborative perception for multi-robot systems, and multi-modal perception for autonomous systems operating in aquatic environments.

Critical Analysis

The OPNV dataset provides a valuable resource for researchers working on infrastructure-supported perception systems for public transportation. However, it is important to consider the limitations and potential challenges associated with the dataset.

One potential limitation is the geographic coverage of the dataset, as it may not represent the full diversity of transportation environments and infrastructure around the world. Additionally, the dataset may not capture all the nuances and edge cases that perception systems may encounter in real-world public transportation operations.

Another area for further research is the integration of the OPNV dataset with other relevant datasets, such as those focused on collaborative perception in autonomous driving or multi-modal perception for autonomous systems. By combining multiple datasets, researchers may be able to develop more comprehensive and robust perception solutions that can handle a wider range of transportation scenarios.

Conclusion

The OPNV dataset is a significant contribution to the field of infrastructure-supported perception research for public transportation. By providing a rich source of sensor data from various transportation environments, the dataset enables researchers to explore how different perception technologies can be integrated and coordinated to improve the safety, efficiency, and reliability of public transportation systems.

The dataset's potential impact extends beyond public transportation, as the insights and advancements made through the use of this dataset can also be applicable to other domains, such as autonomous driving and multi-robot systems. As researchers continue to explore the OPNV dataset and push the boundaries of perception technology, we can expect to see significant progress in the development of smarter, more responsive, and more user-friendly transportation solutions.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

The OPNV Data Collection: A Dataset for Infrastructure-Supported Perception Research with Focus on Public Transportation
Total Score

0

The OPNV Data Collection: A Dataset for Infrastructure-Supported Perception Research with Focus on Public Transportation

Marcel Vosshans, Alexander Baumann, Matthias Drueppel, Omar Ait-Aider, Ralf Woerner, Youcef Mezouar, Thao Dang, Markus Enzweiler

This paper we present our vision and ongoing work for a novel dataset designed to advance research into the interoperability of intelligent vehicles and infrastructure, specifically aimed at enhancing cooperative perception and interaction in the realm of public transportation. Unlike conventional datasets centered on ego-vehicle data, this approach encompasses both a stationary sensor tower and a moving vehicle, each equipped with cameras, LiDARs, and GNSS, while the vehicle additionally includes an inertial navigation system. Our setup features comprehensive calibration and time synchronization, ensuring seamless and accurate sensor data fusion crucial for studying complex, dynamic scenes. Emphasizing public transportation, the dataset targets to include scenes like bus station maneuvers and driving on dedicated bus lanes, reflecting the specifics of small public buses. We introduce the open-source .4mse file format for the new dataset, accompanied by a research kit. This kit provides tools such as ego-motion compensation or LiDAR-to-camera projection enabling advanced research on intelligent vehicle-infrastructure integration. Our approach does not include annotations; however, we plan to implement automatically generated labels sourced from state-of-the-art public repositories. Several aspects are still up for discussion, and timely feedback from the community would be greatly appreciated. A sneak preview on one data frame will be available at a Google Colab Notebook. Moreover, we will use the related GitHub Repository to collect remarks and suggestions.

Read more

7/12/2024

Collaborative Perception Datasets in Autonomous Driving: A Survey
Total Score

0

Collaborative Perception Datasets in Autonomous Driving: A Survey

Melih Yazgan, Mythra Varun Akkanapragada, J. Marius Zoellner

This survey offers a comprehensive examination of collaborative perception datasets in the context of Vehicle-to-Infrastructure (V2I), Vehicle-to-Vehicle (V2V), and Vehicle-to-Everything (V2X). It highlights the latest developments in large-scale benchmarks that accelerate advancements in perception tasks for autonomous vehicles. The paper systematically analyzes a variety of datasets, comparing them based on aspects such as diversity, sensor setup, quality, public availability, and their applicability to downstream tasks. It also highlights the key challenges such as domain shift, sensor setup limitations, and gaps in dataset diversity and availability. The importance of addressing privacy and security concerns in the development of datasets is emphasized, regarding data sharing and dataset creation. The conclusion underscores the necessity for comprehensive, globally accessible datasets and collaborative efforts from both technological and research communities to overcome these challenges and fully harness the potential of autonomous driving.

Read more

4/23/2024

InScope: A New Real-world 3D Infrastructure-side Collaborative Perception Dataset for Open Traffic Scenarios
Total Score

0

InScope: A New Real-world 3D Infrastructure-side Collaborative Perception Dataset for Open Traffic Scenarios

Xiaofei Zhang, Yining Li, Jinping Wang, Xiangyi Qin, Ying Shen, Zhengping Fan, Xiaojun Tan

Perception systems of autonomous vehicles are susceptible to occlusion, especially when examined from a vehicle-centric perspective. Such occlusion can lead to overlooked object detections, e.g., larger vehicles such as trucks or buses may create blind spots where cyclists or pedestrians could be obscured, accentuating the safety concerns associated with such perception system limitations. To mitigate these challenges, the vehicle-to-everything (V2X) paradigm suggests employing an infrastructure-side perception system (IPS) to complement autonomous vehicles with a broader perceptual scope. Nevertheless, the scarcity of real-world 3D infrastructure-side datasets constrains the advancement of V2X technologies. To bridge these gaps, this paper introduces a new 3D infrastructure-side collaborative perception dataset, abbreviated as inscope. Notably, InScope is the first dataset dedicated to addressing occlusion challenges by strategically deploying multiple-position Light Detection and Ranging (LiDAR) systems on the infrastructure side. Specifically, InScope encapsulates a 20-day capture duration with 303 tracking trajectories and 187,787 3D bounding boxes annotated by experts. Through analysis of benchmarks, four different benchmarks are presented for open traffic scenarios, including collaborative 3D object detection, multisource data fusion, data domain transfer, and 3D multiobject tracking tasks. Additionally, a new metric is designed to quantify the impact of occlusion, facilitating the evaluation of detection degradation ratios among various algorithms. The Experimental findings showcase the enhanced performance of leveraging InScope to assist in detecting and tracking 3D multiobjects in real-world scenarios, particularly in tracking obscured, small, and distant objects. The dataset and benchmarks are available at https://github.com/xf-zh/InScope.

Read more

8/1/2024

DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset
Total Score

0

DeepSense-V2V: A Vehicle-to-Vehicle Multi-Modal Sensing, Localization, and Communications Dataset

Joao Morais, Gouranga Charan, Nikhil Srinivas, Ahmed Alkhateeb

High data rate and low-latency vehicle-to-vehicle (V2V) communication are essential for future intelligent transport systems to enable coordination, enhance safety, and support distributed computing and intelligence requirements. Developing effective communication strategies, however, demands realistic test scenarios and datasets. This is important at the high-frequency bands where more spectrum is available, yet harvesting this bandwidth is challenged by the need for direction transmission and the sensitivity of signal propagation to blockages. This work presents the first large-scale multi-modal dataset for studying mmWave vehicle-to-vehicle communications. It presents a two-vehicle testbed that comprises data from a 360-degree camera, four radars, four 60 GHz phased arrays, a 3D lidar, and two precise GPSs. The dataset contains vehicles driving during the day and night for 120 km in intercity and rural settings, with speeds up to 100 km per hour. More than one million objects were detected across all images, from trucks to bicycles. This work further includes detailed dataset statistics that prove the coverage of various situations and highlights how this dataset can enable novel machine-learning applications.

Read more

6/27/2024