Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles

Read original: arXiv:2409.03445 - Published 9/6/2024 by Miao Fan, Yi Yao, Jianping Zhang, Xiangbo Song, Daihui Wu
Total Score

0

Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper proposes a method for generating high-definition (HD) maps from multiple vectorized tiles produced by autonomous vehicles.
  • The research is supported by the National Natural Science Foundation of China under Grant No. U22A20104.
  • The corresponding author's website provides more details about their recent studies: https://godfanmiao.github.io/homepage-en/.

Plain English Explanation

The paper describes a technique for creating detailed maps using data collected by self-driving cars. Autonomous vehicles can generate small, vectorized map tiles as they navigate. By combining many of these tiles from multiple vehicles, the researchers developed a system to assemble a comprehensive, high-definition (HD) map. This allows the creation of accurate, up-to-date maps without the need for costly, large-scale mapping efforts. The approach could improve autonomous driving capabilities by providing detailed, real-time information about the surrounding environment.

Technical Explanation

The paper presents a neural network-based approach for generating HD maps from multiple vectorized tiles produced by autonomous vehicles. The key components include:

  • An encoder-decoder architecture that takes in vectorized map tiles and outputs a high-resolution HD map.
  • Techniques for fusing information from multiple map tiles, including spatial fusion and temporal fusion.
  • Experiments evaluating the performance of the proposed system on real-world autonomous driving datasets.

The results demonstrate the ability to construct accurate HD maps from the distributed, local map tiles generated by autonomous vehicles as they navigate. This represents an efficient alternative to traditional, centralized mapping approaches.

Critical Analysis

The paper acknowledges limitations in the current approach, such as the need for further work to handle dynamic map changes over time. Additionally, the evaluation is limited to simulated datasets, so the real-world performance on diverse environments remains to be validated.

While the proposed method shows promise, there are opportunities to explore alternative fusion techniques and incorporate additional sensor modalities beyond just vectorized map tiles to enhance the robustness and accuracy of the HD map generation.

Conclusion

This research presents a novel approach for constructing high-definition maps from distributed, vectorized tiles generated by autonomous vehicles. By leveraging the collective data from multiple vehicles, the system can efficiently create detailed, up-to-date maps to support advanced autonomous driving capabilities. Further advancements in this area have the potential to improve the safety and reliability of self-driving technology, benefiting both consumers and the broader transportation ecosystem.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles
Total Score

0

Neural HD Map Generation from Multiple Vectorized Tiles Locally Produced by Autonomous Vehicles

Miao Fan, Yi Yao, Jianping Zhang, Xiangbo Song, Daihui Wu

High-definition (HD) map is a fundamental component of autonomous driving systems, as it can provide precise environmental information about driving scenes. Recent work on vectorized map generation could produce merely 65% local map elements around the ego-vehicle at runtime by one tour with onboard sensors, leaving a puzzle of how to construct a global HD map projected in the world coordinate system under high-quality standards. To address the issue, we present GNMap as an end-to-end generative neural network to automatically construct HD maps with multiple vectorized tiles which are locally produced by autonomous vehicles through several tours. It leverages a multi-layer and attention-based autoencoder as the shared network, of which parameters are learned from two different tasks (i.e., pretraining and finetuning, respectively) to ensure both the completeness of generated maps and the correctness of element categories. Abundant qualitative evaluations are conducted on a real-world dataset and experimental results show that GNMap can surpass the SOTA method by more than 5% F1 score, reaching the level of industrial usage with a small amount of manual modification. We have already deployed it at Navinfo Co., Ltd., serving as an indispensable software to automatically build HD maps for autonomous driving systems.

Read more

9/6/2024

GlobalMapNet: An Online Framework for Vectorized Global HD Map Construction
Total Score

0

New!GlobalMapNet: An Online Framework for Vectorized Global HD Map Construction

Anqi Shi, Yuze Cai, Xiangyu Chen, Jian Pu, Zeyu Fu, Hong Lu

High-definition (HD) maps are essential for autonomous driving systems. Traditionally, an expensive and labor-intensive pipeline is implemented to construct HD maps, which is limited in scalability. In recent years, crowdsourcing and online mapping have emerged as two alternative methods, but they have limitations respectively. In this paper, we provide a novel methodology, namely global map construction, to perform direct generation of vectorized global maps, combining the benefits of crowdsourcing and online mapping. We introduce GlobalMapNet, the first online framework for vectorized global HD map construction, which updates and utilizes a global map on the ego vehicle. To generate the global map from scratch, we propose GlobalMapBuilder to match and merge local maps continuously. We design a new algorithm, Map NMS, to remove duplicate map elements and produce a clean map. We also propose GlobalMapFusion to aggregate historical map information, improving consistency of prediction. We examine GlobalMapNet on two widely recognized datasets, Argoverse2 and nuScenes, showing that our framework is capable of generating globally consistent results.

Read more

9/18/2024

Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving
Total Score

0

Online Temporal Fusion for Vectorized Map Construction in Mapless Autonomous Driving

Jiagang Chen, Liangliang Pan, Shunping Ji, Ji Zhao, Zichao Zhang

To reduce the reliance on high-definition (HD) maps, a growing trend in autonomous driving is leveraging on-board sensors to generate vectorized maps online. However, current methods are mostly constrained by processing only single-frame inputs, which hampers their robustness and effectiveness in complex scenarios. To overcome this problem, we propose an online map construction system that exploits the long-term temporal information to build a consistent vectorized map. First, the system efficiently fuses all historical road marking detections from an off-the-shelf network into a semantic voxel map, which is implemented using a hashing-based strategy to exploit the sparsity of road elements. Then reliable voxels are found by examining the fused information and incrementally clustered into an instance-level representation of road markings. Finally, the system incorporates domain knowledge to estimate the geometric and topological structures of roads, which can be directly consumed by the planning and control (PnC) module. Through experiments conducted in complicated urban environments, we have demonstrated that the output of our system is more consistent and accurate than the network output by a large margin and can be effectively used in a closed-loop autonomous driving system.

Read more

9/4/2024

High Definition Map Mapping and Update: A General Overview and Future Directions
Total Score

0

New!High Definition Map Mapping and Update: A General Overview and Future Directions

Benny Wijaya, Kun Jiang, Mengmeng Yang, Tuopu Wen, Yunlong Wang, Xuewei Tang, Zheng Fu, Taohua Zhou, Diange Yang

Along with the rapid growth of autonomous vehicles (AVs), more and more demands are required for environment perception technology. Among others, HD mapping has become one of the more prominent roles in helping the vehicle realize essential tasks such as localization and path planning. While increasing research efforts have been directed toward HD Map development. However, a comprehensive overview of the overall HD map mapping and update framework is still lacking. This article introduces the development and current state of the algorithm involved in creating HD map mapping and its maintenance. As part of this study, the primary data preprocessing approach of processing raw data to information ready to feed for mapping and update purposes, semantic segmentation, and localization are also briefly reviewed. Moreover, the map taxonomy, ontology, and quality assessment are extensively discussed, the map data's general representation method is presented, and the mapping algorithm ranging from SLAM to transformers learning-based approaches are also discussed. The development of the HD map update algorithm, from change detection to the update methods, is also presented. Finally, the authors discuss possible future developments and the remaining challenges in HD map mapping and update technology. This paper simultaneously serves as a position paper and tutorial to those new to HD map mapping and update domains.

Read more

9/17/2024