Extrinsic Calibration of Multiple LiDARs for a Mobile Robot based on Floor Plane And Object Segmentation

Read original: arXiv:2403.14161 - Published 9/16/2024 by Shun Niijima, Atsushi Suzuki, Ryoichi Tsuzaki, Masaya Kinoshita
Total Score

0

Extrinsic Calibration of Multiple LiDARs for a Mobile Robot based on Floor Plane And Object Segmentation

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a method for the extrinsic calibration of multiple LiDARs on a mobile robot.
  • The proposed approach uses floor plane and object segmentation to identify common features between the LiDARs, enabling accurate calibration without the need for specialized calibration targets.
  • The method is evaluated on real-world data, demonstrating its effectiveness and robustness.

Plain English Explanation

In this paper, the researchers developed a technique to calibrate the extrinsic parameters of multiple LiDARs mounted on a mobile robot. Extrinsic parameters refer to the physical positioning and orientation of the sensors relative to each other.

Typically, calibrating multiple LiDARs requires specialized calibration targets, which can be cumbersome to set up and may not always be available. The researchers' approach overcomes this limitation by using the floor plane and segmented objects in the environment as the reference features for calibration.

The key idea is to identify common features (such as the floor and objects) that are visible to all the LiDARs. By analyzing the spatial relationships between these shared features, the researchers can determine the relative positioning and orientation of the LiDARs without the need for dedicated calibration objects.

This method is particularly useful for mobile robots, where the LiDARs may need to be frequently recalibrated as the robot moves around and the sensor configuration changes. The researchers demonstrate the effectiveness of their approach using real-world experimental data, showing that it can accurately calibrate the LiDARs in a robust and efficient manner.

Technical Explanation

The paper presents an extrinsic calibration method for multiple LiDARs on a mobile robot, which uses floor plane and object segmentation to identify common features between the sensors.

The researchers first segment the floor plane and objects in the point cloud data from each LiDAR. They then use the spatial relationships between these shared features to estimate the relative poses (position and orientation) of the LiDARs.

The calibration process involves two main steps:

  1. Initial Pose Estimation: The researchers use the normal vectors of the floor plane and the centroids of the segmented objects to obtain an initial estimate of the LiDARs' relative poses.

  2. Iterative Refinement: They then employ an iterative optimization algorithm to refine the pose estimates, minimizing the distances between corresponding floor planes and object centroids across the LiDARs.

The proposed method is robust to partial occlusions and varying object sizes, as it does not rely on specialized calibration targets. The researchers evaluate their approach using real-world data, demonstrating its effectiveness and accuracy in calibrating multiple LiDARs on a mobile robot.

Critical Analysis

The researchers' approach offers several advantages over traditional LiDAR calibration methods that rely on dedicated calibration targets:

  • Flexibility: The use of floor plane and object segmentation allows the calibration to be performed without the need for specialized equipment, which can be particularly useful for mobile robot applications.
  • Robustness: The method is resilient to partial occlusions and varying object sizes, making it suitable for real-world scenarios.
  • Accuracy: The experiments show that the proposed calibration technique can achieve accurate results, comparable to or even better than those obtained with target-based methods.

However, the paper also identifies some potential limitations and areas for further research:

  • Sensitivity to Segmentation Accuracy: The performance of the calibration method is dependent on the accuracy of the floor plane and object segmentation algorithms, which could be affected by environmental conditions or sensor noise.
  • Scalability: The paper only considers a setup with two LiDARs. Extending the method to calibrate a larger number of sensors may require additional considerations or modifications.
  • Computational Complexity: The iterative optimization step could be computationally intensive, especially for larger-scale setups. Exploring ways to improve the efficiency of this step could be a valuable direction for future research.

Overall, the researchers have presented a promising approach for the extrinsic calibration of multiple LiDARs on mobile robots, which addresses the limitations of traditional target-based methods. Further refinements and evaluations on larger-scale deployments could help strengthen the practical applicability of this technique.

Conclusion

This paper introduces a novel method for the extrinsic calibration of multiple LiDARs on a mobile robot, which leverages floor plane and object segmentation to identify common features across the sensors. The proposed approach eliminates the need for specialized calibration targets, making it more flexible and practical for real-world mobile robot applications.

The researchers demonstrate the effectiveness and accuracy of their method through extensive experiments using real-world data. While the technique shows promising results, the authors also acknowledge potential limitations, such as sensitivity to segmentation accuracy and computational complexity, which could be addressed in future research.

Overall, this work represents a significant contribution to the field of LiDAR calibration for mobile robots, offering a practical and robust solution that can enable more reliable and efficient multi-sensor perception systems.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Extrinsic Calibration of Multiple LiDARs for a Mobile Robot based on Floor Plane And Object Segmentation
Total Score

0

New!Extrinsic Calibration of Multiple LiDARs for a Mobile Robot based on Floor Plane And Object Segmentation

Shun Niijima, Atsushi Suzuki, Ryoichi Tsuzaki, Masaya Kinoshita

Mobile robots equipped with multiple light detection and ranging (LiDARs) and capable of recognizing their surroundings are increasing due to the minitualization and cost reduction of LiDAR. This paper proposes a target-less extrinsic calibration method of multiple LiDARs with non-overlapping field of view (FoV). The proposed method uses accumulated point clouds of floor plane and objects while in motion. It enables accurate calibration with challenging configuration of LiDARs that directed towards the floor plane, caused by biased feature values. Additionally, the method includes a noise removal module that considers the scanning pattern to address bleeding points, which are noises of significant source of error in point cloud alignment using high-density LiDARs. Evaluations through simulation demonstrate that the proposed method achieved higher accuracy extrinsic calibration with two and four LiDARs than conventional methods, regardless type of objects. Furthermore, the experiments using a real mobile robot has shown that our proposed noise removal module can eliminate noise more precisely than conventional methods, and the estimated extrinsic parameters have successfully created consistent 3D maps.

Read more

9/16/2024

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems
Total Score

0

YOCO: You Only Calibrate Once for Accurate Extrinsic Parameter in LiDAR-Camera Systems

Tianle Zeng, Dengke He, Feifan Yan, Meixi He

In a multi-sensor fusion system composed of cameras and LiDAR, precise extrinsic calibration contributes to the system's long-term stability and accurate perception of the environment. However, methods based on extracting and registering corresponding points still face challenges in terms of automation and precision. This paper proposes a novel fully automatic extrinsic calibration method for LiDAR-camera systems that circumvents the need for corresponding point registration. In our approach, a novel algorithm to extract required LiDAR correspondence point is proposed. This method can effectively filter out irrelevant points by computing the orientation of plane point clouds and extracting points by applying distance- and density-based thresholds. We avoid the need for corresponding point registration by introducing extrinsic parameters between the LiDAR and camera into the projection of extracted points and constructing co-planar constraints. These parameters are then optimized to solve for the extrinsic. We validated our method across multiple sets of LiDAR-camera systems. In synthetic experiments, our method demonstrates superior performance compared to current calibration techniques. Real-world data experiments further confirm the precision and robustness of the proposed algorithm, with average rotation and translation calibration errors between LiDAR and camera of less than 0.05 degree and 0.015m, respectively. This method enables automatic and accurate extrinsic calibration in a single one step, emphasizing the potential of calibration algorithms beyond using corresponding point registration to enhance the automation and precision of LiDAR-camera system calibration.

Read more

7/26/2024

Total Score

0

Galibr: Targetless LiDAR-Camera Extrinsic Calibration Method via Ground Plane Initialization

Wonho Song, Minho Oh, Jaeyoung Lee, Hyun Myung

With the rapid development of autonomous driving and SLAM technology, the performance of autonomous systems using multimodal sensors highly relies on accurate extrinsic calibration. Addressing the need for a convenient, maintenance-friendly calibration process in any natural environment, this paper introduces Galibr, a fully automatic targetless LiDAR-camera extrinsic calibration tool designed for ground vehicle platforms in any natural setting. The method utilizes the ground planes and edge information from both LiDAR and camera inputs, streamlining the calibration process. It encompasses two main steps: an initial pose estimation algorithm based on ground planes (GP-init), and a refinement phase through edge extraction and matching. Our approach significantly enhances calibration performance, primarily attributed to our novel initial pose estimation method, as demonstrated in unstructured natural environments, including on the KITTI dataset and the KAIST quadruped dataset.

Read more

6/18/2024

Automatic Target-Less Camera-LiDAR Calibration From Motion and Deep Point Correspondences
Total Score

0

Automatic Target-Less Camera-LiDAR Calibration From Motion and Deep Point Correspondences

Kursat Petek, Niclas Vodisch, Johannes Meyer, Daniele Cattaneo, Abhinav Valada, Wolfram Burgard

Sensor setups of robotic platforms commonly include both camera and LiDAR as they provide complementary information. However, fusing these two modalities typically requires a highly accurate calibration between them. In this paper, we propose MDPCalib which is a novel method for camera-LiDAR calibration that requires neither human supervision nor any specific target objects. Instead, we utilize sensor motion estimates from visual and LiDAR odometry as well as deep learning-based 2D-pixel-to-3D-point correspondences that are obtained without in-domain retraining. We represent the camera-LiDAR calibration as a graph optimization problem and minimize the costs induced by constraints from sensor motion and point correspondences. In extensive experiments, we demonstrate that our approach yields highly accurate extrinsic calibration parameters and is robust to random initialization. Additionally, our approach generalizes to a wide range of sensor setups, which we demonstrate by employing it on various robotic platforms including a self-driving perception car, a quadruped robot, and a UAV. To make our calibration method publicly accessible, we release the code on our project website at http://calibration.cs.uni-freiburg.de.

Read more

4/29/2024