The Kinetics Observer: A Tightly Coupled Estimator for Legged Robots

Read original: arXiv:2406.13267 - Published 6/21/2024 by Arnaud Demont (CNRS-AIST JRL, LISV), Mehdi Benallegue (CNRS-AIST JRL), Abdelaziz Benallegue (LISV, UVSQ), Pierre Gergondet (CNRS-AIST JRL), Antonin Dallard (LIRMM), Rafael Cisneros (CNRS-AIST JRL), Masaki Murooka (CNRS-AIST JRL), Fumio Kanehiro (CNRS-AIST JRL)
Total Score

0

The Kinetics Observer: A Tightly Coupled Estimator for Legged Robots

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a novel state estimation algorithm called the "Kinetics Observer" for legged robots.
  • The Kinetics Observer tightly couples proprioceptive sensor data, such as joint angles and contact forces, to estimate the robot's motion and contacts with the environment.
  • The authors demonstrate the effectiveness of the Kinetics Observer through simulations and experiments on a humanoid robot.

Plain English Explanation

The Kinetics Observer is a new system that helps legged robots, like humanoid robots, better understand their own movements and interactions with their surroundings. Typically, robots rely on sensors like cameras or laser scanners to try to figure out where they are and what's going on around them. But this paper shows that by closely integrating the robot's own internal sensors, like joint angle measurements and contact force sensors, the robot can get a much more accurate and reliable picture of its state.

The key idea is that the robot's joints, muscles, and contact points with the ground or other objects contain a lot of valuable information about the robot's motion and interactions. By carefully combining all of this proprioceptive data, the Kinetics Observer can estimate the robot's position, orientation, and even detect when it makes contact with its environment. This is important for enabling legged robots to navigate complex environments and perform sophisticated tasks safely and effectively.

The researchers tested their Kinetics Observer system through computer simulations and experiments on a real humanoid robot. The results showed that this tightly-coupled estimation approach outperformed other state-of-the-art methods, providing more accurate and robust state estimates. This could pave the way for more advanced legged robots that can move with greater agility and interact more seamlessly with their surroundings.

Technical Explanation

The key innovation in this paper is the "Kinetics Observer," a tightly-coupled state estimator that fuses proprioceptive sensor data, such as joint angles and contact forces, to estimate the full state of a legged robot. This contrasts with many traditional approaches that rely more heavily on exteroceptive sensors like cameras or laser scanners.

The authors formulate the Kinetics Observer as a nonlinear observer design problem, using a Kalman filter-based framework to optimally combine the robot's internal sensor measurements. This allows the estimator to take advantage of the rich information contained in the robot's joint and contact dynamics, which are often overlooked in looser sensor fusion schemes.

Through both simulation studies and experiments on a humanoid robot platform, the authors demonstrate that the Kinetics Observer outperforms other state-of-the-art state estimation approaches, such as LIKO-LIDAR-Inertial-Kinematic Odometry for Bipedal Robots and OptiState: State Estimation for Legged Robots Using Gated Recurrent Units. The tight coupling of proprioceptive data is shown to provide more accurate and robust state estimates, particularly in scenarios with challenging contact dynamics or occluded exteroceptive sensors.

Critical Analysis

The authors acknowledge several limitations and areas for future work. First, the Kinetics Observer currently assumes perfect knowledge of the robot's kinematic and dynamic parameters, which may not always be the case in practice. Extensions to handle parametric uncertainties or online calibration would be valuable.

Additionally, the paper focuses primarily on state estimation in quasi-static scenarios, with limited discussion of high-speed or highly dynamic motions. Expanding the Kinetics Observer to handle more complex and agile behaviors could further broaden its applicability.

The authors also note that the current implementation relies on a centralized estimator, which may not scale well to larger or more distributed robotic systems. Decentralized or federated estimation approaches, as explored in Fast Decentralized State Estimation for Legged Robot Locomotion, could be an interesting direction for future research.

Finally, the paper does not address the potential impact of sensor noise, outliers, or failures on the Kinetics Observer's performance. Robustness to realistic sensor imperfections would be an important consideration for real-world deployment.

Conclusion

Overall, the Kinetics Observer represents a significant advance in state estimation for legged robots, demonstrating the value of tightly coupling proprioceptive sensor data. By better leveraging the rich information available within the robot's internal dynamics and contacts, the Kinetics Observer can provide more accurate and reliable state estimates, which is crucial for enabling safe and agile legged locomotion.

The authors' results suggest that this approach could lead to more capable and autonomous legged robots, with potential applications in areas like search and rescue, disaster response, and advanced manufacturing. Further research to address the noted limitations and expand the Kinetics Observer's capabilities could help bring this technology closer to real-world deployment.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

The Kinetics Observer: A Tightly Coupled Estimator for Legged Robots
Total Score

0

The Kinetics Observer: A Tightly Coupled Estimator for Legged Robots

Arnaud Demont (CNRS-AIST JRL, LISV), Mehdi Benallegue (CNRS-AIST JRL), Abdelaziz Benallegue (LISV, UVSQ), Pierre Gergondet (CNRS-AIST JRL), Antonin Dallard (LIRMM), Rafael Cisneros (CNRS-AIST JRL), Masaki Murooka (CNRS-AIST JRL), Fumio Kanehiro (CNRS-AIST JRL)

In this paper, we propose the Kinetics Observer, a novel estimator addressing the challenge of state estimation for legged robots using proprioceptive sensors (encoders, IMU and force/torque sensors). Based on a Multiplicative Extended Kalman Filter, the Kinetics Observer allows the real-time simultaneous estimation of contact and perturbation forces, and of the robot's kinematics, which are accurate enough to perform proprioceptive odometry. Thanks to a visco-elastic model of the contacts linking their kinematics to the ones of the centroid of the robot, the Kinetics Observer ensures a tight coupling between the whole-body kinematics and dynamics of the robot. This coupling entails a redundancy of the measurements that enhances the robustness and the accuracy of the estimation. This estimator was tested on two humanoid robots performing long distance walking on even terrain and non-coplanar multi-contact locomotion.

Read more

6/21/2024

LIKO: LiDAR, Inertial, and Kinematic Odometry for Bipedal Robots
Total Score

0

LIKO: LiDAR, Inertial, and Kinematic Odometry for Bipedal Robots

Qingrui Zhao, Mingyuan Li, Yongliang Shi, Xuechao Chen, Zhangguo Yu, Lianqiang Han, Zhenyuan Fu, Jintao Zhang, Chao Li, Yuanxi Zhang, Qiang Huang

High-frequency and accurate state estimation is crucial for biped robots. This paper presents a tightly-coupled LiDAR-Inertial-Kinematic Odometry (LIKO) for biped robot state estimation based on an iterated extended Kalman filter. Beyond state estimation, the foot contact position is also modeled and estimated. This allows for both position and velocity updates from kinematic measurement. Additionally, the use of kinematic measurement results in an increased output state frequency of about 1kHz. This ensures temporal continuity of the estimated state and makes it practical for control purposes of biped robots. We also announce a biped robot dataset consisting of LiDAR, inertial measurement unit (IMU), joint encoders, force/torque (F/T) sensors, and motion capture ground truth to evaluate the proposed method. The dataset is collected during robot locomotion, and our approach reached the best quantitative result among other LIO-based methods and biped robot state estimation algorithms. The dataset and source code will be available at https://github.com/Mr-Zqr/LIKO.

Read more

4/30/2024

OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering
Total Score

0

OptiState: State Estimation of Legged Robots using Gated Networks with Transformer-based Vision and Kalman Filtering

Alexander Schperberg, Yusuke Tanaka, Saviz Mowlavi, Feng Xu, Bharathan Balaji, Dennis Hong

State estimation for legged robots is challenging due to their highly dynamic motion and limitations imposed by sensor accuracy. By integrating Kalman filtering, optimization, and learning-based modalities, we propose a hybrid solution that combines proprioception and exteroceptive information for estimating the state of the robot's trunk. Leveraging joint encoder and IMU measurements, our Kalman filter is enhanced through a single-rigid body model that incorporates ground reaction force control outputs from convex Model Predictive Control optimization. The estimation is further refined through Gated Recurrent Units, which also considers semantic insights and robot height from a Vision Transformer autoencoder applied on depth images. This framework not only furnishes accurate robot state estimates, including uncertainty evaluations, but can minimize the nonlinear errors that arise from sensor measurements and model simplifications through learning. The proposed methodology is evaluated in hardware using a quadruped robot on various terrains, yielding a 65% improvement on the Root Mean Squared Error compared to our VIO SLAM baseline. Code example: https://github.com/AlexS28/OptiState

Read more

4/30/2024

Simultaneous State Estimation and Contact Detection for Legged Robots by Multiple-Model Kalman Filtering
Total Score

0

Simultaneous State Estimation and Contact Detection for Legged Robots by Multiple-Model Kalman Filtering

Marcel Menner, Karl Berntorp

This paper proposes an algorithm for combined contact detection and state estimation for legged robots. The proposed algorithm models the robot's movement as a switched system, in which different modes relate to different feet being in contact with the ground. The key element in the proposed algorithm is an interacting multiple-model Kalman filter, which identifies the currently-active mode defining contacts, while estimating the state. The rationale for the proposed estimation framework is that contacts (and contact forces) impact the robot's state and vice versa. This paper presents validation studies with a quadruped using (i) the high-fidelity simulator Gazebo for a comparison with ground truth values and a baseline estimator, and (ii) hardware experiments with the Unitree A1 robot. The simulation study shows that the proposed algorithm outperforms the baseline estimator, which does not simultaneous detect contacts. The hardware experiments showcase the applicability of the proposed algorithm and highlights the ability to detect contacts.

Read more

4/5/2024