A Unified Formulation of Geometry-aware Dynamic Movement Primitives

2203.03374

YC

0

Reddit

0

Published 6/10/2024 by Fares J. Abu-Dakka, Matteo Saveriano, Ville Kyrki

🛸

Abstract

Learning from demonstration (LfD) is considered as an efficient way to transfer skills from humans to robots. Traditionally, LfD has been used to transfer Cartesian and joint positions and forces from human demonstrations. The traditional approach works well for some robotic tasks, but for many tasks of interest, it is necessary to learn skills such as orientation, impedance, and/or manipulability that have specific geometric characteristics. An effective encoding of such skills can be only achieved if the underlying geometric structure of the skill manifold is considered and the constrains arising from this structure are fulfilled during both learning and execution. However, typical learned skill models such as dynamic movement primitives (DMPs) are limited to Euclidean data and fail in correctly embedding quantities with geometric constraints. In this paper, we propose a novel and mathematically principled framework that uses concepts from Riemannian geometry to allow DMPs to properly embed geometric constrains. The resulting DMP formulation can deal with data sampled from any Riemannian manifold including, but not limited to, unit quaternions and symmetric and positive definite matrices. The proposed approach has been extensively evaluated both on simulated data and real robot experiments. The performed evaluation demonstrates that beneficial properties of DMPs, such as convergence to a given goal and the possibility to change the goal during operation, apply also to the proposed formulation.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • Learning from Demonstration (LfD) is a way to transfer skills from humans to robots
  • Traditional LfD methods focus on learning Cartesian and joint positions and forces
  • This works well for some tasks, but many tasks require learning skills like orientation, impedance, and manipulability that have specific geometric characteristics
  • Typical skill models like Dynamic Movement Primitives (DMPs) are limited to Euclidean data and struggle to correctly embed skills with geometric constraints

Plain English Explanation

Robots can learn new skills by watching humans perform them, a technique called Learning from Demonstration (LfD). Traditionally, LfD has been used to teach robots things like joint positions and forces. This works well for some simple tasks, but many real-world skills involve more complex geometric properties, like how to hold an object at a specific orientation or with a particular stiffness.

Typical skill models like Dynamic Movement Primitives (DMPs) are good at learning basic movements, but they're limited to working with flat, Euclidean data. This means they can't properly capture the underlying geometric structure of more sophisticated skills.

Technical Explanation

This paper proposes a new framework that uses Riemannian geometry to extend DMPs so they can learn skills with geometric constraints. The key idea is to model the skill manifold - the set of all possible skill configurations - as a Riemannian manifold. This allows the DMP formulation to properly embed quantities like orientation, represented by unit quaternions, and symmetric positive definite matrices, which describe impedance and manipulability.

The authors evaluate their approach on both simulated data and real robot experiments. They show that beneficial DMP properties like convergence to a goal and the ability to change the goal during execution still hold for the new Riemannian DMP formulation.

Critical Analysis

The paper presents a principled and mathematically-grounded approach to encoding geometric skills in a DMP framework. This is an important contribution, as many real-world robotic tasks require precisely controlling properties beyond just position and force.

However, the authors acknowledge that their framework is limited to skills that can be represented as Riemannian manifolds. Some robotic skills may have more complex, non-Riemannian geometric structure that is not captured by this approach.

Additionally, the paper does not explore how this Riemannian DMP framework could be combined with other skill learning and reuse techniques. Integrating this work with complementary approaches could lead to more powerful and versatile skill learning capabilities for robots.

Conclusion

This paper introduces an important advancement in Learning from Demonstration by extending the popular DMP framework to handle skills with non-Euclidean geometric constraints. By modeling the skill manifold as a Riemannian manifold, the authors enable DMPs to properly learn and encode orientation, impedance, and manipulability - key properties for many real-world robotic tasks. While limited to Riemannian manifold skills, this work represents a significant step forward in equipping robots with the geometric reasoning capabilities needed to learn and reproduce complex human skills.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

👁️

Logic Dynamic Movement Primitives for Long-horizon Manipulation Tasks in Dynamic Environments

Yan Zhang, Teng Xue, Amirreza Razmjoo, Sylvain Calinon

YC

0

Reddit

0

Learning from Demonstration (LfD) stands as an efficient framework for imparting human-like skills to robots. Nevertheless, designing an LfD framework capable of seamlessly imitating, generalizing, and reacting to disturbances for long-horizon manipulation tasks in dynamic environments remains a challenge. To tackle this challenge, we present Logic Dynamic Movement Primitives (Logic-DMP), which combines Task and Motion Planning (TAMP) with an optimal control formulation of DMP, allowing us to incorporate motion-level via-point specifications and to handle task-level variations or disturbances in dynamic environments. We conduct a comparative analysis of our proposed approach against several baselines, evaluating its generalization ability and reactivity across three long-horizon manipulation tasks. Our experiment demonstrates the fast generalization and reactivity of Logic-DMP for handling task-level variants and disturbances in long-horizon manipulation tasks.

Read more

6/26/2024

🎲

Phase-free Dynamic Movement Primitives Applied to Kinesthetic Guidance in Robotic Co-manipulation Tasks

Giovanni Braglia, Davide Tebaldi, Luigi Biagiotti

YC

0

Reddit

0

Whenever a robotic task needs to be defined and adapted based on a reference motion, Dynamic Movement Primitives (DMP) represent a standard and efficient method for encoding it. The nominal trajectory is typically obtained through a Programming by Demonstration (PbD) approach, where the robot is taught a specific task through kinesthetic guidance. Subsequently, the motion is reproduced by the manipulator in terms of both geometric path and timing law. The basic approach for modifying the duration of the execution involves adjusting a time constant characterizing the model. On the contrary, the goal of this paper is to achieve a complete decoupling between the geometric information of the task and the timing law governing the execution, thanks to a new spatial sampling algorithm. This leads to a new DMP concept called Geometric DMP (GDMP), which exhibits the property of being phase-free since the phase variable is no longer constrained to the demonstration timing law. GDMP open up to a variety of applications, including task duration optimization subject to velocity and acceleration constraints and human-in-the-loop applications in co-manipulation tasks. With reference to the latter application, a co-manipulation activity where the robot assists the humans in reproducing simple rehabilitation tasks is considered in this paper as a case study. A custom phase law is designed and the system passivity and stability analyses are carried out. The conclusions drawn through the system stability analysis are validated by the proposed experimental results.

Read more

6/5/2024

An Adaptive Framework for Manipulator Skill Reproduction in Dynamic Environments

An Adaptive Framework for Manipulator Skill Reproduction in Dynamic Environments

Ryan Donald, Brendan Hertel, Stephen Misenti, Yan Gu, Reza Azadeh

YC

0

Reddit

0

Robot skill learning and execution in uncertain and dynamic environments is a challenging task. This paper proposes an adaptive framework that combines Learning from Demonstration (LfD), environment state prediction, and high-level decision making. Proactive adaptation prevents the need for reactive adaptation, which lags behind changes in the environment rather than anticipating them. We propose a novel LfD representation, Elastic-Laplacian Trajectory Editing (ELTE), which continuously adapts the trajectory shape to predictions of future states. Then, a high-level reactive system using an Unscented Kalman Filter (UKF) and Hidden Markov Model (HMM) prevents unsafe execution in the current state of the dynamic environment based on a discrete set of decisions. We first validate our LfD representation in simulation, then experimentally assess the entire framework using a legged mobile manipulator in 36 real-world scenarios. We show the effectiveness of the proposed framework under different dynamic changes in the environment. Our results show that the proposed framework produces robust and stable adaptive behaviors.

Read more

5/27/2024

Movement Primitive Diffusion: Learning Gentle Robotic Manipulation of Deformable Objects

Paul Maria Scheikl, Nicolas Schreiber, Christoph Haas, Niklas Freymuth, Gerhard Neumann, Rudolf Lioutikov, Franziska Mathis-Ullrich

YC

0

Reddit

0

Policy learning in robot-assisted surgery (RAS) lacks data efficient and versatile methods that exhibit the desired motion quality for delicate surgical interventions. To this end, we introduce Movement Primitive Diffusion (MPD), a novel method for imitation learning (IL) in RAS that focuses on gentle manipulation of deformable objects. The approach combines the versatility of diffusion-based imitation learning (DIL) with the high-quality motion generation capabilities of Probabilistic Dynamic Movement Primitives (ProDMPs). This combination enables MPD to achieve gentle manipulation of deformable objects, while maintaining data efficiency critical for RAS applications where demonstration data is scarce. We evaluate MPD across various simulated and real world robotic tasks on both state and image observations. MPD outperforms state-of-the-art DIL methods in success rate, motion quality, and data efficiency. Project page: https://scheiklp.github.io/movement-primitive-diffusion/

Read more

6/11/2024