SICNav: Safe and Interactive Crowd Navigation using Model Predictive Control and Bilevel Optimization

2310.10982

YC

0

Reddit

0

Published 5/29/2024 by Sepehr Samavi, James R. Han, Florian Shkurti, Angela P. Schoellig

📈

Abstract

Robots need to predict and react to human motions to navigate through a crowd without collisions. Many existing methods decouple prediction from planning, which does not account for the interaction between robot and human motions and can lead to the robot getting stuck. We propose SICNav, a Model Predictive Control (MPC) method that jointly solves for robot motion and predicted crowd motion in closed-loop. We model each human in the crowd to be following an Optimal Reciprocal Collision Avoidance (ORCA) scheme and embed that model as a constraint in the robot's local planner, resulting in a bilevel nonlinear MPC optimization problem. We use a KKT-reformulation to cast the bilevel problem as a single level and use a nonlinear solver to optimize. Our MPC method can influence pedestrian motion while explicitly satisfying safety constraints in a single-robot multi-human environment. We analyze the performance of SICNav in two simulation environments and indoor experiments with a real robot to demonstrate safe robot motion that can influence the surrounding humans. We also validate the trajectory forecasting performance of ORCA on a human trajectory dataset.

Create account to get full access

or

If you already have an account, we'll log you in

Overview

  • Robots need to navigate through crowded environments without colliding with humans
  • Existing methods often decouple prediction of human motion from planning robot motion, which can lead to the robot getting stuck
  • The paper proposes SICNav, a Model Predictive Control (MPC) method that jointly optimizes robot motion and predicted crowd motion

Plain English Explanation

The paper focuses on the challenge of getting robots to move safely through crowded environments without running into people. Many existing approaches try to predict how people will move and then plan the robot's path accordingly. However, this decoupled approach doesn't account for the back-and-forth interaction between the robot and the humans, which can cause the robot to get stuck.

To address this, the researchers developed a new method called SICNav that uses Model Predictive Control (MPC) to optimize the robot's motion and the predicted motion of the humans around it simultaneously. The key idea is to model each person as following an "Optimal Reciprocal Collision Avoidance (ORCA)" scheme, and then incorporate that model as a constraint into the robot's planning process.

This joint optimization allows the robot to not just react to the humans, but actively influence their movements in a safe and coordinated way. The researchers tested SICNav in simulations and with a real robot, and found that it could navigate through crowds more effectively than prior decoupled approaches. They also validated the ORCA model's ability to predict human trajectories on a real-world dataset.

Technical Explanation

The core idea behind SICNav is to formulate the robot navigation problem as a bilevel nonlinear Model Predictive Control (MPC) optimization. At the upper level, the robot plans its own motion to reach a goal while avoiding collisions. At the lower level, the motion of each human in the crowd is modeled as following an Optimal Reciprocal Collision Avoidance (ORCA) scheme.

The ORCA model captures how humans tend to cooperatively avoid collisions with each other and with the robot. By embedding this human behavior model as a constraint in the robot's MPC optimization, SICNav can jointly optimize the robot's trajectory and the predicted trajectories of the surrounding humans. This allows the robot to influence the human motions in a safe and coordinated way, rather than just reacting to them.

The researchers used a KKT reformulation to cast the bilevel optimization as a single-level problem, which they then solved using a nonlinear solver. They evaluated SICNav in two different simulation environments as well as indoor experiments with a real robot. The results showed that SICNav enabled the robot to navigate through crowded spaces more effectively than prior decoupled approaches. The researchers also validated the ORCA model's ability to accurately predict human trajectories on a real-world dataset.

Critical Analysis

The paper presents a compelling approach to the challenge of robot navigation in crowded environments. By jointly optimizing the robot's motion and the predicted motion of the surrounding humans, SICNav can enable more effective and coordinated navigation than prior decoupled methods.

However, the paper does acknowledge some limitations of the research. For example, the ORCA model used to represent human behavior may not capture all the nuances of how people move and interact in real-world settings. The researchers also note that the computational complexity of the joint optimization could be a challenge for real-time deployment, especially in large crowds.

Additionally, while the paper demonstrates the performance of SICNav in simulation and limited real-world experiments, further research would be needed to validate its robustness and scalability in more diverse and dynamic crowd scenarios. Integrating social homology-based techniques or mixed-strategy Nash equilibrium approaches could be interesting avenues for enhancing the crowd modeling and interaction capabilities of the SICNav framework.

Conclusion

The SICNav method proposed in this paper represents an important step forward in enabling robots to navigate safely and effectively through crowded environments. By jointly optimizing robot motion and predicted human motion, the approach can facilitate more coordinated and interactive robot-crowd interaction, overcoming the limitations of prior decoupled methods.

While the research has some caveats and areas for further exploration, the core ideas and experimental results suggest that SICNav could have significant implications for a wide range of applications, from autonomous vehicles to service robots in public spaces. As robots become increasingly ubiquitous in our lives, developing such socially aware navigation capabilities will be crucial for their seamless and safe integration into human environments.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Related Papers

📈

Towards Using Fast Embedded Model Predictive Control for Human-Aware Predictive Robot Navigation

Till Hielscher, Lukas Heuer, Frederik Wulle, Luigi Palmieri

YC

0

Reddit

0

Predictive planning is a key capability for robots to efficiently and safely navigate populated environments. Particularly in densely crowded scenes, with uncertain human motion predictions, predictive path planning, and control can become expensive to compute in real time due to the curse of dimensionality. With the goal of achieving pro-active and legible robot motion in shared environments, in this paper we present HuMAN-MPC, a computationally efficient algorithm for Human Motion Aware Navigation using fast embedded Model Predictive Control. The approach consists of a novel model predictive control (MPC) formulation that leverages a fast state-of-the-art optimization backend based on a sequential quadratic programming real-time iteration scheme while also providing feasibility monitoring. Our experiments, in simulation and on a fully integrated ROS-based platform, show that the approach achieves great scalability with fast computation times without penalizing path quality and efficiency of the resulting avoidance behavior.

Read more

5/22/2024

Learning Strategies For Successful Crowd Navigation

Learning Strategies For Successful Crowd Navigation

Rajshree Daulatabad, Serena Nath

YC

0

Reddit

0

Teaching autonomous mobile robots to successfully navigate human crowds is a challenging task. Not only does it require planning, but it requires maintaining social norms which may differ from one context to another. Here we focus on crowd navigation, using a neural network to learn specific strategies in-situ with a robot. This allows us to take into account human behavior and reactions toward a real robot as well as learn strategies that are specific to various scenarios in that context. A CNN takes a top-down image of the scene as input and outputs the next action for the robot to take in terms of speed and angle. Here we present the method, experimental results, and quantitatively evaluate our approach.

Read more

4/11/2024

SHINE: Social Homology Identification for Navigation in Crowded Environments

SHINE: Social Homology Identification for Navigation in Crowded Environments

Diego Martinez-Baselga, Oscar de Groot, Luzia Knoedler, Luis Riazuelo, Javier Alonso-Mora, Luis Montano

YC

0

Reddit

0

Navigating mobile robots in social environments remains a challenging task due to the intricacies of human-robot interactions. Most of the motion planners designed for crowded and dynamic environments focus on choosing the best velocity to reach the goal while avoiding collisions, but do not explicitly consider the high-level navigation behavior (avoiding through the left or right side, letting others pass or passing before others, etc.). In this work, we present a novel motion planner that incorporates topology distinct paths representing diverse navigation strategies around humans. The planner selects the topology class that imitates human behavior the best using a deep neural network model trained on real-world human motion data, ensuring socially intelligent and contextually aware navigation. Our system refines the chosen path through an optimization-based local planner in real time, ensuring seamless adherence to desired social behaviors. In this way, we decouple perception and local planning from the decision-making process. We evaluate the prediction accuracy of the network with real-world data. In addition, we assess the navigation capabilities in both simulation and a real-world platform, comparing it with other state-of-the-art planners. We demonstrate that our planner exhibits socially desirable behaviors and shows a smooth and remarkable performance.

Read more

4/26/2024

Socially-Aware Shared Control Navigation for Assistive Mobile Robots in the Built Environment

Yifan Xu, Qianwei Wang, Vineet Kamat, Carol Menassa

YC

0

Reddit

0

As the number of Persons with Disabilities (PWD), particularly those with one or more physical impairments, increases, there is an increasing demand for assistive robotic technologies that can support independent mobility in the built environment and reduce the burden on caregivers. Current assistive mobility platforms (e.g., robotic wheelchairs) often fail to incorporate user preferences and control, leading to reduced trust and efficiency. Existing shared control algorithms do not allow the incorporation of the user control preferences inside the navigation framework or the path planning algorithm. In addition, existing dynamic local planner algorithms for robotic wheelchairs do not take into account the social spaces of people, potentially leading such platforms to infringe upon these areas and cause discomfort. To address these concerns, this work introduces a novel socially-aware shared autonomy-based navigation system for assistive mobile robotic platforms. Our navigation framework comprises a Global Planner and a Local Planner. To implement the Global Planner, the proposed approach introduces a novel User Preference Field (UPF) theory within its global planning framework, explicitly acknowledging user preferences to adeptly navigate away from congested areas. For the Local Planner, we propose a Socially-aware Shared Control-based Model Predictive Control with Dynamic Control Barrier Function (SS-MPC-DCBF) to adjust movements in real-time, integrating user preferences for safer, more autonomous navigation. Evaluation results show that our Global Planner aligns closely with user preferences compared to baselines, and our Local Planner demonstrates enhanced safety and efficiency in dynamic and static scenarios. This integrated approach fosters trust and autonomy, crucial for the acceptance of assistive mobility technologies in the built environment.

Read more

5/28/2024