Autonomous Drone Racing: A Survey
0
🤷
Sign in to get full access
Overview
- Over the last decade, the use of autonomous drones for tasks like surveying, search and rescue, and last-mile delivery has grown rapidly.
- This increase in drone applications has driven the need for robust, safety-critical algorithms that can operate drones in complex, uncertain environments.
- Flying drones at high speeds can improve their productivity and usefulness, but also poses significant challenges for perception, planning, control, and state estimation.
- Autonomous drone racing is a proxy for developing high-speed navigation algorithms, where drones must quickly navigate through gates and avoid obstacles using onboard sensors and limited computing power.
Plain English Explanation
Drones, or unmanned aerial vehicles, have become increasingly popular for a variety of uses over the past 10 years. From surveying land and helping with search and rescue operations to delivering packages the "last mile" to a customer's door, drones have proven to be a versatile technology. However, as drones take on more complex and safety-critical tasks, the algorithms that control them need to be highly robust and reliable.
One way researchers are working to develop these advanced algorithms is through the task of autonomous drone racing. In this setting, drones are programmed to fly through a series of gates as quickly as possible, avoiding obstacles along the way using only the sensors and computing power on the drone itself. The drones can reach speeds over 80 km/h (50 mph) and accelerations over 4 g, which creates significant challenges around perception, planning, control, and state estimation. The algorithms need to be extremely fast and robust to handle issues like motion blur, changes in lighting, uncertainties in the drone's dynamics, and even unpredictable movements of opponents.
By studying autonomous drone racing, researchers hope to develop the fundamental technologies needed to enable a wide range of high-speed, safety-critical drone applications in the real world.
Technical Explanation
The paper provides an overview of the progress made in autonomous drone racing, covering both model-based and learning-based approaches. The authors discuss the key challenges involved, including the need for real-time perception, planning, control, and state estimation algorithms that can handle the high speeds, accelerations, and uncertainties present in this domain.
In autonomous drone racing, the drones must navigate through a series of gates as quickly as possible using only onboard sensors and limited computational resources. Speeds can exceed 80 km/h (50 mph) and accelerations can be over 4 g, posing significant challenges across the autonomy stack. The algorithms must be robust to issues like motion blur, high dynamic range environments, model uncertainties, aerodynamic disturbances, and the unpredictable behavior of opponents.
The authors survey the evolution of autonomous drone racing over the years, covering both traditional, model-based approaches as well as more recent, learning-based methods. They discuss the tradeoffs and relative strengths of these different techniques, and highlight the key breakthroughs and remaining challenges in this rapidly advancing field.
Critical Analysis
The paper provides a comprehensive overview of the state of the art in autonomous drone racing, covering both the technical progress and the significant challenges that still need to be addressed. The authors acknowledge the limitations of current approaches, such as their sensitivity to model uncertainties and the need for large amounts of training data for learning-based methods.
One area that could be explored further is the potential for hybrid approaches that combine model-based and learning-based techniques. This could help leverage the strengths of both paradigms and potentially improve robustness and generalization.
Additionally, the authors could have delved deeper into the safety implications of high-speed drone autonomy and the regulatory hurdles that need to be overcome before these systems can be deployed in real-world, populated environments. As drone applications become more advanced and safety-critical, these societal and policy considerations will be crucial.
Overall, the paper provides a valuable synthesis of the state of the art in autonomous drone racing and highlights the important research directions that will shape the future of this field.
Conclusion
This survey paper outlines the rapid growth of autonomous drone applications and the corresponding need for highly robust, safety-critical algorithms to enable these systems to operate in complex, uncertain environments. Autonomous drone racing is presented as a proxy for developing high-speed navigation capabilities, where drones must quickly navigate through gates and avoid obstacles using limited onboard resources.
The authors review the progression of both model-based and learning-based approaches in this domain, discussing the key challenges around perception, planning, control, and state estimation. They conclude by highlighting the biggest open questions and areas for future research, underscoring the importance of continued advancements in this field to unlock the full potential of drone technology for a wide range of real-world applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
🤷
0
Autonomous Drone Racing: A Survey
Drew Hanover, Antonio Loquercio, Leonard Bauersfeld, Angel Romero, Robert Penicka, Yunlong Song, Giovanni Cioffi, Elia Kaufmann, Davide Scaramuzza
Over the last decade, the use of autonomous drone systems for surveying, search and rescue, or last-mile delivery has increased exponentially. With the rise of these applications comes the need for highly robust, safety-critical algorithms which can operate drones in complex and uncertain environments. Additionally, flying fast enables drones to cover more ground which in turn increases productivity and further strengthens their use case. One proxy for developing algorithms used in high-speed navigation is the task of autonomous drone racing, where researchers program drones to fly through a sequence of gates and avoid obstacles as quickly as possible using onboard sensors and limited computational power. Speeds and accelerations exceed over 80 kph and 4 g respectively, raising significant challenges across perception, planning, control, and state estimation. To achieve maximum performance, systems require real-time algorithms that are robust to motion blur, high dynamic range, model uncertainties, aerodynamic disturbances, and often unpredictable opponents. This survey covers the progression of autonomous drone racing across model-based and learning-based approaches. We provide an overview of the field, its evolution over the years, and conclude with the biggest challenges and open questions to be faced in the future.
Read more7/9/2024
📶
0
Research on an Autonomous UAV Search and Rescue System Based on the Improved
Haobin Chen, Junyu Tao, Bize Zhou, Xiaoyan Liu
The demand is to solve the issue of UAV (unmanned aerial vehicle) operating autonomously and implementing practical functions such as search and rescue in complex unknown environments. This paper proposes an autonomous search and rescue UAV system based on an EGO-Planner algorithm, which is improved by innovative UAV body application and takes the methods of inverse motor backstepping to enhance the overall flight efficiency of the UAV and miniaturization of the whole machine. At the same time, the system introduced the EGO-Planner planning tool, which is optimized by a bidirectional A* algorithm along with an object detection algorithm. It solves the issue of intelligent obstacle avoidance and search and rescue. Through the simulation and field verification work, and compared with traditional algorithms, this method shows more efficiency and reliability in the task. In addition, due to the existing algorithm's improved robustness, this application shows good prospection.
Read more6/10/2024
0
Demonstrating Agile Flight from Pixels without State Estimation
Ismail Geles, Leonard Bauersfeld, Angel Romero, Jiaxu Xing, Davide Scaramuzza
Quadrotors are among the most agile flying robots. Despite recent advances in learning-based control and computer vision, autonomous drones still rely on explicit state estimation. On the other hand, human pilots only rely on a first-person-view video stream from the drone onboard camera to push the platform to its limits and fly robustly in unseen environments. To the best of our knowledge, we present the first vision-based quadrotor system that autonomously navigates through a sequence of gates at high speeds while directly mapping pixels to control commands. Like professional drone-racing pilots, our system does not use explicit state estimation and leverages the same control commands humans use (collective thrust and body rates). We demonstrate agile flight at speeds up to 40km/h with accelerations up to 2g. This is achieved by training vision-based policies with reinforcement learning (RL). The training is facilitated using an asymmetric actor-critic with access to privileged information. To overcome the computational complexity during image-based RL training, we use the inner edges of the gates as a sensor abstraction. This simple yet robust, task-relevant representation can be simulated during training without rendering images. During deployment, a Swin-transformer-based gate detector is used. Our approach enables autonomous agile flight with standard, off-the-shelf hardware. Although our demonstration focuses on drone racing, we believe that our method has an impact beyond drone racing and can serve as a foundation for future research into real-world applications in structured environments.
Read more6/19/2024
0
Gate-Aware Online Planning for Two-Player Autonomous Drone Racing
Fangguo Zhao, Jiahao Mei, Jin Zhou, Yuanyi Chen, Jiming Chen, Shuo Li
The flying speed of autonomous quadrotors has increased significantly over the past 5 years, particularly in the field of autonomous drone racing. However, most research primarily focuses on the aggressive flight of a single quadrotor, simplifying the racing gate traversal problem to a waypoint passing problem that neglects the orientations of the racing gates. In this paper, we propose a systematic method called Pairwise Model Predictive Control (PMPC) that can guide two quadrotors online to navigate racing gates with minimal time and without collisions. The flight task is initially simplified as a point-mass model waypoint passing problem to provide analytical time optimal reference through an efficient two-step velocity search method. Subsequently, we utilize the spatial configuration of the racing track to compute the optimal heading at each gate, maximizing the visibility of subsequent gates for the quadrotors. To address varying gate orientations, we introduce a novel Magnetic Induction Line-based spatial curve to guide the quadrotors through racing gates of different orientations. Furthermore, we formulate a nonlinear optimization problem that uses the point-mass trajectory as initial values and references to enhance solving efficiency, enabling the method to run onboard at a frequency of 200 Hz. The feasibility of the proposed method is validated through both simulation and real-world experiments. In real-world tests, the two quadrotors achieved a top speed of 6.1 m/s on a 7-waypoint racing track within a compact flying arena of 5 m * 4 m * 2 m.
Read more9/24/2024