Real-Time Drowsiness Detection Using Eye Aspect Ratio and Facial Landmark Detection

Read original: arXiv:2408.05836 - Published 8/13/2024 by Varun Shiva Krishna Rupani, Velpooru Venkata Sai Thushar, Kondadi Tejith
Total Score

0

🔎

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This study presents a real-time system designed to detect drowsiness using eye tracking and facial landmark detection.
  • The system leverages Dlib's pre-trained shape predictor model to accurately detect and monitor 68 facial landmarks.
  • It calculates the Eye Aspect Ratio (EAR) to determine when the eyes are closed, indicating potential drowsiness.
  • The system reliably detects drowsiness with high accuracy while maintaining low computational demands.
  • Future research will explore incorporating additional physiological and contextual data to enhance detection accuracy and reliability.

Plain English Explanation

The study describes a system that can detect when someone is getting drowsy or falling asleep in real-time. This is important for improving safety in areas like transportation and the workplace. The system uses a computer vision technique called facial landmark detection to track 68 key points on a person's face. It then calculates the Eye Aspect Ratio (EAR) – a measure of how open or closed the eyes are. When the EAR drops below a certain threshold, indicating the eyes are closed, the system flags that the person may be drowsy.

The researchers tested this system and found it could reliably detect drowsiness with high accuracy while using relatively low computing power. This makes it a promising solution for real-time drowsiness detection, such as in driver monitoring or workplace safety applications. Future work will explore adding more data sources, like physiological signals or multimodal face analysis, to further improve the system's accuracy and reliability.

Technical Explanation

The study presents a real-time drowsiness detection system that leverages Dlib's pre-trained shape predictor model to accurately detect and monitor 68 facial landmarks. These landmarks are then used to compute the Eye Aspect Ratio (EAR), a metric that indicates the degree of eye closure.

By establishing a threshold for the EAR, the system can identify when the eyes are closed, which is a strong indicator of drowsiness. The process involves capturing a live video stream, detecting faces in each frame, extracting the eye landmarks, and calculating the EAR to assess the user's level of alertness.

The researchers conducted experiments to evaluate the system's performance and found that it can reliably detect drowsiness with high accuracy while maintaining low computational demands. This makes the system well-suited for real-time applications, such as driver monitoring and workplace safety.

Critical Analysis

The study presents a solid solution for real-time drowsiness detection, but there are a few areas that could be explored further:

  1. Incorporating Additional Data Sources: While the system's reliance on facial landmarks and the EAR is effective, adding physiological signals or multimodal face analysis could potentially enhance the detection accuracy and reliability even further.

  2. Evaluating Performance in Real-World Scenarios: The study's experiments were conducted in a controlled laboratory setting. Assessing the system's performance in more realistic, dynamic environments with varying lighting conditions and head movements would provide valuable insights into its practical applicability.

  3. Addressing Privacy Concerns: As the system relies on facial data, there may be privacy implications that need to be carefully considered, especially for applications in sensitive domains like transportation or workplace monitoring.

Overall, this study offers a promising solution for real-time drowsiness detection, but additional research and development may be necessary to address these potential limitations and further improve the system's capabilities.

Conclusion

This study presents a real-time drowsiness detection system that uses eye tracking and facial landmark analysis to reliably identify when a person is getting drowsy. The system's high accuracy and low computational demands make it a strong candidate for applications in transportation, workplace safety, and other domains where monitoring alertness is crucial.

While the current system shows promising results, future research should explore incorporating additional data sources and evaluating its performance in more real-world scenarios. Addressing privacy concerns will also be an important consideration as this technology becomes more widely adopted. Overall, this research contributes a valuable tool for enhancing safety and wellbeing in various contexts.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔎

Total Score

0

Real-Time Drowsiness Detection Using Eye Aspect Ratio and Facial Landmark Detection

Varun Shiva Krishna Rupani, Velpooru Venkata Sai Thushar, Kondadi Tejith

Drowsiness detection is essential for improving safety in areas such as transportation and workplace health. This study presents a real-time system designed to detect drowsiness using the Eye Aspect Ratio (EAR) and facial landmark detection techniques. The system leverages Dlibs pre-trained shape predictor model to accurately detect and monitor 68 facial landmarks, which are used to compute the EAR. By establishing a threshold for the EAR, the system identifies when eyes are closed, indicating potential drowsiness. The process involves capturing a live video stream, detecting faces in each frame, extracting eye landmarks, and calculating the EAR to assess alertness. Our experiments show that the system reliably detects drowsiness with high accuracy while maintaining low computational demands. This study offers a strong solution for real-time drowsiness detection, with promising applications in driver monitoring and workplace safety. Future research will investigate incorporating additional physiological and contextual data to further enhance detection accuracy and reliability.

Read more

8/13/2024

VigilEye -- Artificial Intelligence-based Real-time Driver Drowsiness Detection
Total Score

0

VigilEye -- Artificial Intelligence-based Real-time Driver Drowsiness Detection

Sandeep Singh Sengar, Aswin Kumar, Owen Singh

This study presents a novel driver drowsiness detection system that combines deep learning techniques with the OpenCV framework. The system utilises facial landmarks extracted from the driver's face as input to Convolutional Neural Networks trained to recognise drowsiness patterns. The integration of OpenCV enables real-time video processing, making the system suitable for practical implementation. Extensive experiments on a diverse dataset demonstrate high accuracy, sensitivity, and specificity in detecting drowsiness. The proposed system has the potential to enhance road safety by providing timely alerts to prevent accidents caused by driver fatigue. This research contributes to advancing real-time driver monitoring systems and has implications for automotive safety and intelligent transportation systems. The successful application of deep learning techniques in this context opens up new avenues for future research in driver monitoring and vehicle safety. The implementation code for the paper is available at https://github.com/LUFFY7001/Driver-s-Drowsiness-Detection.

Read more

6/26/2024

A Survey on Drowsiness Detection -- Modern Applications and Methods
Total Score

0

A Survey on Drowsiness Detection -- Modern Applications and Methods

Biying Fu, Fadi Boutros, Chin-Teng Lin, Naser Damer

Drowsiness detection holds paramount importance in ensuring safety in workplaces or behind the wheel, enhancing productivity, and healthcare across diverse domains. Therefore accurate and real-time drowsiness detection plays a critical role in preventing accidents, enhancing safety, and ultimately saving lives across various sectors and scenarios. This comprehensive review explores the significance of drowsiness detection in various areas of application, transcending the conventional focus solely on driver drowsiness detection. We delve into the current methodologies, challenges, and technological advancements in drowsiness detection schemes, considering diverse contexts such as public transportation, healthcare, workplace safety, and beyond. By examining the multifaceted implications of drowsiness, this work contributes to a holistic understanding of its impact and the crucial role of accurate and real-time detection techniques in enhancing safety and performance. We identified weaknesses in current algorithms and limitations in existing research such as accurate and real-time detection, stable data transmission, and building bias-free systems. Our survey frames existing works and leads to practical recommendations like mitigating the bias issue by using synthetic data, overcoming the hardware limitations with model compression, and leveraging fusion to boost model performance. This is a pioneering work to survey the topic of drowsiness detection in such an entirely and not only focusing on one single aspect. We consider the topic of drowsiness detection as a dynamic and evolving field, presenting numerous opportunities for further exploration.

Read more

8/26/2024

Federated Learning for Drowsiness Detection in Connected Vehicles
Total Score

0

Federated Learning for Drowsiness Detection in Connected Vehicles

William Lindskog, Valentin Spannagl, Christian Prehofer

Ensuring driver readiness poses challenges, yet driver monitoring systems can assist in determining the driver's state. By observing visual cues, such systems recognize various behaviors and associate them with specific conditions. For instance, yawning or eye blinking can indicate driver drowsiness. Consequently, an abundance of distributed data is generated for driver monitoring. Employing machine learning techniques, such as driver drowsiness detection, presents a potential solution. However, transmitting the data to a central machine for model training is impractical due to the large data size and privacy concerns. Conversely, training on a single vehicle would limit the available data and likely result in inferior performance. To address these issues, we propose a federated learning framework for drowsiness detection within a vehicular network, leveraging the YawDD dataset. Our approach achieves an accuracy of 99.2%, demonstrating its promise and comparability to conventional deep learning techniques. Lastly, we show how our model scales using various number of federated clients

Read more

5/7/2024