Data-driven Semi-supervised Machine Learning with Surrogate Safety Measures for Abnormal Driving Behavior Detection

Read original: arXiv:2312.04610 - Published 5/27/2024 by Yongqi Dong, Lanxin Zhang, Haneen Farah, Arkady Zgonnikov, Bart van Arem

🔎

Overview

This study analyzes real-world driving data to detect abnormal driving behaviors, such as sudden acceleration and rapid lane-changing.
A semi-supervised machine learning (ML) method called Hierarchical Extreme Learning Machines (HELM) is developed to accurately detect these abnormal behaviors.
The study introduces Surrogate Safety Measures (SSMs) as input features for the ML models to improve detection performance.

Plain English Explanation

Detecting abnormal driving is crucial for road safety and evaluating driver behavior. With the availability of driving data and advancements in machine learning, many models have been developed to identify abnormal driving. Most of these models rely on supervised learning, which requires a lot of labeled data. However, obtaining ground truth labels can be difficult in the real world, so there is a need for unsupervised or semi-supervised approaches to make the anomaly detection process more feasible.

This study tackles this challenge by analyzing real-world driving data to identify various abnormal behaviors, such as sudden acceleration and rapid lane changes. It then develops a semi-supervised machine learning method called Hierarchical Extreme Learning Machines (HELM) to accurately detect these abnormal behaviors using partly labeled data.

Importantly, the study introduces Surrogate Safety Measures (SSMs) as input features for the machine learning models. SSMs are indicators of safety, such as the distance between vehicles or the time to collision. By using these safety-related features, the models can better detect abnormal driving behaviors that compromise road safety.

The results show that the proposed semi-supervised HELM model, with the SSM features, outperforms other baseline semi-supervised and unsupervised methods in terms of accuracy and other performance metrics. This suggests that semi-supervised learning and safety-focused features can be effective for detecting abnormal driving behaviors in the real world.

Technical Explanation

The study analyzes large-scale real-world driving data to identify various abnormal driving behaviors, such as sudden acceleration and rapid lane-changing. To detect these abnormal behaviors, the researchers develop a semi-supervised machine learning method called Hierarchical Extreme Learning Machines (HELM).

Unlike fully supervised methods that require substantial labeled data, the proposed HELM model can work with partially labeled data, making it more practical for real-world applications where ground truth labels are not always available. The HELM architecture consists of multiple layers of Extreme Learning Machines (ELMs), a type of neural network that can be trained efficiently.

To improve the detection performance, the study introduces Surrogate Safety Measures (SSMs) as input features for the machine learning models. SSMs are safety-related metrics, such as time to collision and distance to the vehicle ahead, that can provide valuable information about the safety of driving behaviors.

Through extensive experiments, the researchers demonstrate that the proposed semi-supervised HELM model with SSM features outperforms other baseline semi-supervised and unsupervised methods in terms of accuracy, F-1 score, and other performance metrics. The ablation study further highlights the significance of the SSM features in advancing the detection performance.

Critical Analysis

The study presents a promising approach for detecting abnormal driving behaviors using a semi-supervised machine learning method and safety-focused features. The use of SSMs as input features is a particularly interesting and valuable contribution, as it allows the models to capture safety-related aspects of driving behavior that may be missed by more basic motion features.

However, the paper does not discuss the potential limitations of the proposed method. For example, it is unclear how the method would perform on more diverse or complex driving data, or how it would handle cases where the abnormal behaviors are more subtle or intermittent. Additionally, the study does not explore the generalizability of the model across different driving environments or vehicle types.

Further research could investigate the robustness of the HELM model to different types of abnormal driving behaviors, as well as its performance in real-world deployment scenarios. Exploring the integration of the HELM model with other safety-enhancing technologies could also be a fruitful area of investigation.

Conclusion

This study presents a semi-supervised machine learning approach, called HELM, for detecting abnormal driving behaviors using real-world driving data. The key innovation is the introduction of Surrogate Safety Measures (SSMs) as input features, which allow the models to better capture safety-related aspects of driving behavior.

The results demonstrate that the proposed HELM model with SSM features outperforms other baseline semi-supervised and unsupervised methods, suggesting that this approach could be a valuable tool for improving road safety and evaluating driver behavior. While the study has some limitations, it represents an important step forward in developing practical and effective anomaly detection systems for real-world driving scenarios.

This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🔎

Data-driven Semi-supervised Machine Learning with Surrogate Safety Measures for Abnormal Driving Behavior Detection

Yongqi Dong, Lanxin Zhang, Haneen Farah, Arkady Zgonnikov, Bart van Arem

Detecting abnormal driving behavior is critical for road traffic safety and the evaluation of drivers' behavior. With the advancement of machine learning (ML) algorithms and the accumulation of naturalistic driving data, many ML models have been adopted for abnormal driving behavior detection. Most existing ML-based detectors rely on (fully) supervised ML methods, which require substantial labeled data. However, ground truth labels are not always available in the real world, and labeling large amounts of data is tedious. Thus, there is a need to explore unsupervised or semi-supervised methods to make the anomaly detection process more feasible and efficient. To fill this research gap, this study analyzes large-scale real-world data revealing several abnormal driving behaviors (e.g., sudden acceleration, rapid lane-changing) and develops a Hierarchical Extreme Learning Machines (HELM) based semi-supervised ML method using partly labeled data to accurately detect the identified abnormal driving behaviors. Moreover, previous ML-based approaches predominantly utilize basic vehicle motion features (such as velocity and acceleration) to label and detect abnormal driving behaviors, while this study seeks to introduce Surrogate Safety Measures (SSMs) as the input features for ML models to improve the detection performance. Results from extensive experiments demonstrate the effectiveness of the proposed semi-supervised ML model with the introduced SSMs serving as important features. The proposed semi-supervised ML method outperforms other baseline semi-supervised or unsupervised methods regarding various metrics, e.g., delivering the best accuracy at 99.58% and the best F-1 measure at 0.9913. The ablation study further highlights the significance of SSMs for advancing detection performance.

5/27/2024

UMAD: Unsupervised Mask-Level Anomaly Detection for Autonomous Driving

Daniel Bogdoll, Noel Ollick, Tim Joseph, J. Marius Zollner

Dealing with atypical traffic scenarios remains a challenging task in autonomous driving. However, most anomaly detection approaches cannot be trained on raw sensor data but require exposure to outlier data and powerful semantic segmentation models trained in a supervised fashion. This limits the representation of normality to labeled data, which does not scale well. In this work, we revisit unsupervised anomaly detection and present UMAD, leveraging generative world models and unsupervised image segmentation. Our method outperforms state-of-the-art unsupervised anomaly detection.

6/11/2024

🤷

Enhancing Functional Safety in Automotive AMS Circuits through Unsupervised Machine Learning

Ayush Arunachalam, Ian Kintz, Suvadeep Banerjee, Arnab Raha, Xiankun Jin, Fei Su, Viswanathan Pillai Prasanth, Rubin A. Parekhji, Suriyaprakash Natarajan, Kanad Basu

Given the widespread use of safety-critical applications in the automotive field, it is crucial to ensure the Functional Safety (FuSa) of circuits and components within automotive systems. The Analog and Mixed-Signal (AMS) circuits prevalent in these systems are more vulnerable to faults induced by parametric perturbations, noise, environmental stress, and other factors, in comparison to their digital counterparts. However, their continuous signal characteristics present an opportunity for early anomaly detection, enabling the implementation of safety mechanisms to prevent system failure. To address this need, we propose a novel framework based on unsupervised machine learning for early anomaly detection in AMS circuits. The proposed approach involves injecting anomalies at various circuit locations and individual components to create a diverse and comprehensive anomaly dataset, followed by the extraction of features from the observed circuit signals. Subsequently, we employ clustering algorithms to facilitate anomaly detection. Finally, we propose a time series framework to enhance and expedite anomaly detection performance. Our approach encompasses a systematic analysis of anomaly abstraction at multiple levels pertaining to the automotive domain, from hardware- to block-level, where anomalies are injected to create diverse fault scenarios. By monitoring the system behavior under these anomalous conditions, we capture the propagation of anomalies and their effects at different abstraction levels, thereby potentially paving the way for the implementation of reliable safety mechanisms to ensure the FuSa of automotive SoCs. Our experimental findings indicate that our approach achieves 100% anomaly detection accuracy and significantly optimizes the associated latency by 5X, underscoring the effectiveness of our devised solution.

4/3/2024

Exploring learning environments for label-efficient cancer diagnosis

Samta Rani, Tanvir Ahmad, Sarfaraz Masood, Chandni Saxena

Despite significant research efforts and advancements, cancer remains a leading cause of mortality. Early cancer prediction has become a crucial focus in cancer research to streamline patient care and improve treatment outcomes. Manual tumor detection by histopathologists can be time consuming, prompting the need for computerized methods to expedite treatment planning. Traditional approaches to tumor detection rely on supervised learning, necessitates a large amount of annotated data for model training. However, acquiring such extensive labeled data can be laborious and time-intensive. This research examines the three learning environments: supervised learning (SL), semi-supervised learning (Semi-SL), and self-supervised learning (Self-SL): to predict kidney, lung, and breast cancer. Three pre-trained deep learning models (Residual Network-50, Visual Geometry Group-16, and EfficientNetB0) are evaluated based on these learning settings using seven carefully curated training sets. To create the first training set (TS1), SL is applied to all annotated image samples. Five training sets (TS2-TS6) with different ratios of labeled and unlabeled cancer images are used to evaluateSemi-SL. Unlabeled cancer images from the final training set (TS7) are utilized for Self-SL assessment. Among different learning environments, outcomes from the Semi-SL setting show a strong degree of agreement with the outcomes achieved in the SL setting. The uniform pattern of observations from the pre-trained models across all three datasets validates the methodology and techniques of the research. Based on modest number of labeled samples and minimal computing cost, our study suggests that the Semi-SL option can be a highly viable replacement for the SL option under label annotation constraint scenarios.

8/19/2024