Evaluating ROCKET and Catch22 features for calf behaviour classification from accelerometer data using Machine Learning models
0
Sign in to get full access
Overview
- This paper evaluates the use of ROCKET and Catch22 feature extraction techniques for classifying calf behavior from accelerometer data using machine learning models.
- The researchers collected accelerometer data from calves and used it to train and test different machine learning models to classify calf behaviors.
- The goal was to determine which feature extraction method and machine learning model performed best for this task.
Plain English Explanation
The researchers in this study wanted to find the best way to analyze data from sensors worn by calves to determine what the calves were doing. They collected data from sensors that measured the movements of calves, and then used different machine learning techniques to try to classify the calves' behaviors, such as walking, lying down, or standing up.
The researchers tested two different methods for extracting useful features from the sensor data: ROCKET and Catch22. These are algorithms that can identify patterns and characteristics in the sensor data that are relevant for classifying the calf's behavior. They also tested several different machine learning models, such as decision trees and random forests, to see which one worked best for this task.
The goal was to determine the combination of feature extraction method and machine learning model that could most accurately predict the calf's behavior based on the sensor data. This information could be useful for farmers or researchers who want to monitor the behavior of calves, for example to detect signs of illness or distress.
Technical Explanation
The researchers collected accelerometer data from calves and used it to evaluate the performance of ROCKET and Catch22 feature extraction techniques in combination with various machine learning models for classifying calf behavior.
ROCKET and Catch22 are algorithms that can automatically extract relevant features from time series data, which is useful for tasks like behavior classification. The researchers applied these feature extraction methods to the accelerometer data and then trained different machine learning models, including decision trees, random forests, support vector machines, and long short-term memory (LSTM) networks, to classify the calf behaviors.
They evaluated the performance of these combinations using metrics like accuracy, precision, recall, and F1-score. The results showed that the ROCKET feature extraction method coupled with a random forest classifier achieved the best overall performance for classifying calf behaviors from the accelerometer data.
Critical Analysis
The researchers acknowledged some limitations of their study, including the relatively small dataset and the fact that the data was collected in a controlled laboratory setting rather than on a working farm. They suggested that further research is needed to evaluate the performance of these techniques in real-world farming environments.
Additionally, the paper does not provide much detail on the specific behaviors that the models were able to classify, or the relative importance of the ROCKET and Catch22 features for each behavior. It would be helpful to have a more in-depth analysis of the types of behaviors that were most accurately classified, and the specific characteristics of the data that were most discriminative for each behavior.
Overall, this research demonstrates the potential of using machine learning techniques like ROCKET and Catch22 for classifying animal behavior from sensor data, but more work is needed to fully validate the approach and understand its practical applications in real-world farming scenarios.
Conclusion
This paper evaluated the use of ROCKET and Catch22 feature extraction techniques in combination with various machine learning models for classifying calf behavior from accelerometer data. The results showed that the ROCKET method coupled with a random forest classifier achieved the best overall performance for this task.
The findings suggest that these techniques have promising applications for monitoring and analyzing animal behavior, which could be useful for farmers, researchers, and others interested in understanding and improving animal welfare. However, further research is needed to validate the approach in real-world farming environments and explore the specific behaviors that can be accurately classified using these methods.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Evaluating ROCKET and Catch22 features for calf behaviour classification from accelerometer data using Machine Learning models
Oshana Dissanayake, Sarah E. McPherson, Joseph Allyndree, Emer Kennedy, Padraig Cunningham, Lucile Riaboff
Monitoring calf behaviour continuously would be beneficial to identify routine practices (e.g., weaning, dehorning, etc.) that impact calf welfare in dairy farms. In that regard, accelerometer data collected from neck collars can be used along with Machine Learning models to classify calf behaviour automatically. Hand-crafted features are commonly used in Machine Learning models, while ROCKET and Catch22 features are specifically designed for time-series classification problems in related fields. This study aims to compare the performance of ROCKET and Catch22 features to Hand-Crafted features. 30 Irish Holstein Friesian and Jersey pre-weaned calves were monitored using accelerometer sensors allowing for 27.4 hours of annotated behaviors. Additional time-series were computed from the raw X, Y and Z-axis and split into 3-second time windows. ROCKET, Catch22 and Hand-Crafted features were calculated for each time window, and the dataset was then split into the train, validation and test sets. Each set of features was used to train three Machine Learning models (Random Forest, eXtreme Gradient Boosting, and RidgeClassifierCV) to classify six behaviours indicative of pre-weaned calf welfare (drinking milk, grooming, lying, running, walking and other). Models were tuned with the validation set, and the performance of each feature-model combination was evaluated with the test set. The best performance across the three models was obtained with ROCKET [average balanced accuracy +/- standard deviation] (0.70 +/- 0.07), followed by Catch22 (0.69 +/- 0.05), surpassing Hand-Crafted (0.65 +/- 0.034). The best balanced accuracy (0.77) was obtained with ROCKET and RidgeClassifierCV, followed by Catch22 and Random Forest (0.73). Thus, tailoring these approaches for specific behaviours and contexts will be crucial in advancing precision livestock farming and enhancing animal welfare on a larger scale.
Read more5/1/2024
🔄
0
Development of a digital tool for monitoring the behaviour of pre-weaned calves using accelerometer neck-collars
Oshana Dissanayake (UCD), Sarah E. Mcpherson (Teagasc, WUR), Joseph Allyndr'ee (UCD), Emer Kennedy (Teagasc), P'adraig Cunningham (UCD), Lucile Riaboff (GenPhySE, INRAE)
Automatic monitoring of calf behaviour is a promising way of assessing animal welfare from their first week on farms. This study aims to (i) develop machine learning models from accelerometer data to classify the main behaviours of pre-weaned calves and (ii) set up a digital tool for monitoring the behaviour of pre-weaned calves from the models' prediction. Thirty pre-weaned calves were equipped with a 3-D accelerometer attached to a neck-collar for two months and filmed simultaneously. The behaviours were annotated, resulting in 27.4 hours of observation aligned with the accelerometer data. The time-series were then split into 3 seconds windows. Two machine learning models were tuned using data from 80% of the calves: (i) a Random Forest model to classify between active and inactive behaviours using a set of 11 hand-craft features [model 1] and (ii) a RidgeClassifierCV model to classify between lying, running, drinking milk and other behaviours using ROCKET features [model 2]. The performance of the models was tested using data from the remaining 20% of the calves. Model 1 achieved a balanced accuracy of 0.92. Model 2 achieved a balanced accuracy of 0.84. Behavioural metrics such as daily activity ratio and episodes of running, lying, drinking milk, and other behaviours expressed over time were deduced from the predictions. All the development was finally embedded into a Python dashboard so that the individual calf metrics could be displayed directly from the raw accelerometer files.
Read more6/26/2024
0
A Comparison of Deep Learning and Established Methods for Calf Behaviour Monitoring
Oshana Dissanayake, Lucile Riaboff, Sarah E. McPherson, Emer Kennedy, P'adraig Cunningham
In recent years, there has been considerable progress in research on human activity recognition using data from wearable sensors. This technology also has potential in the context of animal welfare in livestock science. In this paper, we report on research on animal activity recognition in support of welfare monitoring. The data comes from collar-mounted accelerometer sensors worn by Holstein and Jersey calves, the objective being to detect changes in behaviour indicating sickness or stress. A key requirement in detecting changes in behaviour is to be able to classify activities into classes, such as drinking, running or walking. In Machine Learning terms, this is a time-series classification task, and in recent years, the Rocket family of methods have emerged as the state-of-the-art in this area. We have over 27 hours of labelled time-series data from 30 calves for our analysis. Using this data as a baseline, we present Rocket's performance on a 6-class classification task. Then, we compare this against the performance of 11 Deep Learning (DL) methods that have been proposed as promising methods for time-series classification. Given the success of DL in related areas, it is reasonable to expect that these methods will perform well here as well. Surprisingly, despite taking care to ensure that the DL methods are configured correctly, none of them match Rocket's performance. A possible explanation for the impressive success of Rocket is that it has the data encoding benefits of DL models in a much simpler classification framework.
Read more8/26/2024
🏷️
0
Accelerometer-Based Multivariate Time-Series Dataset for Calf Behavior Classification
Oshana Dissanayake, Sarah E. McPherson, Joseph Allyndree, Emer Kennedy, Padraig Cunningham, Lucile Riaboff
Getting new insights on pre-weaned calf behavioral adaptation to routine challenges (transport, group relocation, etc.) and diseases (respiratory diseases, diarrhea, etc.) is a promising way to improve calf welfare in dairy farms. A classic approach to automatically monitoring behavior is to equip animals with accelerometers attached to neck collars and to develop machine learning models from accelerometer time-series. However, to be used for model development, data must be equipped with labels. Obtaining these labels requires annotating behaviors from direct observation or videos, a time-consuming and labor-intensive process. To address this challenge, we propose the ActBeCalf (Accelerometer Time-Series for Calf Behaviour classification) dataset: 30 pre-weaned dairy calves (Holstein Friesian and Jersey) were equipped with a 3D-accelerometer sensor attached to a neck-collar from one week of birth for 13 weeks. The calves were simultaneously filmed with a camera in each pen. At the end of the trial, behaviors were manually annotated from the videos using the Behavioral Observation Research Interactive Software (BORIS) by 3 observers using an ethogram with 23 behaviors. ActBeCalf contains 27.4 hours of accelerometer data aligned adequately with calf behaviors. The dataset includes the main behaviors, like lying, standing, walking, and running, and less prominent behaviors, such as sniffing, social interaction, and grooming. Finally, ActBeCalf was used for behavior classification with machine learning models: (i)two classes of behaviors, [active and inactive; model 1] and (ii)four classes of behaviors [running, lying, drinking milk, and 'other' class; model 2] to demonstrate its reliability. We got a balanced accuracy of 92% [model1] and 84% [model2]. ActBeCalf is a comprehensive and ready-to-use dataset for classifying pre-weaned calf behaviour from the acceleration time series.
Read more9/4/2024