An empirical study of testing machine learning in the wild

Overview

• Recent research has focused on ensuring the quality of machine learning (ML) and deep learning (DL) systems, as they are increasingly being used in software applications.
• Traditional software testing methods may not be well-suited for these inductive ML/DL systems, which learn patterns from training data rather than being built deductively.
• This study aims to understand the practical application of ML testing strategies and the specific properties being tested in real-world ML deployments.

Plain English Explanation

Machine learning (ML) and deep learning (DL) algorithms have become more common in many software applications. Unlike traditional software that is built by explicitly writing out rules, ML/DL systems learn patterns from data. This makes ensuring the quality of these systems a significant challenge.

Researchers have tried adapting traditional software testing techniques, like mutation testing, to improve the reliability of ML/DL systems. However, it's unclear if these proposed testing methods are actually used in practice, or if new testing strategies have emerged from real-world ML deployments.

To address this gap, the researchers conducted a detailed study to understand the ML testing practices being used in the wild. They analyzed test files and cases from 11 open-source ML/DL projects on GitHub. By manually examining the testing strategies, tested ML properties, and implementation methods, the researchers gained insights into how ML/DL software systems are built and released in practice.

Technical Explanation

The researchers performed a mixed-methods study, combining quantitative analysis of test files and cases with qualitative open coding to understand the practical application of ML testing. They examined 11 open-source ML/DL projects on GitHub, looking at the testing strategies, tested ML properties, and implemented testing methods.

Their key findings include:

1. The most common testing strategies, accounting for less than 40% of the tests, are Grey-box and White-box methods, such as Negative Testing, Oracle Approximation, and Statistical Testing.
2. A wide range of 17 ML properties are tested, but only 20% to 30% are frequently tested, including Consistency, Correctness, and Efficiency.
3. Certain ML properties are more often tested in specific domains - for example, Bias and Fairness is more tested in Recommendation systems, while Security & Privacy is tested in Computer Vision (CV), Application Platforms, and Natural Language Processing (NLP) systems.

These findings provide empirical evidence about the current state of ML testing practices, which can inform the development of more effective testing strategies and help bridge the gap between research and practice in ML software engineering.

Critical Analysis

The researchers acknowledge that their study is limited to a relatively small sample of 11 open-source projects, and the findings may not be fully representative of the broader ML/DL testing landscape. Additionally, the study focuses on understanding current practices, but does not evaluate the efficacy or suitability of the tested approaches.

Further research could explore testing strategies and ML properties in a larger, more diverse set of ML/DL projects, including both open-source and commercial systems. Investigating the reasons behind the observed testing practices, as well as the challenges and barriers to adopting more comprehensive testing approaches, could also provide valuable insights.

The researchers also suggest the need for systematic approaches to ML model testing and the use of machine learning to optimize software development, which could help address the unique challenges posed by the inductive nature of ML/DL systems.

Conclusion

This study provides the first fine-grained empirical insights into the current state of ML testing practices in the wild. The findings reveal that while a wide range of ML properties are being tested, the most common testing strategies account for less than 40% of the tests, and only a subset of the tested properties are frequently addressed.

These insights can inform the development of more comprehensive and effective testing approaches for ML/DL systems, helping to bridge the gap between research and practice in this critical area of software engineering. As ML/DL continue to be more widely adopted, ensuring the quality and reliability of these systems will become increasingly important for building safe and trustworthy applications.