Out-of-distribution Detection in Medical Image Analysis: A survey
2404.18279
0
0
Abstract
Computer-aided diagnostics has benefited from the development of deep learning-based computer vision techniques in these years. Traditional supervised deep learning methods assume that the test sample is drawn from the identical distribution as the training data. However, it is possible to encounter out-of-distribution samples in real-world clinical scenarios, which may cause silent failure in deep learning-based medical image analysis tasks. Recently, research has explored various out-of-distribution (OOD) detection situations and techniques to enable a trustworthy medical AI system. In this survey, we systematically review the recent advances in OOD detection in medical image analysis. We first explore several factors that may cause a distributional shift when using a deep-learning-based model in clinic scenarios, with three different types of distributional shift well defined on top of these factors. Then a framework is suggested to categorize and feature existing solutions, while the previous studies are reviewed based on the methodology taxonomy. Our discussion also includes evaluation protocols and metrics, as well as the challenge and a research direction lack of exploration.
Create account to get full access
Overview
- Examines the critical issue of out-of-distribution (OOD) detection in medical image analysis
- Reviews current approaches and identifies areas for further research to improve the reliability and robustness of AI systems in healthcare
Plain English Explanation
The paper explores the challenge of detecting when a medical image analysis AI system is presented with data that is different from what it was trained on. This is an important problem because if an AI system is used in a medical setting, it needs to be able to recognize when it is looking at an image that is very different from the ones it was trained on, so it doesn't make a mistake in its analysis.
The paper discusses various techniques researchers have developed to help AI systems detect when an image is "out-of-distribution" - in other words, when it's something the system hasn't seen before and shouldn't try to analyze. These techniques involve things like adding internal link adding noise to training data, using adversarial examples, and regularizing the gradients of the neural network.
The goal is to make these AI systems more robust and trustworthy, so doctors and patients can have confidence in their medical image analysis. The paper highlights areas that need more research, like how to define and measure out-of-distribution detection and the theoretical limits of what's possible.
Technical Explanation
The paper first provides a overview of the problem of out-of-distribution (OOD) detection in medical image analysis. OOD detection aims to identify when an AI system is presented with data that is significantly different from its training data, so it can avoid making unreliable predictions.
The authors then discuss various technical approaches that have been explored to address OOD detection, such as:
- Injecting noise into training data to make the system more robust to distributional shift
- Using adversarial examples to expose the system's weaknesses and improve its ability to detect OOD samples
- Gradient-based regularization to encourage the network to learn features that are more indicative of in-distribution vs. OOD data
The paper also discusses theoretical work on measuring the learnability of OOD detection and highlights the importance of having robust, standardized benchmarks for evaluating OOD detection performance.
Critical Analysis
The paper provides a thorough overview of the current state of OOD detection research in medical image analysis, but it also acknowledges several key limitations and areas for further work:
- The lack of consensus on how to define and measure OOD detection, making it difficult to compare approaches
- The need for more realistic, diverse benchmarks that better reflect the challenges of real-world medical imaging data
- The potential for adversarial attacks to undermine OOD detection systems, and the need for more robust defenses
- The inherent difficulty of OOD detection, given the potential complexity and variability of medical images "out-of-distribution"
The paper argues that addressing these challenges will be critical for developing trustworthy and reliable AI systems for medical image analysis. Further research is needed to better understand the theoretical limits and practical feasibility of OOD detection in this domain.
Conclusion
This paper provides a comprehensive survey of the current state of out-of-distribution (OOD) detection research in medical image analysis. It highlights the importance of this problem for ensuring the reliability and safety of AI systems in healthcare, and reviews a variety of technical approaches that have been explored.
The paper also identifies key challenges and limitations of existing work, and calls for further research to develop more robust, standardized benchmarks and a deeper theoretical understanding of the learnability of OOD detection. Addressing these issues will be crucial for building trustworthy AI systems that can be safely deployed in real-world medical settings.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
Continual Unsupervised Out-of-Distribution Detection
Lars Doorenbos, Raphael Sznitman, Pablo M'arquez-Neila
0
0
Deep learning models excel when the data distribution during training aligns with testing data. Yet, their performance diminishes when faced with out-of-distribution (OOD) samples, leading to great interest in the field of OOD detection. Current approaches typically assume that OOD samples originate from an unconcentrated distribution complementary to the training distribution. While this assumption is appropriate in the traditional unsupervised OOD (U-OOD) setting, it proves inadequate when considering the place of deployment of the underlying deep learning model. To better reflect this real-world scenario, we introduce the novel setting of continual U-OOD detection. To tackle this new setting, we propose a method that starts from a U-OOD detector, which is agnostic to the OOD distribution, and slowly updates during deployment to account for the actual OOD distribution. Our method uses a new U-OOD scoring function that combines the Mahalanobis distance with a nearest-neighbor approach. Furthermore, we design a confidence-scaled few-shot OOD detector that outperforms previous methods. We show our method greatly improves upon strong baselines from related fields.
6/5/2024
Toward a Realistic Benchmark for Out-of-Distribution Detection
Pietro Recalcati, Fabio Garcea, Luca Piano, Fabrizio Lamberti, Lia Morra
0
0
Deep neural networks are increasingly used in a wide range of technologies and services, but remain highly susceptible to out-of-distribution (OOD) samples, that is, drawn from a different distribution than the original training set. A common approach to address this issue is to endow deep neural networks with the ability to detect OOD samples. Several benchmarks have been proposed to design and validate OOD detection techniques. However, many of them are based on far-OOD samples drawn from very different distributions, and thus lack the complexity needed to capture the nuances of real-world scenarios. In this work, we introduce a comprehensive benchmark for OOD detection, based on ImageNet and Places365, that assigns individual classes as in-distribution or out-of-distribution depending on the semantic similarity with the training set. Several techniques can be used to determine which classes should be considered in-distribution, yielding benchmarks with varying properties. Experimental results on different OOD detection techniques show how their measured efficacy depends on the selected benchmark and how confidence-based techniques may outperform classifier-based ones on near-OOD samples.
4/17/2024
Out-of-Distribution Data: An Acquaintance of Adversarial Examples -- A Survey
Naveen Karunanayake, Ravin Gunawardena, Suranga Seneviratne, Sanjay Chawla
0
0
Deep neural networks (DNNs) deployed in real-world applications can encounter out-of-distribution (OOD) data and adversarial examples. These represent distinct forms of distributional shifts that can significantly impact DNNs' reliability and robustness. Traditionally, research has addressed OOD detection and adversarial robustness as separate challenges. This survey focuses on the intersection of these two areas, examining how the research community has investigated them together. Consequently, we identify two key research directions: robust OOD detection and unified robustness. Robust OOD detection aims to differentiate between in-distribution (ID) data and OOD data, even when they are adversarially manipulated to deceive the OOD detector. Unified robustness seeks a single approach to make DNNs robust against both adversarial attacks and OOD inputs. Accordingly, first, we establish a taxonomy based on the concept of distributional shifts. This framework clarifies how robust OOD detection and unified robustness relate to other research areas addressing distributional shifts, such as OOD detection, open set recognition, and anomaly detection. Subsequently, we review existing work on robust OOD detection and unified robustness. Finally, we highlight the limitations of the existing work and propose promising research directions that explore adversarial and OOD inputs within a unified framework.
4/9/2024
A noisy elephant in the room: Is your out-of-distribution detector robust to label noise?
Galadrielle Humblot-Renaux, Sergio Escalera, Thomas B. Moeslund
0
0
The ability to detect unfamiliar or unexpected images is essential for safe deployment of computer vision systems. In the context of classification, the task of detecting images outside of a model's training domain is known as out-of-distribution (OOD) detection. While there has been a growing research interest in developing post-hoc OOD detection methods, there has been comparably little discussion around how these methods perform when the underlying classifier is not trained on a clean, carefully curated dataset. In this work, we take a closer look at 20 state-of-the-art OOD detection methods in the (more realistic) scenario where the labels used to train the underlying classifier are unreliable (e.g. crowd-sourced or web-scraped labels). Extensive experiments across different datasets, noise types & levels, architectures and checkpointing strategies provide insights into the effect of class label noise on OOD detection, and show that poor separation between incorrectly classified ID samples vs. OOD samples is an overlooked yet important limitation of existing methods. Code: https://github.com/glhr/ood-labelnoise
4/3/2024