Absolute-Unified Multi-Class Anomaly Detection via Class-Agnostic Distribution Alignment
0
Sign in to get full access
Overview
- This paper presents a novel approach for multi-class anomaly detection called Absolute-Unified Multi-Class Anomaly Detection (AU-MAD) that aligns the distribution of normal and abnormal samples in a class-agnostic manner.
- The proposed method aims to overcome the limitations of existing approaches by not requiring prior knowledge about the number of normal classes and their distributions.
- The authors demonstrate the effectiveness of AU-MAD on industrial defect detection tasks, showing improved performance compared to state-of-the-art methods.
Plain English Explanation
AU-MAD is a new way to detect anomalies or unusual samples in data that contains multiple different classes or categories. Unlike other methods, AU-MAD doesn't require you to know ahead of time how many normal classes there are or what their distributions look like.
The key idea is to align the distributions of normal and abnormal samples in a way that doesn't depend on the specific classes. This allows the model to learn what "normal" looks like without needing to explicitly define the normal classes. Then, when presented with a new sample, the model can determine if it is an anomaly or not based on how different it is from the learned normal distribution.
The authors show that AU-MAD performs better than existing methods on the task of detecting manufacturing defects, which is an important real-world problem. By not relying on detailed prior knowledge about the normal classes, AU-MAD can be more widely applicable and easier to use in practice.
Technical Explanation
The paper proposes the Absolute-Unified Multi-Class Anomaly Detection (AU-MAD) method, which aims to overcome the limitations of existing multi-class anomaly detection approaches. Unlike prior work that requires knowledge of the number of normal classes and their distributions, AU-MAD aligns the distributions of normal and abnormal samples in a class-agnostic manner.
The key innovation is a Class-Agnostic Distribution Alignment (CADA) module that learns to map both normal and abnormal samples to a unified feature space. This allows the model to capture the underlying data distribution without explicitly modeling the individual normal classes.
The authors also propose a Spatio-Temporal Pseudo-Labeling (STPL) strategy to effectively leverage unlabeled data during training. This helps the model learn a more robust representation of normality.
Experiments on industrial defect detection datasets show that AU-MAD outperforms state-of-the-art multi-class anomaly detection methods, demonstrating the effectiveness of the proposed approach.
Critical Analysis
The authors acknowledge that AU-MAD, like other unsupervised anomaly detection methods, may struggle in open-set scenarios where the test-time anomalies differ significantly from the training data. Additionally, the performance of AU-MAD can be sensitive to the choice of hyperparameters, which may require careful tuning.
While the authors show promising results on industrial defect detection, it would be valuable to evaluate the method on a wider range of datasets and tasks to better understand its broader applicability and limitations. Exploring ways to make AU-MAD more robust to distribution shifts and less sensitive to hyperparameter choices could also be an interesting direction for future research.
Conclusion
The Absolute-Unified Multi-Class Anomaly Detection (AU-MAD) method presented in this paper offers a novel approach to the challenging problem of multi-class anomaly detection. By aligning the distributions of normal and abnormal samples in a class-agnostic manner, AU-MAD can effectively learn a representation of normality without requiring detailed prior knowledge about the data.
The authors demonstrate the effectiveness of AU-MAD on industrial defect detection tasks, where it outperforms state-of-the-art methods. This suggests that AU-MAD could be a valuable tool for a range of real-world anomaly detection applications that involve complex, multi-class data. Further research to enhance the robustness and generalization of the method could help unlock its full potential.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Absolute-Unified Multi-Class Anomaly Detection via Class-Agnostic Distribution Alignment
Jia Guo, Haonan Han, Shuai Lu, Weihang Zhang, Huiqi Li
Conventional unsupervised anomaly detection (UAD) methods build separate models for each object category. Recent studies have proposed to train a unified model for multiple classes, namely model-unified UAD. However, such methods still implement the unified model separately on each class during inference with respective anomaly decision thresholds, which hinders their application when the image categories are entirely unavailable. In this work, we present a simple yet powerful method to address multi-class anomaly detection without any class information, namely textit{absolute-unified} UAD. We target the crux of prior works in this challenging setting: different objects have mismatched anomaly score distributions. We propose Class-Agnostic Distribution Alignment (CADA) to align the mismatched score distribution of each implicit class without knowing class information, which enables unified anomaly detection for all classes and samples. The essence of CADA is to predict each class's score distribution of normal samples given any image, normal or anomalous, of this class. As a general component, CADA can activate the potential of nearly all UAD methods under absolute-unified setting. Our approach is extensively evaluated under the proposed setting on two popular UAD benchmark datasets, MVTec AD and VisA, where we exceed previous state-of-the-art by a large margin.
Read more4/17/2024
🤷
0
Dinomaly: The Less Is More Philosophy in Multi-Class Unsupervised Anomaly Detection
Jia Guo, Shuai Lu, Weihang Zhang, Huiqi Li
Recent studies highlighted a practical setting of unsupervised anomaly detection (UAD) that builds a unified model for multi-class images, serving as an alternative to the conventional one-class-one-model setup. Despite various advancements addressing this challenging task, the detection performance under the multi-class setting still lags far behind state-of-the-art class-separated models. Our research aims to bridge this substantial performance gap. In this paper, we introduce a minimalistic reconstruction-based anomaly detection framework, namely Dinomaly, which leverages pure Transformer architectures without relying on complex designs, additional modules, or specialized tricks. Given this powerful framework consisted of only Attentions and MLPs, we found four simple components that are essential to multi-class anomaly detection: (1) Foundation Transformers that extracts universal and discriminative features, (2) Noisy Bottleneck where pre-existing Dropouts do all the noise injection tricks, (3) Linear Attention that naturally cannot focus, and (4) Loose Reconstruction that does not force layer-to-layer and point-by-point reconstruction. Extensive experiments are conducted across three popular anomaly detection benchmarks including MVTec-AD, VisA, and the recently released Real-IAD. Our proposed Dinomaly achieves impressive image AUROC of 99.6%, 98.7%, and 89.3% on the three datasets respectively, which is not only superior to state-of-the-art multi-class UAD methods, but also surpasses the most advanced class-separated UAD records.
Read more5/30/2024
0
Hierarchical Gaussian Mixture Normalizing Flow Modeling for Unified Anomaly Detection
Xincheng Yao, Ruoqi Li, Zefeng Qian, Lu Wang, Chongyang Zhang
Unified anomaly detection (AD) is one of the most challenges for anomaly detection, where one unified model is trained with normal samples from multiple classes with the objective to detect anomalies in these classes. For such a challenging task, popular normalizing flow (NF) based AD methods may fall into a homogeneous mapping issue,where the NF-based AD models are biased to generate similar latent representations for both normal and abnormal features, and thereby lead to a high missing rate of anomalies. In this paper, we propose a novel Hierarchical Gaussian mixture normalizing flow modeling method for accomplishing unified Anomaly Detection, which we call HGAD. Our HGAD consists of two key components: inter-class Gaussian mixture modeling and intra-class mixed class centers learning. Compared to the previous NF-based AD methods, the hierarchical Gaussian mixture modeling approach can bring stronger representation capability to the latent space of normalizing flows, so that even complex multi-class distribution can be well represented and learned in the latent space. In this way, we can avoid mapping different class distributions into the same single Gaussian prior, thus effectively avoiding or mitigating the homogeneous mapping issue. We further indicate that the more distinguishable different class centers, the more conducive to avoiding the bias issue. Thus, we further propose a mutual information maximization loss for better structuring the latent feature space. We evaluate our method on four real-world AD benchmarks, where we can significantly improve the previous NF-based AD methods and also outperform the SOTA unified AD methods.
Read more7/8/2024
0
Towards a Unified Framework of Clustering-based Anomaly Detection
Zeyu Fang, Ming Gu, Sheng Zhou, Jiawei Chen, Qiaoyu Tan, Haishuai Wang, Jiajun Bu
Unsupervised Anomaly Detection (UAD) plays a crucial role in identifying abnormal patterns within data without labeled examples, holding significant practical implications across various domains. Although the individual contributions of representation learning and clustering to anomaly detection are well-established, their interdependencies remain under-explored due to the absence of a unified theoretical framework. Consequently, their collective potential to enhance anomaly detection performance remains largely untapped. To bridge this gap, in this paper, we propose a novel probabilistic mixture model for anomaly detection to establish a theoretical connection among representation learning, clustering, and anomaly detection. By maximizing a novel anomaly-aware data likelihood, representation learning and clustering can effectively reduce the adverse impact of anomalous data and collaboratively benefit anomaly detection. Meanwhile, a theoretically substantiated anomaly score is naturally derived from this framework. Lastly, drawing inspiration from gravitational analysis in physics, we have devised an improved anomaly score that more effectively harnesses the combined power of representation learning and clustering. Extensive experiments, involving 17 baseline methods across 30 diverse datasets, validate the effectiveness and generalization capability of the proposed method, surpassing state-of-the-art methods.
Read more6/4/2024