A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localization

Read original: arXiv:2407.09359 - Published 7/15/2024 by Qiyu Chen, Huiyuan Luo, Chengkan Lv, Zhengtao Zhang
Total Score

0

A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localization

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper presents a unified anomaly synthesis strategy using gradient ascent to improve industrial anomaly detection and localization.
  • The method generates realistic anomalies to augment training data and enhance the performance of anomaly detection models.
  • The approach leverages both global and local information to produce anomalies that closely mimic real-world defects.

Plain English Explanation

In the real world, it can be challenging to gather enough high-quality data on defective or anomalous industrial products. This lack of data can make it difficult to train machine learning models to accurately detect and locate these types of anomalies. To address this issue, the researchers developed a new technique that can [object Object] realistic anomalies to supplement the training data.

The key idea is to use a [object Object] optimization process to iteratively modify normal images in a way that creates anomalous patterns. These generated anomalies capture both the global structure and local details of real defects, making them highly realistic. By combining these synthetic anomalies with the available normal training data, the researchers were able to [object Object] that could better identify and locate defects in industrial settings.

The benefit of this approach is that it allows for the creation of a larger and more diverse training dataset, overcoming the challenge of limited real-world anomaly data. This, in turn, [object Object] of the anomaly detection models, making them more effective at identifying and localizing defects in industrial products.

Technical Explanation

The proposed method consists of three main components:

  1. Anomaly Synthesis: The researchers use a gradient ascent optimization process to iteratively modify normal images and generate realistic anomalies. This involves maximizing the anomaly score of a target image by adjusting its pixel values, while preserving the global structure and local details of the original image.

  2. Anomaly Detection: The generated anomalies are combined with the available normal training data to train an anomaly detection model. The researchers experiment with different architectures, including one-class classifiers and autoencoders, to identify the most effective approach for their industrial use case.

  3. Anomaly Localization: The trained anomaly detection model is used to not only identify the presence of anomalies but also to [object Object]. This is achieved by analyzing the spatial distribution of the anomaly scores within the image.

The key innovation of this work is the use of gradient ascent to synthesize realistic anomalies that closely resemble real-world defects. This allows the researchers to overcome the challenge of limited anomaly data and [object Object] for industrial applications.

Critical Analysis

The researchers acknowledge that their synthetic anomaly generation approach has some limitations. For example, the generated anomalies may not capture all the complex patterns and variability present in real-world defects. Additionally, the method relies on having a well-trained anomaly detection model to guide the anomaly synthesis process, which could be challenging in scenarios with limited normal data.

Further research could explore ways to [object Object], such as by incorporating more advanced generative models or leveraging domain-specific knowledge. Investigating the [object Object] would also be an interesting avenue for future work.

Conclusion

This paper presents a novel approach for [object Object] using gradient ascent optimization. By combining these generated anomalies with normal training data, the researchers were able to [object Object] for industrial applications. This technique helps overcome the challenge of limited real-world anomaly data, ultimately improving the ability to [object Object] in industrial settings.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localization
Total Score

0

A Unified Anomaly Synthesis Strategy with Gradient Ascent for Industrial Anomaly Detection and Localization

Qiyu Chen, Huiyuan Luo, Chengkan Lv, Zhengtao Zhang

Anomaly synthesis strategies can effectively enhance unsupervised anomaly detection. However, existing strategies have limitations in the coverage and controllability of anomaly synthesis, particularly for weak defects that are very similar to normal regions. In this paper, we propose Global and Local Anomaly co-Synthesis Strategy (GLASS), a novel unified framework designed to synthesize a broader coverage of anomalies under the manifold and hypersphere distribution constraints of Global Anomaly Synthesis (GAS) at the feature level and Local Anomaly Synthesis (LAS) at the image level. Our method synthesizes near-in-distribution anomalies in a controllable way using Gaussian noise guided by gradient ascent and truncated projection. GLASS achieves state-of-the-art results on the MVTec AD (detection AUROC of 99.9%), VisA, and MPDD datasets and excels in weak defect detection. The effectiveness and efficiency have been further validated in industrial applications for woven fabric defect detection. The code and dataset are available at: url{https://github.com/cqylunlun/GLASS}.

Read more

7/15/2024

Total Score

0

LogicAL: Towards logical anomaly synthesis for unsupervised anomaly localization

Ying Zhao

Anomaly localization is a practical technology for improving industrial production line efficiency. Due to anomalies are manifold and hard to be collected, existing unsupervised researches are usually equipped with anomaly synthesis methods. However, most of them are biased towards structural defects synthesis while ignoring the underlying logical constraints. To fill the gap and boost anomaly localization performance, we propose an edge manipulation based anomaly synthesis framework, named LogicAL, that produces photo-realistic both logical and structural anomalies. We introduce a logical anomaly generation strategy that is adept at breaking logical constraints and a structural anomaly generation strategy that complements to the structural defects synthesis. We further improve the anomaly localization performance by introducing edge reconstruction into the network structure. Extensive experiments on the challenge MVTecLOCO, MVTecAD, VisA and MADsim datasets verify the advantage of proposed LogicAL on both logical and structural anomaly localization.

Read more

5/14/2024

GLAD: Towards Better Reconstruction with Global and Local Adaptive Diffusion Models for Unsupervised Anomaly Detection
Total Score

0

GLAD: Towards Better Reconstruction with Global and Local Adaptive Diffusion Models for Unsupervised Anomaly Detection

Hang Yao, Ming Liu, Haolin Wang, Zhicun Yin, Zifei Yan, Xiaopeng Hong, Wangmeng Zuo

Diffusion models have shown superior performance on unsupervised anomaly detection tasks. Since trained with normal data only, diffusion models tend to reconstruct normal counterparts of test images with certain noises added. However, these methods treat all potential anomalies equally, which may cause two main problems. From the global perspective, the difficulty of reconstructing images with different anomalies is uneven. Therefore, instead of utilizing the same setting for all samples, we propose to predict a particular denoising step for each sample by evaluating the difference between image contents and the priors extracted from diffusion models. From the local perspective, reconstructing abnormal regions differs from normal areas even in the same image. Theoretically, the diffusion model predicts a noise for each step, typically following a standard Gaussian distribution. However, due to the difference between the anomaly and its potential normal counterpart, the predicted noise in abnormal regions will inevitably deviate from the standard Gaussian distribution. To this end, we propose introducing synthetic abnormal samples in training to encourage the diffusion models to break through the limitation of standard Gaussian distribution, and a spatial-adaptive feature fusion scheme is utilized during inference. With the above modifications, we propose a global and local adaptive diffusion model (abbreviated to GLAD) for unsupervised anomaly detection, which introduces appealing flexibility and achieves anomaly-free reconstruction while retaining as much normal information as possible. Extensive experiments are conducted on three commonly used anomaly detection datasets (MVTec-AD, MPDD, and VisA) and a printed circuit board dataset (PCB-Bank) we integrated, showing the effectiveness of the proposed method.

Read more

9/10/2024

🤷

Total Score

0

Unsupervised Industrial Anomaly Detection via Pattern Generative and Contrastive Networks

Jianfeng Huang, Chenyang Li, Yimin Lin, Shiguo Lian

It is hard to collect enough flaw images for training deep learning network in industrial production. Therefore, existing industrial anomaly detection methods prefer to use CNN-based unsupervised detection and localization network to achieve this task. However, these methods always fail when there are varieties happened in new signals since traditional end-to-end networks suffer barriers of fitting nonlinear model in high-dimensional space. Moreover, they have a memory library by clustering the feature of normal images essentially, which cause it is not robust to texture change. To this end, we propose the Vision Transformer based (VIT-based) unsupervised anomaly detection network. It utilizes a hierarchical task learning and human experience to enhance its interpretability. Our network consists of pattern generation and comparison networks. Pattern generation network uses two VIT-based encoder modules to extract the feature of two consecutive image patches, then uses VIT-based decoder module to learn the human designed style of these features and predict the third image patch. After this, we use the Siamese-based network to compute the similarity of the generation image patch and original image patch. Finally, we refine the anomaly localization by the bi-directional inference strategy. Comparison experiments on public dataset MVTec dataset show our method achieves 99.8% AUC, which surpasses previous state-of-the-art methods. In addition, we give a qualitative illustration on our own leather and cloth datasets. The accurate segment results strongly prove the accuracy of our method in anomaly detection.

Read more

8/16/2024