Haze-Aware Attention Network for Single-Image Dehazing

Read original: arXiv:2407.11505 - Published 7/17/2024 by Lihan Tong, Yun Liu, Weijia Li, Liyuan Chen, Erkang Chen
Total Score

0

Haze-Aware Attention Network for Single-Image Dehazing

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper introduces a novel approach for image dehazing that leverages frequency-domain information to estimate a continuous density mask.
  • The proposed method, called FALCON, outperforms state-of-the-art dehazing techniques on various benchmark datasets.
  • The authors also present two additional contributions - AMSA-UNet and HDMBA - which are complementary techniques for enhancing dehazing performance.

Plain English Explanation

The paper describes a new way to remove haze or fog from images. Haze can make images appear dull and hard to see, which is a problem for many applications like self-driving cars or satellite imagery analysis. The authors' approach, called FALCON, uses information about the frequencies (high, low, etc.) in the image to estimate a special "mask" that can be used to clear up the haze.

FALCON: Frequency Adjoint Link for Continuous Density Mask outperforms other state-of-the-art dehazing methods, meaning it does a better job of making hazy images look clearer and more vibrant. The authors also introduce two other techniques - AMSA-UNet and HDMBA - that can further improve dehazing performance.

The key innovation in FALCON is using information about the different frequencies in the image to estimate a continuous "density mask" that can be applied to remove the haze. This is more effective than previous methods that relied on simpler models or assumptions about the haze. By incorporating this frequency-domain information, FALCON is able to do a more accurate job of clearing up hazy images.

Technical Explanation

The FALCON method introduced in this paper leverages frequency-domain information to estimate a continuous density mask for effective image dehazing. The authors propose a novel frequency-adjoint link module that captures the relationship between the frequency spectrum of the input image and the desired density mask.

This frequency-based approach outperforms prior image dehazing techniques like VIFNet and Parallel Cross-Strip Attention Network on various benchmark datasets. The authors also present two complementary contributions:

  1. AMSA-UNet: An asymmetric multiple-scale U-Net architecture that jointly learns multi-scale features for enhanced dehazing.
  2. HDMBA: A hyperspectral dehazing method for remote sensing imagery that leverages the spectral-spatial information in the data.

The technical details of the FALCON architecture involve a frequency-adjoint link module that maps the input image's frequency spectrum to the desired continuous density mask. This frequency-based representation allows the model to better capture the underlying structure of the haze, leading to superior dehazing performance compared to prior methods.

Critical Analysis

The authors provide a thorough evaluation of FALCON's performance on multiple datasets, demonstrating its effectiveness in improving image clarity under diverse hazy conditions. However, the paper does not delve into potential limitations or failure cases of the approach.

One area that could warrant further investigation is the model's robustness to extreme or atypical haze patterns that may not be well-represented in the training data. Additionally, the computational complexity and real-time performance of FALCON compared to other dehazing techniques are not discussed in detail.

While the paper makes a compelling case for the superiority of the frequency-based approach, a more critical analysis of the method's tradeoffs and limitations would help readers develop a more nuanced understanding of its practical applicability and scope for further improvements.

Conclusion

This paper presents a novel image dehazing technique called FALCON that leverages frequency-domain information to estimate a continuous density mask for effective haze removal. The authors demonstrate that FALCON outperforms state-of-the-art dehazing methods on various benchmarks, highlighting the benefits of their frequency-based approach.

The paper also introduces two complementary contributions, AMSA-UNet and HDMBA, which further enhance dehazing performance in different domains. These advancements represent significant progress in the field of image enhancement and could have widespread applications in areas such as autonomous driving, remote sensing, and computational photography.

Overall, the FALCON method and its accompanying techniques showcased in this paper offer a compelling solution to the long-standing challenge of image dehazing, with the potential to unlock new possibilities for improved visual understanding and analysis.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

Haze-Aware Attention Network for Single-Image Dehazing
Total Score

0

Haze-Aware Attention Network for Single-Image Dehazing

Lihan Tong, Yun Liu, Weijia Li, Liyuan Chen, Erkang Chen

Single-image dehazing is a pivotal challenge in computer vision that seeks to remove haze from images and restore clean background details. Recognizing the limitations of traditional physical model-based methods and the inefficiencies of current attention-based solutions, we propose a new dehazing network combining an innovative Haze-Aware Attention Module (HAAM) with a Multiscale Frequency Enhancement Module (MFEM). The HAAM is inspired by the atmospheric scattering model, thus skillfully integrating physical principles into high-dimensional features for targeted dehazing. It picks up on latent features during the image restoration process, which gives a significant boost to the metrics, while the MFEM efficiently enhances high-frequency details, thus sidestepping wavelet or Fourier transform complexities. It employs multiscale fields to extract and emphasize key frequency components with minimal parameter overhead. Integrated into a simple U-Net framework, our Haze-Aware Attention Network (HAA-Net) for single-image dehazing significantly outperforms existing attention-based and transformer models in efficiency and effectiveness. Tested across various public datasets, the HAA-Net sets new performance benchmarks. Our work not only advances the field of image dehazing but also offers insights into the design of attention mechanisms for broader applications in computer vision.

Read more

7/17/2024

FALCON: Frequency Adjoint Link with CONtinuous Density Mask for Fast Single Image Dehazing
Total Score

0

FALCON: Frequency Adjoint Link with CONtinuous Density Mask for Fast Single Image Dehazing

Donghyun Kim, Seil Kang, Seong Jae Hwang

Image dehazing, addressing atmospheric interference like fog and haze, remains a pervasive challenge crucial for robust vision applications such as surveillance and remote sensing under adverse visibility. While various methodologies have evolved from early works predicting transmission matrix and atmospheric light features to deep learning and dehazing networks, they innately prioritize dehazing quality metrics, neglecting the need for real-time applicability in time-sensitive domains like autonomous driving. This work introduces FALCON (Frequency Adjoint Link with CONtinuous density mask), a single-image dehazing system achieving state-of-the-art performance on both quality and speed. Particularly, we develop a novel bottleneck module, namely, Frequency Adjoint Link, operating in the frequency space to globally expand the receptive field with minimal growth in network size. Further, we leverage the underlying haze distribution based on the atmospheric scattering model via a Continuous Density Mask (CDM) which serves as a continuous-valued mask input prior and a differentiable auxiliary loss. Comprehensive experiments involving multiple state-of-the-art methods and ablation analysis demonstrate FALCON's exceptional performance in both dehazing quality and speed (i.e., >$180 frames-per-second), quantified by metrics such as FPS, PSNR, and SSIM.

Read more

7/2/2024

HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model
Total Score

0

HDMba: Hyperspectral Remote Sensing Imagery Dehazing with State Space Model

Hang Fu, Genyun Sun, Yinhe Li, Jinchang Ren, Aizhu Zhang, Cheng Jing, Pedram Ghamisi

Haze contamination in hyperspectral remote sensing images (HSI) can lead to spatial visibility degradation and spectral distortion. Haze in HSI exhibits spatial irregularity and inhomogeneous spectral distribution, with few dehazing networks available. Current CNN and Transformer-based dehazing methods fail to balance global scene recovery, local detail retention, and computational efficiency. Inspired by the ability of Mamba to model long-range dependencies with linear complexity, we explore its potential for HSI dehazing and propose the first HSI Dehazing Mamba (HDMba) network. Specifically, we design a novel window selective scan module (WSSM) that captures local dependencies within windows and global correlations between windows by partitioning them. This approach improves the ability of conventional Mamba in local feature extraction. By modeling the local and global spectral-spatial information flow, we achieve a comprehensive analysis of hazy regions. The DehazeMamba layer (DML), constructed by WSSM, and residual DehazeMamba (RDM) blocks, composed of DMLs, are the core components of the HDMba framework. These components effectively characterize the complex distribution of haze in HSIs, aiding in scene reconstruction and dehazing. Experimental results on the Gaofen-5 HSI dataset demonstrate that HDMba outperforms other state-of-the-art methods in dehazing performance. The code will be available at https://github.com/RsAI-lab/HDMba.

Read more

6/11/2024

VIFNet: An End-to-end Visible-Infrared Fusion Network for Image Dehazing
Total Score

0

VIFNet: An End-to-end Visible-Infrared Fusion Network for Image Dehazing

Meng Yu, Te Cui, Haoyang Lu, Yufeng Yue

Image dehazing poses significant challenges in environmental perception. Recent research mainly focus on deep learning-based methods with single modality, while they may result in severe information loss especially in dense-haze scenarios. The infrared image exhibits robustness to the haze, however, existing methods have primarily treated the infrared modality as auxiliary information, failing to fully explore its rich information in dehazing. To address this challenge, the key insight of this study is to design a visible-infrared fusion network for image dehazing. In particular, we propose a multi-scale Deep Structure Feature Extraction (DSFE) module, which incorporates the Channel-Pixel Attention Block (CPAB) to restore more spatial and marginal information within the deep structural features. Additionally, we introduce an inconsistency weighted fusion strategy to merge the two modalities by leveraging the more reliable information. To validate this, we construct a visible-infrared multimodal dataset called AirSim-VID based on the AirSim simulation platform. Extensive experiments performed on challenging real and simulated image datasets demonstrate that VIFNet can outperform many state-of-the-art competing methods. The code and dataset are available at https://github.com/mengyu212/VIFNet_dehazing.

Read more

4/12/2024