CIC: Circular Image Compression

Read original: arXiv:2407.15870 - Published 7/24/2024 by Honggui Li, Sinan Chen, Nahid Md Lokman Hossain, Maria Trocan, Beata Mikovicova, Muhammad Fahimullah, Dimitri Galayko, Mohamad Sawan
Total Score

0

🖼️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • The paper introduces a new approach called Circular Image Compression (CIC) to address the performance degradation of Learned Image Compression (LIC) on out-of-sample, out-of-distribution, or out-of-domain testing images.
  • Classical LIC uses a serial, open-loop architecture, while CIC uses a closed-loop architecture to potentially improve the dynamic and static performance.
  • The proposed CIC method establishes a nonlinear loop equation and proves that the steady-state error between reconstructed and original images is close to zero.
  • CIC can be built on top of any existing advanced Serial Image Compression (SIC) methods and offers the properties of Post-Training and plug-and-play.

Plain English Explanation

The paper focuses on a problem with the current state-of-the-art Learned Image Compression (LIC) techniques. These LIC methods work well when the test images are similar to the training images, but their performance can degrade significantly when the test images are different - for example, if they have dark backgrounds, sharp edges, high contrast, grid shapes, or complex patterns.

To address this, the researchers propose a new approach called Circular Image Compression (CIC). The key idea is to use a closed-loop architecture, rather than the open-loop architecture of classical LIC. This closed-loop design allows the compression and decompression process to "feedback" on itself, which can improve the quality of the reconstructed images, especially for challenging test cases.

Mathematically, the CIC approach establishes a nonlinear loop equation and shows that the error between the reconstructed and original images can be driven to near-zero. Importantly, the CIC method can be built on top of any existing advanced Serial Image Compression (SIC) techniques, allowing it to leverage the latest improvements in the field.

The researchers demonstrate through experiments on several public image compression datasets that the proposed CIC method outperforms several state-of-the-art SIC algorithms, particularly for challenging test images with dark backgrounds, sharp edges, high contrast, grid shapes, or complex patterns.

Technical Explanation

The paper presents a new Circular Image Compression (CIC) approach to address the performance degradation of Learned Image Compression (LIC) on out-of-sample, out-of-distribution, or out-of-domain testing images.

Classical LIC uses a serial, open-loop architecture with separate encoding and decoding units. In contrast, the proposed CIC approach employs a closed-loop architecture, where the encoding and decoding processes are interconnected in a circular manner. The researchers argue that according to control theory, this closed-loop design has the potential to improve the dynamic and static performance of image compression.

The key technical contributions of the CIC method are:

  1. Establishing a nonlinear loop equation that governs the relationship between the reconstructed and original images.
  2. Proving that the steady-state error between the reconstructed and original images can be driven close to zero using Taylor series expansion.
  3. Demonstrating that CIC can be built on top of any existing advanced Serial Image Compression (SIC) methods, offering the properties of Post-Training and plug-and-play.

The researchers evaluate the proposed CIC method on five public image compression datasets and compare it against five open-source state-of-the-art SIC algorithms. The results show that CIC outperforms the competing methods in reconstruction capacity, particularly for challenging test images with dark backgrounds, sharp edges, high contrast, grid shapes, or complex patterns.

Critical Analysis

The paper presents a novel approach to address the performance limitations of existing Learned Image Compression (LIC) techniques, especially for out-of-sample, out-of-distribution, or out-of-domain testing images.

One potential limitation of the CIC method is that the mathematical analysis and proof of the near-zero steady-state error assume a specific nonlinear loop equation. It would be valuable to understand the sensitivity of this result to variations in the loop equation or the underlying SIC method used.

Additionally, the paper does not provide a detailed analysis of the computational complexity or inference time of the CIC approach compared to the competing SIC methods. This information would be helpful for evaluating the practical deployment of CIC in real-world applications.

While the experimental results demonstrate the superior performance of CIC on challenging test images, it would be informative to understand the tradeoffs in terms of compression ratio, file size, or other practical metrics relevant to image compression tasks.

Overall, the CIC approach is a promising contribution to the field of image compression, and the researchers have laid a solid theoretical foundation. Further analysis and comparisons to state-of-the-art methods on a broader range of practical criteria would help strengthen the case for adopting CIC in real-world applications.

Conclusion

The paper introduces a novel Circular Image Compression (CIC) approach to address the performance degradation of Learned Image Compression (LIC) on out-of-sample, out-of-distribution, or out-of-domain testing images.

By using a closed-loop architecture, the CIC method can potentially improve the dynamic and static performance of image compression, as demonstrated by the researchers' mathematical analysis and experimental results. Importantly, CIC can be built on top of any existing advanced Serial Image Compression (SIC) techniques, allowing it to leverage the latest improvements in the field.

The experimental evaluation shows that CIC outperforms several state-of-the-art SIC algorithms, particularly for challenging test images with dark backgrounds, sharp edges, high contrast, grid shapes, or complex patterns. This suggests that the CIC approach could have significant practical implications for real-world image compression applications that need to handle a diverse range of input data.

Further research could explore the sensitivity of the CIC method to variations in the loop equation, the computational complexity, and the tradeoffs between compression quality, file size, and other practical metrics. Nonetheless, the CIC framework represents a promising step forward in the ongoing pursuit of more robust and versatile image compression techniques.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🖼️

Total Score

0

CIC: Circular Image Compression

Honggui Li, Sinan Chen, Nahid Md Lokman Hossain, Maria Trocan, Beata Mikovicova, Muhammad Fahimullah, Dimitri Galayko, Mohamad Sawan

Learned image compression (LIC) is currently the cutting-edge method. However, the inherent difference between testing and training images of LIC results in performance degradation to some extent. Especially for out-of-sample, out-of-distribution, or out-of-domain testing images, the performance of LIC dramatically degraded. Classical LIC is a serial image compression (SIC) approach that utilizes an open-loop architecture with serial encoding and decoding units. Nevertheless, according to the theory of automatic control, a closed-loop architecture holds the potential to improve the dynamic and static performance of LIC. Therefore, a circular image compression (CIC) approach with closed-loop encoding and decoding elements is proposed to minimize the gap between testing and training images and upgrade the capability of LIC. The proposed CIC establishes a nonlinear loop equation and proves that steady-state error between reconstructed and original images is close to zero by Talor series expansion. The proposed CIC method possesses the property of Post-Training and plug-and-play which can be built on any existing advanced SIC methods. Experimental results on five public image compression datasets demonstrate that the proposed CIC outperforms five open-source state-of-the-art competing SIC algorithms in reconstruction capacity. Experimental results further show that the proposed method is suitable for out-of-sample testing images with dark backgrounds, sharp edges, high contrast, grid shapes, or complex patterns.

Read more

7/24/2024

Few-Shot Domain Adaptation for Learned Image Compression
Total Score

0

New!Few-Shot Domain Adaptation for Learned Image Compression

Tianyu Zhang, Haotian Zhang, Yuqi Li, Li Li, Dong Liu

Learned image compression (LIC) has achieved state-of-the-art rate-distortion performance, deemed promising for next-generation image compression techniques. However, pre-trained LIC models usually suffer from significant performance degradation when applied to out-of-training-domain images, implying their poor generalization capabilities. To tackle this problem, we propose a few-shot domain adaptation method for LIC by integrating plug-and-play adapters into pre-trained models. Drawing inspiration from the analogy between latent channels and frequency components, we examine domain gaps in LIC and observe that out-of-training-domain images disrupt pre-trained channel-wise decomposition. Consequently, we introduce a method for channel-wise re-allocation using convolution-based adapters and low-rank adapters, which are lightweight and compatible to mainstream LIC schemes. Extensive experiments across multiple domains and multiple representative LIC schemes demonstrate that our method significantly enhances pre-trained models, achieving comparable performance to H.266/VVC intra coding with merely 25 target-domain samples. Additionally, our method matches the performance of full-model finetune while transmitting fewer than $2%$ of the parameters.

Read more

9/18/2024

Rethinking Learned Image Compression: Context is All You Need
Total Score

0

Rethinking Learned Image Compression: Context is All You Need

Jixiang Luo

Since LIC has made rapid progress recently compared to traditional methods, this paper attempts to discuss the question about 'Where is the boundary of Learned Image Compression(LIC)?'. Thus this paper splits the above problem into two sub-problems:1)Where is the boundary of rate-distortion performance of PSNR? 2)How to further improve the compression gain and achieve the boundary? Therefore this paper analyzes the effectiveness of scaling parameters for encoder, decoder and context model, which are the three components of LIC. Then we conclude that scaling for LIC is to scale for context model and decoder within LIC. Extensive experiments demonstrate that overfitting can actually serve as an effective context. By optimizing the context, this paper further improves PSNR and achieves state-of-the-art performance, showing a performance gain of 14.39% with BD-RATE over VVC.

Read more

8/6/2024

FLLIC: Functionally Lossless Image Compression
Total Score

0

FLLIC: Functionally Lossless Image Compression

Xi Zhang, Xiaolin Wu

Recently, DNN models for lossless image coding have surpassed their traditional counterparts in compression performance, reducing the bit rate by about ten percent for natural color images. But even with these advances, mathematically lossless image compression (MLLIC) ratios for natural images still fall short of the bandwidth and cost-effectiveness requirements of most practical imaging and vision systems at present and beyond. To break the bottleneck of MLLIC in compression performance, we question the necessity of MLLIC, as almost all digital sensors inherently introduce acquisition noises, making mathematically lossless compression counterproductive. Therefore, in contrast to MLLIC, we propose a new paradigm of joint denoising and compression called functionally lossless image compression (FLLIC), which performs lossless compression of optimally denoised images (the optimality may be task-specific). Although not literally lossless with respect to the noisy input, FLLIC aims to achieve the best possible reconstruction of the latent noise-free original image. Extensive experiments show that FLLIC achieves state-of-the-art performance in joint denoising and compression of noisy images and does so at a lower computational cost.

Read more

5/28/2024