Perceptual Assessment and Optimization of High Dynamic Range Image Rendering

Read original: arXiv:2310.12877 - Published 6/18/2024 by Peibei Cao, Rafal K. Mantiuk, Kede Ma
Total Score

0

🛠️

Sign in to get full access

or

If you already have an account, we'll log you in

Overview

  • This paper proposes a new family of high dynamic range (HDR) image quality metrics that can accurately assess the rendering quality of HDR images.
  • Existing quality models are primarily designed for low dynamic range (LDR) images and do not align well with human perception of HDR image quality.
  • The proposed HDR quality metrics use a simple inverse display model to decompose an HDR image into a stack of LDR images with varying exposures, which are then assessed using well-established LDR quality metrics.

Plain English Explanation

The paper discusses a new way to evaluate the quality of HDR images, which can capture a much wider range of brightness levels than traditional LDR images. [https://aimodels.fyi/papers/arxiv/hdr-imaging-dynamic-scenes-events] Existing quality assessment models are not well-suited for HDR images, as they were designed for the more limited range of LDR images.

The researchers' approach is to break down an HDR image into a series of LDR images, each with a different exposure level. [https://aimodels.fyi/papers/arxiv/optimizing-illuminant-estimation-dual-exposure-hdr-imaging] These LDR images can then be evaluated using established quality metrics, which provides a more accurate assessment of the HDR image's overall quality. This method has several advantages:

  1. It builds on the recent advancements in LDR quality metrics, rather than requiring the development of completely new HDR-specific models.
  2. It does not rely on human perceptual data of HDR image quality, which can be difficult to obtain.
  3. It allows for the prioritization of specific luminance ranges, enabling a more detailed and nuanced quality assessment.

By using this approach, the researchers aim to provide a better way to evaluate the rendering quality of HDR images, which is important for applications like HDR imaging, [https://aimodels.fyi/papers/arxiv/fasthdrnet-new-efficient-method-sdr-to-hdr] novel view synthesis, [https://aimodels.fyi/papers/arxiv/di-retinex-digital-imaging-retinex-theory-low] and other areas where accurate representation of a wide range of brightness levels is critical.

Technical Explanation

The key step in the proposed HDR quality metrics is the use of a simple inverse display model to decompose an HDR image into a stack of LDR images with varying exposures. This is done to leverage the recent advancements in well-established LDR quality metrics, rather than developing entirely new HDR-specific models.

The researchers tested their HDR quality metrics on four different HDR image quality datasets and found that they consistently outperformed existing models. The metrics also demonstrated their usefulness in perceptually optimizing HDR novel view synthesis, an application where accurately representing the wide luminance ranges in natural scenes is essential.

Critical Analysis

The paper presents a novel and promising approach to HDR image quality assessment, but there are a few potential limitations and areas for further research:

  1. The inverse display model used to decompose HDR images into LDR layers may not perfectly capture the complex human visual system's response to a wide range of luminance levels. [https://aimodels.fyi/papers/arxiv/di-retinex-digital-imaging-retinex-theory-low]
  2. The researchers did not directly compare their metrics to human perceptual judgments of HDR image quality, which would provide a more direct validation of the approach.
  3. The paper focuses on static HDR images, but the quality assessment of dynamic HDR content, such as video, may require additional considerations.

Future research could explore more sophisticated HDR-to-LDR decomposition models, as well as investigate the applicability of the proposed metrics to dynamic HDR content. Additionally, further validation against human perceptual studies would strengthen the findings.

Conclusion

This paper introduces a new family of HDR image quality metrics that leverage well-established LDR quality assessment models. By decomposing HDR images into a stack of LDR images with varying exposures, the proposed metrics can accurately evaluate the rendering quality of HDR images without requiring extensive human perceptual data or the development of entirely new HDR-specific models.

The experimental results demonstrate the effectiveness of this approach, which has important implications for applications such as HDR imaging, [https://aimodels.fyi/papers/arxiv/fasthdrnet-new-efficient-method-sdr-to-hdr] novel view synthesis, [https://aimodels.fyi/papers/arxiv/di-retinex-digital-imaging-retinex-theory-low] and other areas where faithful representation of a wide range of luminance levels is crucial. The proposed HDR quality metrics offer a promising step forward in accurately assessing the quality of HDR content.



This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!

Follow @aimodelsfyi on 𝕏 →

Related Papers

🛠️

Total Score

0

Perceptual Assessment and Optimization of High Dynamic Range Image Rendering

Peibei Cao, Rafal K. Mantiuk, Kede Ma

High dynamic range (HDR) rendering has the ability to faithfully reproduce the wide luminance ranges in natural scenes, but how to accurately assess the rendering quality is relatively underexplored. Existing quality models are mostly designed for low dynamic range (LDR) images, and do not align well with human perception of HDR image quality. To fill this gap, we propose a family of HDR quality metrics, in which the key step is employing a simple inverse display model to decompose an HDR image into a stack of LDR images with varying exposures. Subsequently, these decomposed images are assessed through well-established LDR quality metrics. Our HDR quality models present three distinct benefits. First, they directly inherit the recent advancements of LDR quality metrics. Second, they do not rely on human perceptual data of HDR image quality for re-calibration. Third, they facilitate the alignment and prioritization of specific luminance ranges for more accurate and detailed quality assessment. Experimental results show that our HDR quality metrics consistently outperform existing models in terms of quality assessment on four HDR image quality datasets and perceptual optimization of HDR novel view synthesis.

Read more

6/18/2024

Learned HDR Image Compression for Perceptually Optimal Storage and Display
Total Score

0

Learned HDR Image Compression for Perceptually Optimal Storage and Display

Peibei Cao, Haoyu Chen, Jingzhe Ma, Yu-Chieh Yuan, Zhiyong Xie, Xin Xie, Haiqing Bai, Kede Ma

High dynamic range (HDR) capture and display have seen significant growth in popularity driven by the advancements in technology and increasing consumer demand for superior image quality. As a result, HDR image compression is crucial to fully realize the benefits of HDR imaging without suffering from large file sizes and inefficient data handling. Conventionally, this is achieved by introducing a residual/gain map as additional metadata to bridge the gap between HDR and low dynamic range (LDR) images, making the former compatible with LDR image codecs but offering suboptimal rate-distortion performance. In this work, we initiate efforts towards end-to-end optimized HDR image compression for perceptually optimal storage and display. Specifically, we learn to compress an HDR image into two bitstreams: one for generating an LDR image to ensure compatibility with legacy LDR displays, and another as side information to aid HDR image reconstruction from the output LDR image. To measure the perceptual quality of output HDR and LDR images, we use two recently proposed image distortion metrics, both validated against human perceptual data of image quality and with reference to the uncompressed HDR image. Through end-to-end optimization for rate-distortion performance, our method dramatically improves HDR and LDR image quality at all bit rates.

Read more

7/19/2024

Adapting Pretrained Networks for Image Quality Assessment on High Dynamic Range Displays
Total Score

0

Adapting Pretrained Networks for Image Quality Assessment on High Dynamic Range Displays

Andrei Chubarau, Hyunjin Yoo, Tara Akhavan, James Clark

Conventional image quality metrics (IQMs), such as PSNR and SSIM, are designed for perceptually uniform gamma-encoded pixel values and cannot be directly applied to perceptually non-uniform linear high-dynamic-range (HDR) colors. Similarly, most of the available datasets consist of standard-dynamic-range (SDR) images collected in standard and possibly uncontrolled viewing conditions. Popular pre-trained neural networks are likewise intended for SDR inputs, restricting their direct application to HDR content. On the other hand, training HDR models from scratch is challenging due to limited available HDR data. In this work, we explore more effective approaches for training deep learning-based models for image quality assessment (IQA) on HDR data. We leverage networks pre-trained on SDR data (source domain) and re-target these models to HDR (target domain) with additional fine-tuning and domain adaptation. We validate our methods on the available HDR IQA datasets, demonstrating that models trained with our combined recipe outperform previous baselines, converge much quicker, and reliably generalize to HDR inputs.

Read more

5/2/2024

HDR Imaging for Dynamic Scenes with Events
Total Score

0

HDR Imaging for Dynamic Scenes with Events

Li Xiaopeng, Zeng Zhaoyuan, Fan Cien, Zhao Chen, Deng Lei, Yu Lei

High dynamic range imaging (HDRI) for real-world dynamic scenes is challenging because moving objects may lead to hybrid degradation of low dynamic range and motion blur. Existing event-based approaches only focus on a separate task, while cascading HDRI and motion deblurring would lead to sub-optimal solutions, and unavailable ground-truth sharp HDR images aggravate the predicament. To address these challenges, we propose an Event-based HDRI framework within a Self-supervised learning paradigm, i.e., Self-EHDRI, which generalizes HDRI performance in real-world dynamic scenarios. Specifically, a self-supervised learning strategy is carried out by learning cross-domain conversions from blurry LDR images to sharp LDR images, which enables sharp HDR images to be accessible in the intermediate process even though ground-truth sharp HDR images are missing. Then, we formulate the event-based HDRI and motion deblurring model and conduct a unified network to recover the intermediate sharp HDR results, where both the high dynamic range and high temporal resolution of events are leveraged simultaneously for compensation. We construct large-scale synthetic and real-world datasets to evaluate the effectiveness of our method. Comprehensive experiments demonstrate that the proposed Self-EHDRI outperforms state-of-the-art approaches by a large margin. The codes, datasets, and results are available at https://lxp-whu.github.io/Self-EHDRI.

Read more

4/5/2024