Cut-FUNQUE: An Objective Quality Model for Compressed Tone-Mapped High Dynamic Range Videos
0
Sign in to get full access
Overview
- This paper introduces Cut-FUNQUE, a new objective quality model for evaluating the perceptual quality of compressed tone-mapped high dynamic range (HDR) videos.
- The model aims to account for both compression artifacts and tone mapping distortions, which can significantly impact the perceived quality of HDR video content.
- The researchers developed Cut-FUNQUE by leveraging user studies and machine learning techniques to capture important aspects of human visual perception.
Plain English Explanation
High dynamic range (HDR) video technology captures a wider range of light and color compared to standard dynamic range (SDR) video. This allows HDR video to better represent the real-world visual experience. However, when HDR video is compressed for storage or transmission, it can introduce visual artifacts. Additionally, the process of converting HDR video to a format suitable for display on SDR devices (tone mapping) can further degrade the visual quality.
The Cut-FUNQUE model proposed in this paper aims to objectively measure the perceptual quality of compressed tone-mapped HDR video. It considers both the compression-related distortions and the tone mapping-related distortions to provide a more comprehensive quality assessment. The researchers developed Cut-FUNQUE by conducting user studies to understand how people perceive the quality of HDR video and then used machine learning techniques to capture these perceptual factors in the model.
Technical Explanation
The Cut-FUNQUE model is designed to assess the quality of compressed tone-mapped HDR video by considering both compression-related and tone mapping-related distortions. The researchers conducted subjective user studies to understand which factors influence human perception of HDR video quality, such as contrast, color accuracy, and overall visual appeal.
Based on the insights from the user studies, the Cut-FUNQUE model incorporates several quality metrics, including:
- Compression-related metrics, such as block artifacts and blurriness
- Tone mapping-related metrics, such as loss of dynamic range and color accuracy
- Perceptual uniformity, which measures how evenly the quality is distributed across the video frames
The researchers then used machine learning techniques to combine these metrics into a single quality score that aligns with human subjective assessments of HDR video quality.
Critical Analysis
The Cut-FUNQUE model provides a comprehensive approach to evaluating the quality of compressed tone-mapped HDR videos, considering both compression-related and tone mapping-related distortions. This is an important contribution, as previous quality models often focused on one type of distortion or the other, but not both.
However, the paper acknowledges that the model's performance may be limited by the scope and diversity of the user studies used to develop it. The researchers suggest that further user studies with a wider range of HDR video content and viewing conditions could help refine the model and improve its generalization.
Additionally, the paper does not provide a detailed analysis of the relative importance of the different quality metrics in the Cut-FUNQUE model. Understanding which factors have the greatest impact on perceived quality could help guide future research and enable more targeted quality optimization approaches.
Conclusion
The Cut-FUNQUE model represents a significant step forward in objectively evaluating the perceptual quality of compressed tone-mapped HDR videos. By considering both compression-related and tone mapping-related distortions, the model provides a more comprehensive and accurate assessment of visual quality, which could be valuable for a variety of HDR video applications, such as video compression optimization, quality monitoring, and user experience evaluation.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Cut-FUNQUE: An Objective Quality Model for Compressed Tone-Mapped High Dynamic Range Videos
Abhinau K. Venkataramanan, Cosmin Stejerean, Ioannis Katsavounidis, Hassene Tmar, Alan C. Bovik
High Dynamic Range (HDR) videos have enjoyed a surge in popularity in recent years due to their ability to represent a wider range of contrast and color than Standard Dynamic Range (SDR) videos. Although HDR video capture has seen increasing popularity because of recent flagship mobile phones such as Apple iPhones, Google Pixels, and Samsung Galaxy phones, a broad swath of consumers still utilize legacy SDR displays that are unable to display HDR videos. As result, HDR videos must be processed, i.e., tone-mapped, before streaming to a large section of SDR-capable video consumers. However, server-side tone-mapping involves automating decisions regarding the choices of tone-mapping operators (TMOs) and their parameters to yield high-fidelity outputs. Moreover, these choices must be balanced against the effects of lossy compression, which is ubiquitous in streaming scenarios. In this work, we develop a novel, efficient model of objective video quality named Cut-FUNQUE that is able to accurately predict the visual quality of tone-mapped and compressed HDR videos. Finally, we evaluate Cut-FUNQUE on a large-scale crowdsourced database of such videos and show that it achieves state-of-the-art accuracy.
Read more4/23/2024
🤖
0
YouTube SFV+HDR Quality Dataset
Yilin Wang, Joong Gon Yim, Neil Birkbeck, Balu Adsumilli
The popularity of Short form videos (SFV) has grown dramatically in the past few years, and has become a phenomenal video category with billions of viewers. Meanwhile, High Dynamic Range (HDR) as an advanced feature also becomes more and more popular on video sharing platforms. As a hot topic with huge impact, SFV and HDR bring new questions to video quality research: 1) is SFV+HDR quality assessment significantly different from traditional User Generated Content (UGC) quality assessment? 2) do objective quality metrics designed for traditional UGC still work well for SFV+HDR? To answer the above questions, we created the first large scale SFV+HDR dataset with reliable subjective quality scores, covering 10 popular content categories. Further, we also introduce a general sampling framework to maximize the representativeness of the dataset. We provided a comprehensive analysis of subjective quality scores for Short form SDR and HDR videos, and discuss the reliability of state-of-the-art UGC quality metrics and potential improvements.
Read more6/24/2024
0
Semantic Aware Diffusion Inverse Tone Mapping
Abhishek Goswami, Aru Ranjan Singh, Francesco Banterle, Kurt Debattista, Thomas Bashford-Rogers
The range of real-world scene luminance is larger than the capture capability of many digital camera sensors which leads to details being lost in captured images, most typically in bright regions. Inverse tone mapping attempts to boost these captured Standard Dynamic Range (SDR) images back to High Dynamic Range (HDR) by creating a mapping that linearizes the well exposed values from the SDR image, and provides a luminance boost to the clipped content. However, in most cases, the details in the clipped regions cannot be recovered or estimated. In this paper, we present a novel inverse tone mapping approach for mapping SDR images to HDR that generates lost details in clipped regions through a semantic-aware diffusion based inpainting approach. Our method proposes two major contributions - first, we propose to use a semantic graph to guide SDR diffusion based inpainting in masked regions in a saturated image. Second, drawing inspiration from traditional HDR imaging and bracketing methods, we propose a principled formulation to lift the SDR inpainted regions to HDR that is compatible with generative inpainting methods. Results show that our method demonstrates superior performance across different datasets on objective metrics, and subjective experiments show that the proposed method matches (and in most cases outperforms) state-of-art inverse tone mapping operators in terms of objective metrics and outperforms them for visual fidelity.
Read more5/27/2024
🛠️
0
Perceptual Assessment and Optimization of High Dynamic Range Image Rendering
Peibei Cao, Rafal K. Mantiuk, Kede Ma
High dynamic range (HDR) rendering has the ability to faithfully reproduce the wide luminance ranges in natural scenes, but how to accurately assess the rendering quality is relatively underexplored. Existing quality models are mostly designed for low dynamic range (LDR) images, and do not align well with human perception of HDR image quality. To fill this gap, we propose a family of HDR quality metrics, in which the key step is employing a simple inverse display model to decompose an HDR image into a stack of LDR images with varying exposures. Subsequently, these decomposed images are assessed through well-established LDR quality metrics. Our HDR quality models present three distinct benefits. First, they directly inherit the recent advancements of LDR quality metrics. Second, they do not rely on human perceptual data of HDR image quality for re-calibration. Third, they facilitate the alignment and prioritization of specific luminance ranges for more accurate and detailed quality assessment. Experimental results show that our HDR quality metrics consistently outperform existing models in terms of quality assessment on four HDR image quality datasets and perceptual optimization of HDR novel view synthesis.
Read more6/18/2024