Study of Subjective and Objective Quality in Super-Resolution Enhanced Broadcast Images on a Novel SR-IQA Dataset
0
Sign in to get full access
Overview
- Evaluates subjective and objective image quality in super-resolution enhanced broadcast images
- Presents a novel dataset for super-resolution image quality assessment (SR-IQA)
- Explores the relationship between subjective and objective quality measures
Plain English Explanation
This research paper examines the quality of super-resolution enhanced images used in broadcast television and other video applications. Super-resolution is a technique that improves the resolution and detail of lower-quality images.
The researchers created a new dataset of broadcast images that have been enhanced using super-resolution algorithms. They then conducted subjective quality tests, where people rated the visual quality of the images. The researchers also calculated objective quality metrics that aim to automatically assess image quality without human raters.
By comparing the subjective and objective quality measures, the researchers explored the relationship between how people perceive image quality and how quality is measured computationally. This helps understand when super-resolution is successful at improving the visual experience and when there may be disconnects between human perception and technical quality metrics.
Technical Explanation
The paper presents a novel dataset called SR-IQA, which contains broadcast images that have been super-resolution enhanced using different algorithms. Subjective quality tests were conducted, where participants rated the visual quality of the images on a scale.
The researchers also calculated several objective image quality assessment (IQA) metrics on the images, including PSNR, SSIM, and VIF. These metrics aim to automatically assess quality without human raters.
By analyzing the relationship between the subjective and objective quality scores, the paper provides insights into how well current IQA metrics capture human perception of super-resolution enhanced images. The results suggest that while objective metrics can provide a useful proxy for quality, there are often gaps between technical quality and human visual experience.
Critical Analysis
The paper makes a valuable contribution by creating a new dataset specifically focused on super-resolution enhanced broadcast images, an important application domain. The subjective testing methodology appears rigorous, with a large number of participants rating the images.
However, the paper does not deeply explore potential reasons for the gaps between subjective and objective quality. More analysis of the types of distortions or artifacts that lead to mismatches could provide additional insights. The paper is also limited to a single type of content (broadcast images), so further research is needed to understand how generalizable the findings are.
Additionally, while the authors discuss the limitations of current IQA metrics, they do not propose new metrics or approaches that could better capture human perception of super-resolution quality. Developing more perceptually-aligned quality measures is an important area for future work.
Conclusion
This research sheds light on the complex relationship between subjective and objective quality in super-resolution enhanced broadcast images. The creation of the SR-IQA dataset and analysis of quality metrics provides a valuable foundation for further research in this area.
Understanding the gaps between technical quality and human perception is crucial for improving super-resolution algorithms and ensuring they deliver a high-quality visual experience. The findings suggest that a combination of subjective and objective quality assessment is needed to fully evaluate the performance of super-resolution techniques in real-world applications.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
Study of Subjective and Objective Quality in Super-Resolution Enhanced Broadcast Images on a Novel SR-IQA Dataset
Yongrok Kim, Junha Shin, Juhyun Lee, Hyunsuk Ko
To display low-quality broadcast content on high-resolution screens in full-screen format, the application of Super-Resolution (SR), a key consumer technology, is essential. Recently, SR methods have been developed that not only increase resolution while preserving the original image information but also enhance the perceived quality. However, evaluating the quality of SR images generated from low-quality sources, such as SR-enhanced broadcast content, is challenging due to the need to consider both distortions and improvements. Additionally, assessing SR image quality without original high-quality sources presents another significant challenge. Unfortunately, there has been a dearth of research specifically addressing the Image Quality Assessment (IQA) of SR images under these conditions. In this work, we introduce a new IQA dataset for SR broadcast images in both 2K and 4K resolutions. We conducted a subjective quality evaluation to obtain the Mean Opinion Score (MOS) for these SR images and performed a comprehensive human study to identify the key factors influencing the perceived quality. Finally, we evaluated the performance of existing IQA metrics on our dataset. This study reveals the limitations of current metrics, highlighting the need for a more robust IQA metric that better correlates with the perceived quality of SR images.
Read more9/27/2024
0
Perception- and Fidelity-aware Reduced-Reference Super-Resolution Image Quality Assessment
Xinying Lin, Xuyang Liu, Hong Yang, Xiaohai He, Honggang Chen
With the advent of image super-resolution (SR) algorithms, how to evaluate the quality of generated SR images has become an urgent task. Although full-reference methods perform well in SR image quality assessment (SR-IQA), their reliance on high-resolution (HR) images limits their practical applicability. Leveraging available reconstruction information as much as possible for SR-IQA, such as low-resolution (LR) images and the scale factors, is a promising way to enhance assessment performance for SR-IQA without HR for reference. In this letter, we attempt to evaluate the perceptual quality and reconstruction fidelity of SR images considering LR images and scale factors. Specifically, we propose a novel dual-branch reduced-reference SR-IQA network, ie, Perception- and Fidelity-aware SR-IQA (PFIQA). The perception-aware branch evaluates the perceptual quality of SR images by leveraging the merits of global modeling of Vision Transformer (ViT) and local relation of ResNet, and incorporating the scale factor to enable comprehensive visual perception. Meanwhile, the fidelity-aware branch assesses the reconstruction fidelity between LR and SR images through their visual perception. The combination of the two branches substantially aligns with the human visual system, enabling a comprehensive SR image evaluation. Experimental results indicate that our PFIQA outperforms current state-of-the-art models across three widely-used SR-IQA benchmarks. Notably, PFIQA excels in assessing the quality of real-world SR images.
Read more7/30/2024
0
S-IQA Image Quality Assessment With Compressive Sampling
Ronghua Liao, Chen Hui, Lang Yuan, Haiqi Zhu, Feng Jiang
No-Reference Image Quality Assessment (NR-IQA) aims at estimating image quality in accordance with subjective human perception. However, most methods focus on exploring increasingly complex networks to improve the final performance,accompanied by limitations on input images. Especially when applied to high-resolution (HR) images, these methods offen have to adjust the size of original image to meet model input.To further alleviate the aforementioned issue, we propose two networks for NR-IQA with Compressive Sampling (dubbed CL-IQA and CS-IQA). They consist of four components: (1) The Compressed Sampling Module (CSM) to sample the image (2)The Adaptive Embedding Module (AEM). The measurements are embedded by AEM to extract high-level features. (3) The Vision Transformer and Scale Swin TranBlocksformer Moudle(SSTM) to extract deep features. (4) The Dual Branch (DB) to get final quality score. Experiments show that our proposed methods outperform other methods on various datasets with less data usage.
Read more9/12/2024
🖼️
0
Exploring Rich Subjective Quality Information for Image Quality Assessment in the Wild
Xiongkuo Min, Yixuan Gao, Yuqin Cao, Guangtao Zhai, Wenjun Zhang, Huifang Sun, Chang Wen Chen
Traditional in the wild image quality assessment (IQA) models are generally trained with the quality labels of mean opinion score (MOS), while missing the rich subjective quality information contained in the quality ratings, for example, the standard deviation of opinion scores (SOS) or even distribution of opinion scores (DOS). In this paper, we propose a novel IQA method named RichIQA to explore the rich subjective rating information beyond MOS to predict image quality in the wild. RichIQA is characterized by two key novel designs: (1) a three-stage image quality prediction network which exploits the powerful feature representation capability of the Convolutional vision Transformer (CvT) and mimics the short-term and long-term memory mechanisms of human brain; (2) a multi-label training strategy in which rich subjective quality information like MOS, SOS and DOS are concurrently used to train the quality prediction network. Powered by these two novel designs, RichIQA is able to predict the image quality in terms of a distribution, from which the mean image quality can be subsequently obtained. Extensive experimental results verify that the three-stage network is tailored to predict rich quality information, while the multi-label training strategy can fully exploit the potentials within subjective quality rating and enhance the prediction performance and generalizability of the network. RichIQA outperforms state-of-the-art competitors on multiple large-scale in the wild IQA databases with rich subjective rating labels. The code of RichIQA will be made publicly available on GitHub.
Read more9/10/2024