HDRT: Infrared Capture for HDR Imaging
0
Sign in to get full access
Overview
• This paper introduces HDRT, a novel method for capturing and processing high dynamic range (HDR) images using thermal infrared (IR) cameras.
• The key innovations of HDRT include an inverse tone mapping technique to convert standard dynamic range (SDR) images to HDR, and a fusion algorithm to combine visible RGB and thermal IR data for enhanced HDR imaging.
Plain English Explanation
• HDRT is a new way to create HDR images that can capture a wider range of brightness levels compared to regular cameras. It does this by using a special thermal infrared camera in addition to a normal color camera.
• The thermal camera can see details in very bright and very dark areas that a regular camera would miss. HDRT has a process to take the images from both cameras and combine them into one HDR image that shows a much wider range of brightness levels.
• This allows HDRT to create HDR images that are more true to what the human eye can see, capturing details that would normally be lost in overly bright or dark areas of a scene. [The paper discusses related work on inverse tone mapping and HDR imaging that provides context for HDRT's approach.]
Technical Explanation
• HDRT uses a thermal IR camera alongside a regular RGB camera to capture scene information. It then applies an inverse tone mapping technique to convert the SDR RGB images to HDR, leveraging the thermal IR data.
• A fusion algorithm is used to combine the HDR RGB and thermal IR data into a single RGBT HDR image. This fusion process allows HDRT to preserve details in both bright and dark regions of the scene.
• The paper presents experiments evaluating HDRT's performance on HDR reconstruction and dynamic scene capture, demonstrating its advantages over existing HDR imaging methods.
Critical Analysis
• The paper acknowledges that HDRT requires using specialized thermal IR hardware, which may limit its broader adoption compared to software-only HDR methods. Further research could explore ways to reduce the hardware requirements.
• While the fusion of RGB and thermal IR data is a key innovation, the paper does not deeply analyze potential issues around misalignment or other sensor fusion challenges that could impact performance.
• The evaluation focuses on controlled scenes, so more research may be needed to understand HDRT's real-world performance, especially in dynamic environments.
Conclusion
• HDRT presents a novel HDR imaging approach that leverages thermal IR data to enhance the capture of high and low brightness details compared to standard RGB cameras.
• The inverse tone mapping and data fusion techniques demonstrated in this work show promise for advancing the state-of-the-art in HDR imaging, with potential applications in photography, surveillance, and other domains requiring wide dynamic range capture.
• Further research could explore ways to make HDRT more accessible and robust for diverse real-world scenarios, building on the foundations established in this paper.
This summary was produced with help from an AI and may contain inaccuracies - check out the links to read the original source documents!
Related Papers
0
HDRT: Infrared Capture for HDR Imaging
Jingchao Peng, Thomas Bashford-Rogers, Francesco Banterle, Haitao Zhao, Kurt Debattista
Capturing real world lighting is a long standing challenge in imaging and most practical methods acquire High Dynamic Range (HDR) images by either fusing multiple exposures, or boosting the dynamic range of Standard Dynamic Range (SDR) images. Multiple exposure capture is problematic as it requires longer capture times which can often lead to ghosting problems. The main alternative, inverse tone mapping is an ill-defined problem that is especially challenging as single captured exposures usually contain clipped and quantized values, and are therefore missing substantial amounts of content. To alleviate this, we propose a new approach, High Dynamic Range Thermal (HDRT), for HDR acquisition using a separate, commonly available, thermal infrared (IR) sensor. We propose a novel deep neural method (HDRTNet) which combines IR and SDR content to generate HDR images. HDRTNet learns to exploit IR features linked to the RGB image and the IR-specific parameters are subsequently used in a dual branch method that fuses features at shallow layers. This produces an HDR image that is significantly superior to that generated using naive fusion approaches. To validate our method, we have created the first HDR and thermal dataset, and performed extensive experiments comparing HDRTNet with the state-of-the-art. We show substantial quantitative and qualitative quality improvements on both over- and under-exposed images, showing that our approach is robust to capturing in multiple different lighting conditions.
Read more6/11/2024
0
Semantic Aware Diffusion Inverse Tone Mapping
Abhishek Goswami, Aru Ranjan Singh, Francesco Banterle, Kurt Debattista, Thomas Bashford-Rogers
The range of real-world scene luminance is larger than the capture capability of many digital camera sensors which leads to details being lost in captured images, most typically in bright regions. Inverse tone mapping attempts to boost these captured Standard Dynamic Range (SDR) images back to High Dynamic Range (HDR) by creating a mapping that linearizes the well exposed values from the SDR image, and provides a luminance boost to the clipped content. However, in most cases, the details in the clipped regions cannot be recovered or estimated. In this paper, we present a novel inverse tone mapping approach for mapping SDR images to HDR that generates lost details in clipped regions through a semantic-aware diffusion based inpainting approach. Our method proposes two major contributions - first, we propose to use a semantic graph to guide SDR diffusion based inpainting in masked regions in a saturated image. Second, drawing inspiration from traditional HDR imaging and bracketing methods, we propose a principled formulation to lift the SDR inpainted regions to HDR that is compatible with generative inpainting methods. Results show that our method demonstrates superior performance across different datasets on objective metrics, and subjective experiments show that the proposed method matches (and in most cases outperforms) state-of-art inverse tone mapping operators in terms of objective metrics and outperforms them for visual fidelity.
Read more5/27/2024
🏋️
0
FastHDRNet: A new efficient method for SDR-to-HDR Translation
Siyuan Tian, Hao Wang, Yiren Rong, Junhao Wang, Renjie Dai, Zhengxiao He
Modern displays nowadays possess the capability to render video content with a high dynamic range (HDR) and an extensive color gamut .However, the majority of available resources are still in standard dynamic range (SDR). Therefore, we need to identify an effective methodology for this objective.The existing deep neural networks (DNN) based SDR to HDR conversion methods outperforms conventional methods, but they are either too large to implement or generate some terrible artifacts. We propose a neural network for SDR to HDR conversion, termed FastHDRNet. This network includes two parts, Adaptive Universal Color Transformation (AUCT) and Local Enhancement (LE). The architecture is designed as a lightweight network that utilizes global statistics and local information with super high efficiency. After the experiment, we find that our proposed method achieves state-of-the-art performance in both quantitative comparisons and visual quality with a lightweight structure and a enhanced infer speed.
Read more5/14/2024
🛠️
0
Perceptual Assessment and Optimization of High Dynamic Range Image Rendering
Peibei Cao, Rafal K. Mantiuk, Kede Ma
High dynamic range (HDR) rendering has the ability to faithfully reproduce the wide luminance ranges in natural scenes, but how to accurately assess the rendering quality is relatively underexplored. Existing quality models are mostly designed for low dynamic range (LDR) images, and do not align well with human perception of HDR image quality. To fill this gap, we propose a family of HDR quality metrics, in which the key step is employing a simple inverse display model to decompose an HDR image into a stack of LDR images with varying exposures. Subsequently, these decomposed images are assessed through well-established LDR quality metrics. Our HDR quality models present three distinct benefits. First, they directly inherit the recent advancements of LDR quality metrics. Second, they do not rely on human perceptual data of HDR image quality for re-calibration. Third, they facilitate the alignment and prioritization of specific luminance ranges for more accurate and detailed quality assessment. Experimental results show that our HDR quality metrics consistently outperform existing models in terms of quality assessment on four HDR image quality datasets and perceptual optimization of HDR novel view synthesis.
Read more6/18/2024