scholarly journals Depth image super-resolution reconstruction based on a modified joint trilateral filter

2019 ◽  
Vol 6 (1) ◽  
pp. 181074 ◽  
Author(s):  
Dongsheng Zhou ◽  
Ruyi Wang ◽  
Xin Yang ◽  
Qiang Zhang ◽  
Xiaopeng Wei
Keyword(s):  
Super Resolution ◽  
Structural Similarity ◽  
Depth Image ◽  
High Quality ◽  
Depth Images ◽  
Trilateral Filter ◽  
Coding Method ◽  
Image Edge ◽  
Image Super Resolution ◽  
Sr Reconstruction

Depth image super-resolution (SR) is a technique that uses signal processing technology to enhance the resolution of a low-resolution (LR) depth image. Generally, external database or high-resolution (HR) images are needed to acquire prior information for SR reconstruction. To overcome the limitations, a depth image SR method without reference to any external images is proposed. In this paper, a high-quality edge map is first constructed using a sparse coding method, which uses a dictionary learned from the original images at different scales. Then, the high-quality edge map is used to guide the interpolation for depth images by a modified joint trilateral filter. During the interpolation, some information of gradient and structural similarity (SSIM) are added to preserve the detailed information and suppress the noise. The proposed method can not only preserve the sharpness of image edge, but also avoid the dependence on database. Experimental results show that the proposed method is superior to some state-of-the-art depth image SR methods.

scholarly journals Perceptual Metric Guided Deep Attention Network for Single Image Super-Resolution

Electronics ◽  
2020 ◽  
Vol 9 (7) ◽  
pp. 1145
Author(s):  
Yubao Sun ◽  
Yuyang Shi ◽  
Ying Yang ◽  
Wangping Zhou
Keyword(s):  
Deep Learning ◽  
Multiple Scales ◽  
Super Resolution ◽  
Structural Similarity ◽  
Training Image ◽  
Superior Performance ◽  
Single Image ◽  
Network Parameters ◽  
Image Super Resolution ◽  
Sr Reconstruction

Deep learning has been widely applied to image super-resolution (SR) tasks and has achieved superior performance over traditional methods due to its excellent feature learning capabilities. However, most of these deep learning-based methods require training image sets to pre-train SR network parameters. In this paper, we propose a new single image SR network without the need of any pre-training. The proposed network is optimized to achieve the SR reconstruction only from a low resolution observation rather than training image sets, and it focuses on improving the visual quality of reconstructed images. Specifically, we designed an attention-based decoder-encoder network for predicting the SR reconstruction, in which a residual spatial attention (RSA) unit is deployed in each layer of decoder to capture key information. Moreover, we adopt the perceptual metric consisting of L1 metric and multi-scale structural similarity (MSSSIM) metric to learn the network parameters. Different than the conventional MSE (mean squared error) metric, the perceptual metric coincides well with perceptual characteristics of the human visual system. Under the guidance of the perceptual metric, the RSA units are capable of predicting the visually sensitive areas at different scales. The proposed network can thus pay more attention to these areas for preserving visual informative structures at multiple scales. The experimental results on the Set5 and Set14 image set demonstrate that the combination of Perceptual metric and RSA units can significantly improve the reconstruction quality. In terms of PSNR and structural similarity (SSIM) values, the proposed method achieves better reconstruction results than the related works, and it is even comparable to some pre-trained networks.

Edge area constraint guided filter depth image super-resolution reconstruction algorithm

2021 ◽  
Vol 50 (1) ◽  
pp. 20200081-20200081
Author(s):  
武军安 Jun''an Wu ◽  
郭锐 Rui Guo ◽  
刘荣忠 Rongzhong Liu ◽  
柯尊贵 Zungui Ke ◽  
赵旭 Xu Zhao
Keyword(s):  
Super Resolution ◽  
Reconstruction Algorithm ◽  
Guided Filter ◽  
Depth Image ◽  
Image Super Resolution

scholarly journals Image Super Resolution Reconstruction Based on Improved Invertible Rescaling Net

2021 ◽  
Author(s):  
Taiping Mo ◽  
Dehong Chen
Keyword(s):  
Feature Extraction ◽  
High Frequency ◽  
Interpolation Method ◽  
Super Resolution ◽  
Frequency Information ◽  
Ill Posed ◽  
Image Edge ◽  
Image Super Resolution ◽  
Improved Model ◽  
Image Details

Abstract The Invertible Rescaling Net (IRN) is modeling image downscaling and upscaling as a unified task to alleviate the ill-posed problem in the super-resolution task. However, the ability of potential variables of the model embedded high-frequency information is general, which affects the performance of the reconstructed image. In order to improve the ability of embedding high-frequency information and further reduce the complexity of the model, the potential variables and feature extraction of key components of IRN are improved. Attention mechanism and dilated convolution are used to improve the feature extraction block, reduce the parameters of feature extraction block, and allocate more attention to the image details. The high frequency sub-band interpolation method of wavelet domain is used to improve the potential variables, process and save the image edge, and enhance the ability of embedding high frequency information. Experimental results show that compared with IRN model, improved model has less complexity and excellent performance.

scholarly journals Edge-Guided Depth Image Super-Resolution Based on KSVD

IEEE Access ◽  
2020 ◽  
Vol 8 ◽  
pp. 41108-41115
Author(s):  
Binhui Liu ◽  
Qiang Ling
Keyword(s):  
Super Resolution ◽  
Depth Image ◽  
Image Super Resolution

Discrete and continuous optimizations for depth image super-resolution

2012 ◽  
Author(s):  
Ouk Choi ◽  
Hwasup Lim ◽  
Byongmin Kang ◽  
Yong Sun Kim ◽  
Keechang Lee ◽  
...  
Keyword(s):  
Super Resolution ◽  
Depth Image ◽  
Image Super Resolution

scholarly journals Single Image Super-Resolution: Depthwise Separable Convolution Super-Resolution Generative Adversarial Network

2020 ◽  
Vol 10 (1) ◽  
pp. 375 ◽  
Author(s):  
Zetao Jiang ◽  
Yongsong Huang ◽  
Lirui Hu
Keyword(s):  
Similarity Index ◽  
Super Resolution ◽  
Structural Similarity ◽  
Image Features ◽  
Single Image ◽  
Generative Adversarial Network ◽  
Visual Evaluation ◽  
Adversarial Network ◽  
Image Super Resolution ◽  
Single Image Super Resolution

The super-resolution generative adversarial network (SRGAN) is a seminal work that is capable of generating realistic textures during single image super-resolution. However, the hallucinated details are often accompanied by unpleasant artifacts. To further enhance the visual quality, we propose a deep learning method for single image super-resolution (SR). Our method directly learns an end-to-end mapping between the low/high-resolution images. The method is based on depthwise separable convolution super-resolution generative adversarial network (DSCSRGAN). A new depthwise separable convolution dense block (DSC Dense Block) was designed for the generator network, which improved the ability to represent and extract image features, while greatly reducing the total amount of parameters. For the discriminator network, the batch normalization (BN) layer was discarded, and the problem of artifacts was reduced. A frequency energy similarity loss function was designed to constrain the generator network to generate better super-resolution images. Experiments on several different datasets showed that the peak signal-to-noise ratio (PSNR) was improved by more than 3 dB, structural similarity index (SSIM) was increased by 16%, and the total parameter was reduced to 42.8% compared with the original model. Combining various objective indicators and subjective visual evaluation, the algorithm was shown to generate richer image details, clearer texture, and lower complexity.

Sign in / Sign up

Export Citation Format

Share Document