scholarly journals A framework for estimating relative depth in video

2021 ◽  
Author(s):  
Richard Rzeszutek

This dissertation proposes a novel framework for recovering relative depth maps from a video. The framework is composed of two parts: a depth estimator and a sparse label interpolator. These parts are completely separate from one another and can operate independently. Prior methods have tended to heavily couple the interpolation stage with the depth estimation, which can assist with automation at the expense of flexibility. The loss of this flexibility can in fact be worse than any advantage gained by coupling the two stages together. This dissertation shows how by treating the two stages separately, it is very easy to change the quality of the results with little effort. It also leaves room for other adjustments. The depth estimator is based upon well-established computer vision principles and only has the restriction that the camera must be moving in order to obtain depth estimates. By starting from first principles, this dissertation has developed a new approach for quickly estimating relative depth. That is, it is able to answer the question, “is this feature closer than another," with relatively little computational overhead. The estimator is designed using a pipeline-style approach so that it produces sparse depth estimates in an online fashion; i.e. a depth estimate is automatically available for each new frame presented to the estimator. Finally, the interpolator applies an existing method based upon edge-aware filtering to generate the final depth maps. When temporal filters are used, the interpolation stage is able to very easily handle frames without any depth information, such as when the camera was stationary. However, unlike the prior work, this dissertation establishes the theoretical background for this type of interpolation and addresses some of the associated numerical problems. Strategies for dealing with these issues have also been provided

2021 ◽  
Author(s):  
Richard Rzeszutek

This dissertation proposes a novel framework for recovering relative depth maps from a video. The framework is composed of two parts: a depth estimator and a sparse label interpolator. These parts are completely separate from one another and can operate independently. Prior methods have tended to heavily couple the interpolation stage with the depth estimation, which can assist with automation at the expense of flexibility. The loss of this flexibility can in fact be worse than any advantage gained by coupling the two stages together. This dissertation shows how by treating the two stages separately, it is very easy to change the quality of the results with little effort. It also leaves room for other adjustments. The depth estimator is based upon well-established computer vision principles and only has the restriction that the camera must be moving in order to obtain depth estimates. By starting from first principles, this dissertation has developed a new approach for quickly estimating relative depth. That is, it is able to answer the question, “is this feature closer than another," with relatively little computational overhead. The estimator is designed using a pipeline-style approach so that it produces sparse depth estimates in an online fashion; i.e. a depth estimate is automatically available for each new frame presented to the estimator. Finally, the interpolator applies an existing method based upon edge-aware filtering to generate the final depth maps. When temporal filters are used, the interpolation stage is able to very easily handle frames without any depth information, such as when the camera was stationary. However, unlike the prior work, this dissertation establishes the theoretical background for this type of interpolation and addresses some of the associated numerical problems. Strategies for dealing with these issues have also been provided


2021 ◽  
Vol 11 (6) ◽  
pp. 2666
Author(s):  
Hafiz Muhammad Usama Hassan Alvi ◽  
Muhammad Shahid Farid ◽  
Muhammad Hassan Khan ◽  
Marcin Grzegorzek

Emerging 3D-related technologies such as augmented reality, virtual reality, mixed reality, and stereoscopy have gained remarkable growth due to their numerous applications in the entertainment, gaming, and electromedical industries. In particular, the 3D television (3DTV) and free-viewpoint television (FTV) enhance viewers’ television experience by providing immersion. They need an infinite number of views to provide a full parallax to the viewer, which is not practical due to various financial and technological constraints. Therefore, novel 3D views are generated from a set of available views and their depth maps using depth-image-based rendering (DIBR) techniques. The quality of a DIBR-synthesized image may be compromised for several reasons, e.g., inaccurate depth estimation. Since depth is important in this application, inaccuracies in depth maps lead to different textural and structural distortions that degrade the quality of the generated image and result in a poor quality of experience (QoE). Therefore, quality assessment DIBR-generated images are essential to guarantee an appreciative QoE. This paper aims at estimating the quality of DIBR-synthesized images and proposes a novel 3D objective image quality metric. The proposed algorithm aims to measure both textural and structural distortions in the DIBR image by exploiting the contrast sensitivity and the Hausdorff distance, respectively. The two measures are combined to estimate an overall quality score. The experimental evaluations performed on the benchmark MCL-3D dataset show that the proposed metric is reliable and accurate, and performs better than existing 2D and 3D quality assessment metrics.


2021 ◽  
Vol 309 ◽  
pp. 01069
Author(s):  
K. Swaraja ◽  
V. Akshitha ◽  
K. Pranav ◽  
B. Vyshnavi ◽  
V. Sai Akhil ◽  
...  

Depth estimation is a computer vision technique that is critical for autonomous schemes for sensing their surroundings and predict their own condition. Traditional estimating approaches, such as structure from motion besides stereo vision similarity, rely on feature communications from several views to provide depth information. In the meantime, the depth maps anticipated are scarce. Gathering depth information via monocular depth estimation is an ill-posed issue, according to a substantial corpus of deep learning approaches recently suggested. Estimation of Monocular depth with deep learning has gotten a lot of interest in current years, thanks to the fast expansion of deep neural networks, and numerous strategies have been developed to solve this issue. In this study, we want to give a comprehensive assessment of the methodologies often used in the estimation of monocular depth. The purpose of this study is to look at recent advances in deep learning-based estimation of monocular depth. To begin, we'll go through the various depth estimation techniques and datasets for monocular depth estimation. A complete overview of multiple deep learning methods that use transfer learning Network designs, including several combinations of encoders and decoders, is offered. In addition, multiple deep learning-based monocular depth estimation approaches and models are classified. Finally, the use of transfer learning approaches to monocular depth estimation is illustrated.


2020 ◽  
Vol 12 (1) ◽  
pp. 84-94
Author(s):  
Pedro Oliveira Raimundo ◽  
Karl Philips Apaza-Agüero

Poor data acquisition from low-cost cameras, such as low-resolution depth maps or high level of noise or point clouds generated with insufficient information from an object, limits the use of such cameras for heritage artifacts 3D reconstruction. This work proposes to improve this depth low-cost acquisition by using a new approach based on the Super-Resolution technique. The proposed approach has been applied to several artifacts of the Federal University of Bahia Museum of Archaeology and Ethnology (MAE/UFBA). As shown in the results, our approach improved the quality of point clouds generated from tested heritage artifacts. Results indicate that whenever artifact geometry is gained via our method there is actual reconstruction of detail or accuracy improvements, whereas a reduction in number of points of the clouds, if any, would indicate the removal of inconsistencies or noise from the input data without loss of detail.


2018 ◽  
Vol 15 (1) ◽  
pp. 172988141774844 ◽  
Author(s):  
Mandan Zhao ◽  
Gaochang Wu ◽  
Yebin Liu ◽  
Xiangyang Hao

With the development of consumer light field cameras, the light field imaging has become an extensively used method for capturing the three-dimensional appearance of a scene. The depth estimation often requires a dense sampled light field in the angular domain or a high resolution in the spatial domain. However, there is an inherent trade-off between the angular and spatial resolutions of the light field. Recently, some studies for super-resolving the trade-off light field have been introduced. Rather than the conventional approaches that optimize the depth maps, these approaches focus on maximizing the quality of the super-resolved light field. In this article, we investigate how the depth estimation can benefit from these super-resolution methods. Specifically, we compare the qualities of the estimated depth using (a) the original sparse sampled light fields and the reconstructed dense sampled light fields, and (b) the original low-resolution light fields and the high-resolution light fields. Experiment results evaluate the enhanced depth maps using different super-resolution approaches.


2014 ◽  
Vol 2014 ◽  
pp. 1-10 ◽  
Author(s):  
Zhiwei Tang ◽  
Bin Li ◽  
Huosheng Li ◽  
Zheng Xu

Depth estimation becomes the key technology to resolve the communications of the stereo vision. We can get the real-time depth map based on hardware, which cannot implement complicated algorithm as software, because there are some restrictions in the hardware structure. Eventually, some wrong stereo matching will inevitably exist in the process of depth estimation by hardware, such as FPGA. In order to solve the problem a postprocessing function is designed in this paper. After matching cost unique test, the both left-right and right-left consistency check solutions are implemented, respectively; then, the cavities in depth maps can be filled by right depth values on the basis of right-left consistency check solution. The results in the experiments have shown that the depth map extraction and postprocessing function can be implemented in real time in the same system; what is more, the quality of the depth maps is satisfactory.


2019 ◽  
Vol 21 (2) ◽  
pp. 564-580
Author(s):  
Eloiza Rocha Queiroz ◽  
José Falcão Sobrinho

A região Nordeste do Brasil vem sendo alvo de medidas do Estado a mais de um século, na tentativa de solucionar o problema da falta de água em época de secas. O Estado do Ceará, por sua vez, apresenta boa parte de seu território inserido no semiárido brasileiro, uma região caracterizada pelo clima seco, com poucas chuvas e elevada evapotranspiração. A problemática da água existe há bastante tempo, principalmente o acesso em quantidade e qualidade suficientes para atender a população. O presente trabalho tem como tema central a questão dos recursos hídricos, com enfoque no abastecimento humano do município de Cariré, localizado na região noroeste do Ceará. Nosso objetivo consiste em apresentar um panorama de como atualmente a população carireense tem acesso à água potável. A metodologia adotada constitui-se em duas etapas: na primeira, realizamos levantamento de material bibliográfico e a segunda diz respeito a parte prática realizada em saídas a campo. Segundo a ONU, a água é um bem comum e que deve ser de acesso a todos, é um direito humano. Nesta perspectiva, o gerenciamento adequado dos recursos hídricos é essencial para a manutenção da qualidade de vida. Palavras-chave: Recursos Hídricos; Abastecimento Humano; Cariré-Ce. ABSTRACTThe pnortheast region from Brazil has been subject of measures for more than a century in attempts to solve the problems lack of water in dry season. The state of Ceará has a good part of its territorial inserted in Brazilian semiarid, a region characterized by dry climate, short rains and high evapotranspiration. The water issue has existed for a long time, mainly in a sufficient access of quantity and quality to serve the population. Then, this article has as a central theme the water resources focusing on water supply of the Cariré localized at Northeast region from Ceará. Therefore the purpose of the paper is to present a study about how the Carire’s population has had access to potable water currently. The methodology adopted to this research consists of two stages: Firstly it was carried out a survey of bibliographical material and secondly it concerned the practical part carried out in the field trips. In accordance to United nations, water is a commom good and it has to be available to everyone, it is a human rights. In that sense, the proper management of water resources is essential to keep the quality of life.Key-words: Human supply; Water resources; Cariré – Ce. RÉSUMÉLa région du nord-est du Brésil est la cible de mesures prises par l’État depuis plus d’un siècle pour tenter de résoudre le problème de la pénurie d’eau en saison sèche. L’État du Ceará, en revanche, présente une bonne partie de son territoire inséré dans le semi-aride brésilien, région caractérisée par un climat sec, avec peu de pluies et une forte évapotranspiration. Le problème de l'eau existe depuis longtemps, principalement l'accès en quantité et qualité suffisantes pour satisfaire la population. Le travail actuel a pour thème central la question des ressources en eau, en mettant l'accent sur l'approvisionnement humain de la municipalité de Cariré, située dans la région nord-ouest du Ceará. Notre objectif est de présenter un aperçu de la façon dont la population carioca a actuellement accès à l’eau potable. La méthodologie adoptée comporte deux étapes: dans le premier, nous procédons à une enquête sur le matériel bibliographique et le second à la partie pratique réalisée lors des visites sur le terrain. Selon l'ONU, l'eau est un bien commun et doit être accessible à tous, c'est un droit humain. Dans cette perspective, la gestion adéquate des ressources en eau est essentielle au maintien de la qualité de la vie.Mots-clés: Ressources en eau; Approvisionnement humain; Cariré-Ce.


2019 ◽  
Vol 4 (2) ◽  
pp. 282
Author(s):  
Isti Harkomah

<p><em>Clients with hallucinations really need continuous family support both internal and external families. Reduced external family support will cause a heavy burden on the internal family in caring for hallucinatory clients. The reason families bring to the hospital is the inability to treat patient hallucinations at home after hospitalization because hallucinations pose a burden on the family. The purpose of this study was to find out in-depth information about family experience in treating schizophrenic patients who experience auditory hallucinations after hospitalization. This research is qualitative research, the phenomenology approach uses the method of collecting data by in-depth interviews and document review. Data were obtained by in-depth interviews with six participants. The results of the study are two main themes, namely family understanding of recognizing hallucinatory problems after hospitalization and family experience in treating schizophrenic patients with hallucinatory problems.It is hoped that health services will further improve the quality of health services in providing health education to families about how to properly care for hallucinatory patients and families are expected to be able to treat hallucinogenic patients well.</em></p><p><em><br /></em></p><p><em><em>Klien dengan halusinasi sangat membutuhkan dukungan dari keluarga secara terus menerus baik keluarga internal maupun eksternal. Berkurangnya dukungan keluarga eksternal akan menimbulkan beban yang berat bagi keluarga internal dalam merawat klien halusinasi. Alasan keluarga membawa ke RSJ adalah ketidakmampuan merawat halusinasi pasien dirumah pasca rawat inap karena halusinasi menimbulkan beban bagi keluarga. Tujuan penelitian ini adalah untuk mengetahui informasi mendalam tentang pengalaman keluarga dalam merawat pasien skizofrenia yang mengalami masalah halusinasi pendengaran pasca hospitalisasi. Penelitian ini merupahkan penelitian kualitatif, pendekatan fenomenologi menggunakan metode pengumpulan data dengan wawancara mendalam dan telaah dokumen. Data didapatkan dengan wawancara mendalam terhadap enam partisipan. Hasil wawancara dianalisis dengan menggunakan metode Collaizi. Hasil penelitian yaitu terdapat 2 utama tema yaitu pemahaman keluarga tentang mengenal masalah halusinasi pasca hospitalisasi dan pengalaman keluarga dalam merawat pasien skizofrenia dengan masalah halusinasi.Diharapkan bagi pelayanan kesehatan agar lebih meningkatkan mutu pelayanan kesehatan dalam memberikan pendidikan kesehatan kepada keluarga tentang cara merawat pasien halusinasi yang benar dan keluarga diharapkan dapat merawat pasien halusinasi dengan baik.</em></em></p>


Sign in / Sign up

Export Citation Format

Share Document