• Title/Summary/Keyword: Visual depth

Search Result 590, Processing Time 0.022 seconds

Three-Dimensional Visualization Technique of Occluded Objects Using Integral Imaging with Plenoptic Camera

  • Lee, Min-Chul;Inoue, Kotaro;Tashiro, Masaharu;Cho, Myungjin
    • Journal of information and communication convergence engineering
    • /
    • v.15 no.3
    • /
    • pp.193-198
    • /
    • 2017
  • In this study, we propose a three-dimensional (3D) visualization technique of occluded objects using integral imaging with a plenoptic camera. In previous studies, depth map estimation from elemental images was used to remove occlusion. However, the resolution of these depth maps is low. Thus, the occlusion removal accuracy is not efficient. Therefore, we use a plenoptic camera to obtain a high-resolution depth map. Hence, individual depth map for each elemental image can also be generated. Finally, we can regenerate a more accurate depth map for 3D objects with these separate depth maps, allowing us to remove the occlusion layers more efficiently. We perform optical experiments to prove our proposed technique. Moreover, we use MSE and PSNR as a performance metric to evaluate the quality of the reconstructed image. In conclusion, we enhance the visual quality of the reconstructed image after removing the occlusion layers using the plenoptic camera.

Iterative Deep Convolutional Grid Warping Network for Joint Depth Upsampling (반복적인 격자 워핑 기법을 이용한 깊이 영상 초해상도 기술)

  • Yang, Yoonmo;Kim, Dongsin;Oh, Byung Tae
    • Proceedings of the Korean Society of Broadcast Engineers Conference
    • /
    • 2020.11a
    • /
    • pp.205-207
    • /
    • 2020
  • This paper proposes a novel deep learning-based method to upsample a depth map. Most conventional methods estimate high-resolution depth map by modifying pixel value of given depth map using high-resolution color image and low-resolution depth map. However, these methods cause under- or over-shooting problems that restrict performance improvement. To overcome these problems, the proposed method iteratively performs grid warping scheme which shifts pixel values to restore blurred image for estimating high-resolution depth map. Experimental results show that the proposed method improves both quantitative and visual quality compared to the existing method.

  • PDF

Deep Learning-based Depth Map Estimation: A Review

  • Abdullah, Jan;Safran, Khan;Suyoung, Seo
    • Korean Journal of Remote Sensing
    • /
    • v.39 no.1
    • /
    • pp.1-21
    • /
    • 2023
  • In this technically advanced era, we are surrounded by smartphones, computers, and cameras, which help us to store visual information in 2D image planes. However, such images lack 3D spatial information about the scene, which is very useful for scientists, surveyors, engineers, and even robots. To tackle such problems, depth maps are generated for respective image planes. Depth maps or depth images are single image metric which carries the information in three-dimensional axes, i.e., xyz coordinates, where z is the object's distance from camera axes. For many applications, including augmented reality, object tracking, segmentation, scene reconstruction, distance measurement, autonomous navigation, and autonomous driving, depth estimation is a fundamental task. Much of the work has been done to calculate depth maps. We reviewed the status of depth map estimation using different techniques from several papers, study areas, and models applied over the last 20 years. We surveyed different depth-mapping techniques based on traditional ways and newly developed deep-learning methods. The primary purpose of this study is to present a detailed review of the state-of-the-art traditional depth mapping techniques and recent deep learning methodologies. This study encompasses the critical points of each method from different perspectives, like datasets, procedures performed, types of algorithms, loss functions, and well-known evaluation metrics. Similarly, this paper also discusses the subdomains in each method, like supervised, unsupervised, and semi-supervised methods. We also elaborate on the challenges of different methods. At the conclusion of this study, we discussed new ideas for future research and studies in depth map research.

Analysis of Relationship between Objective Performance Measurement and 3D Visual Discomfort in Depth Map Upsampling (깊이맵 업샘플링 방법의 객관적 성능 측정과 3D 시각적 피로도의 관계 분석)

  • Gil, Jong In;Mahmoudpour, Saeed;Kim, Manbae
    • Journal of Broadcast Engineering
    • /
    • v.19 no.1
    • /
    • pp.31-43
    • /
    • 2014
  • A depth map is an important component for stereoscopic image generation. Since the depth map acquired from a depth camera has a low resolution, upsamling a low-resolution depth map to a high-resolution one has been studied past decades. Upsampling methods are evaluated by objective evaluation tools such as PSNR, Sharpness Degree, Blur Metric. As well, the subjective quality is compared using virtual views generated by DIBR (depth image based rendering). However, works on the analysis of the relation between depth map upsampling and stereoscopic images are relatively few. In this paper, we investigate the relationship between subjective evaluation of stereoscopic images and objective performance of upsampling methods using cross correlation and linear regression. Experimental results demonstrate that the correlation of edge PSNR and visual fatigue is the highest and the blur metric has lowest correlation. Further, from the linear regression, we found relative weights of objective measurements. Further we introduce a formulae that can estimate 3D performance of conventional or new upsampling methods.

Resolution-enhanced Reconstruction of 3D Object Using Depth-reversed Elemental Images for Partially Occluded Object Recognitionz

  • Wei, Tan-Chun;Shin, Dong-Hak;Lee, Byung-Gook
    • Journal of the Optical Society of Korea
    • /
    • v.13 no.1
    • /
    • pp.139-145
    • /
    • 2009
  • Computational integral imaging (CII) is a new method for 3D imaging and visualization. However, it suffers from seriously poor image quality of the reconstructed image as the reconstructed image plane increases. In this paper, to overcome this problem, we propose a CII method based on a smart pixel mapping (SPM) technique for partially occluded 3D object recognition, in which the object to be recognized is located at far distance from the lenslet array. In the SPM-based CII, the use of SPM moves a far 3D object toward the near lenslet array and then improves the image quality of the reconstructed image. To show the usefulness of the proposed method, we carry out some experiments for occluded objects and present the experimental results.

Schentific analysis and interpretation of visual structure of feng-shui : Case study of Hahoi and Yangdong villages (풍수지리의 시각적 구조의 과학적 분석파 해석 -하회, 양동 마을의 사례 연구-)

  • 현중영;박찬용
    • Journal of the Korean Institute of Landscape Architecture
    • /
    • v.25 no.1
    • /
    • pp.124-134
    • /
    • 1997
  • The primary purpose of this research is to scientifically investigate visual structure of Korean feng-shui at the level of village settlement. This study deals with Hahoi and Yangdong villages of which feng-shui is regarded highly fit to traditional feng-shui principles. Methodologically this research utilizes analytical tools of geographical information systems and statistical analysis methods, Visual structures of the villages'feng-shui are analyzed in terms of elevation, orientation, gradient of slope and relative dominance of visibility of major hills. A mathematical model is suggested to quantify facets of the villages'lung-shui with reference to slope trends. The quantitative analysis results indicate that both villages have good feng-shui. Hahoi village has an excellent feng-shui attributable to a near perfect harmony between water and terrain while Yangdong village has an effective feng-shui facet for conserving energy in terms of microclimate. Principles of fang-shui have potentials to be developed as a holistic planning and design language. Further in-depth research on feng-shui needed to accomplish this goal.

  • PDF

A Study on the Effect of Disparity-based Asymmetrical Filtering on the Binocular Stereoscopic Video (양안식 스테레오 비디오에 대한 변이 기반 비대칭 필터링의 효과에 관한 연구)

  • 엄기문;강훈종;윤국진;안충현;이수인
    • Journal of Broadcast Engineering
    • /
    • v.9 no.2
    • /
    • pp.131-141
    • /
    • 2004
  • Current binocular stereoscopic displays cause visual discomfort when objects with large disparities are present in the scene. One solution for improving visual comfort is synthetic depth-of-field processing, which simulates the characteristics of a human visual system. With this technique, visual comfort is improved by blurring portions of the background and/or foreground in the scene. However, this technique has the drawback of degrading overall image quality because the blurring is typically applied to both left and right images. To alleviate the visual discomfort, we propose a novel disparity-based asymmetrical filtering technique. Proposed technique applies the filtering to the image of one eye only, and controls the blur level according to the disparity information between stereoscopic images. We investigate the effects of this technique on stereoscopic video by measuring visual comfort and apparent sharpness. Our results indicate that disparity-based asymmetrical filtering can improve visual comfort of stereoscopic video while it maintains apparent sharpness if unfixated regions with large disparities are blurred under the appropriate filtering condition.

Effects of Real-time Visual Feedback Gait Training on Gait Stability in Older Adults (실시간 시각적 피드백 보행 훈련이 노인들의 보행 안정성에 미치는 영향)

  • Byun, Kyungseok;Han, Sooji;Bhang, Dawon;Seo, Hyundam;Lee, Hyo Keun
    • Korean Journal of Applied Biomechanics
    • /
    • v.30 no.3
    • /
    • pp.247-253
    • /
    • 2020
  • Objective: This study aimed to examine the effects of real-time visual feedback gait training on gait stability in older adults. Method: Twelve older adults participated in this study, being divided into 2 groups including a) visual feedback (VF) and b) non-visual feedback (NVF) groups. For 4 weeks, VF performed a treadmill walking training with real-time visual feedback about their postural information while NVF performed a normal treadmill walking training. For evaluations of gait stability, kinematic data of 15-minute treadmill walking were collected from depth-based motion capture system (30 Hz, exbody, Korea). Given that step lengths in both right and left sides were determined based on kinematic data, three variables including step difference, coefficient of variation, approximate entropy were calculated to evaluate gait symmetry, variability and complexity, respectively. Results: For research findings, VF exhibited significant improvements in gait stability after 4-week training in comparison to NVF, particularly in gait symmetry and complexity measures. However, greater improvement in gait variability was observed in NVF than VF. Conclusion: Given that visual feedback walking gives potential effectiveness on gait stability in older adults, gait training with visual feedback may be a robust therapeutic intervention in people with gait disturbances like instability or falls.

Effects of the Convergence Training on Reduction of Visual Discomfort in 3D TV Environment (3D TV 시청 환경에서 수렴 훈련에 의한 시각적 불편감의 감소)

  • Kham, Keetaek;Jeon, Hyunmin
    • Journal of Broadcast Engineering
    • /
    • v.18 no.5
    • /
    • pp.738-748
    • /
    • 2013
  • The present study investigated whether convergence training in which has an effect on reducing visual discomfort in viewing 3D TV. The stereoscopic depth of 3D training stimulus was gradually increased while maintaining individual visual discomfort at a minimum value. Participants were randomly assigned into one of three groups: a control group and two training groups. For both training groups, all procedure and the disparity range of training stimuli were the same except the order of the disparities of training stimuli. One of the two different training procedure was provided: gradual change or random change of the disparities of training stimulus. Training itself was very effective so that convergence fusional range was improved after three sessions of training with intervals of two weeks. In order to evaluate the effect of convergence training on visual discomfort, the subjective visual discomfort in 3D TV viewing was measured before and after training sessions using questionnaire. The results showed that a significant reduction in visual discomfort was found after training only in the group of gradual change. These results demonstrated a repeated convergence training might be helpful in reducing the visual discomfort in 3D TV environment.

A Study of the Visual Effects by Variations in the Location of the Waistline and the Width of the Round Belt of the Basic Pants (베이직 팬츠의 허리선 위치(位置)와 라운드 벨트 폭(幅)의 변화(變化)에 따른 시각적(視覺的) 효과(效果))

  • Kim, Ji-Young;Lee, Jung-Soon
    • Journal of Fashion Business
    • /
    • v.9 no.5
    • /
    • pp.37-50
    • /
    • 2005
  • The purpose of this study is to present basic data that can express beautiful silhouette by studying visual effect that depend on waist position of basic pants and the change of round belt width and analyzing the study of visual effect of the pattern design as well as the effect of design component. The stimuli are 21 samples: 7 variations of the location of the waistline and 3 variations of the width of the belt. The data has been obtained from 35 fashion design majors. The data has analyzed by frequency, factor analysis, anova, scheffe's test and the MCA method. The visual effects by the location of waistline and the width of belt are composed of 3 factors : horizontal direction factor, vertical direction factor and flexuosity factor. In these factors, horizontal factor is estimated by most important factor. Visual effect is positive when belt width widens as the location of waist line goes down to position of low belt. And in case the location of waist line is in the position of natural waist belt and low rise belt, belt of 3.2cm width is effective visually. The interaction effects between the location of the waistline and the width of the belt have significant differences in all factors. Factor that appears in visual effect of basic pants can be evaluated differently according to pattern of pants and characteristic of body shape. So we may receive better visual assessment if we consider the location of waist belt and width of belt in side of visual effect and image, when we produce pants giving variety to crotch depth.