• Title/Summary/Keyword: 2D depth map

Search Result 171, Processing Time 0.024 seconds

Stereoscopic Image Conversion Algorithm using Object Segmentation and Motion Parallax (객체 분할과 운동 시차를 이용한 입체 영상 변환 알고리즘)

  • Jung, Jae-Sung;Cho, Hwa-Hyun;Yoon, Jong-Ho;Choi, Myung-Ryul
    • Proceedings of the IEEK Conference
    • /
    • 2005.11a
    • /
    • pp.1129-1132
    • /
    • 2005
  • In this paper, we proposed real-time stereoscopic image conversion algorithm using object segmentation and motion parallax. The proposed algorithm separates objects using luminance of image, extracts moving object among objects of the image using motion parallax and generates depth map. Parallax process is done based on the depth map. The proposed method has been evaluated using visual test and APD(Absolute Parallx Difference) for comparing the stereoscopic image of the proposed method with that of MTD. The proposed method offers realistic stereoscopic conversion effect regardless of the direction and velocity of the 2-D image.

  • PDF

Adaptive Spatial Coordinates Detection Scheme for Path-Planning of Autonomous Mobile Robot (자율 이동로봇의 경로추정을 위한 적응적 공간좌표 검출 기법)

  • Lee, Jung-Suk;Ko, Jung-Hwan
    • The Transactions of the Korean Institute of Electrical Engineers P
    • /
    • v.55 no.2
    • /
    • pp.103-109
    • /
    • 2006
  • In this paper, the detection scheme of the spatial coordinates based on stereo camera for a intelligent path planning of an automatic mobile robot is proposed. In the proposed system, face area of a moving person is detected from a left image among the stereo image pairs by using the YCbCr color model and its center coordinates are computed by using the centroid method and then using these data, the stereo camera embedded on the mobile robot can be controlled for tracking the moving target in real-time. Moreover, using the disparity mad obtained from the left and right images captured by the tracking-controlled stereo camera system and the perspective transformation between a 3-D scene. and an image plane, depth information can be detected. Finally, based-on the analysis of these calculated coordinates, a mobile robot system is derived as a intelligent path planning and a estimation.

A Real-Time Stereoscopic Image Conversion Method Based on A Single Frame (단일 프레임 기반의 실시간 입체 영상 변환 방법)

  • Jung Jae-Sung;Cho Hwa-Hyun;Choi Myung-Ryul
    • Journal of the Institute of Electronics Engineers of Korea CI
    • /
    • v.43 no.1 s.307
    • /
    • pp.45-52
    • /
    • 2006
  • In this paper, a real-time stereoscopic image conversion method using a single frame from a 2-D image is proposed. The Stereoscopic image is generated by creating depth map using vortical position information and parallax processing. For a real-time processing of stereoscopic conversion and reduction of hardware complexity, it uses image sampling, object segmentation by standardizing luminance and depth map generation by boundary scan. The proposed method offers realistic 3-D effect regardless of the direction, velocity and scene conversion of the 2-D image. It offers effective stereoscopic conversion using images suitable conditions assumed in this paper such as recorded image at long distance, landscape and panorama photo because it creates different depth sense using vertical position information from a single frame. The proposed method can be applied to still image because it uses a single frame from a 2-D image. The proposed method has been evaluated using visual test and APD for comparing the stereoscopic image of the proposed method with that of MTD. It is confirmed that stereoscopic images conversed by the proposed method offers 3-D effect regardless of the direction and velocity of the 2-D image.

Fusion System of Time-of-Flight Sensor and Stereo Cameras Considering Single Photon Avalanche Diode and Convolutional Neural Network (SPAD과 CNN의 특성을 반영한 ToF 센서와 스테레오 카메라 융합 시스템)

  • Kim, Dong Yeop;Lee, Jae Min;Jun, Sewoong
    • The Journal of Korea Robotics Society
    • /
    • v.13 no.4
    • /
    • pp.230-236
    • /
    • 2018
  • 3D depth perception has played an important role in robotics, and many sensory methods have also proposed for it. As a photodetector for 3D sensing, single photon avalanche diode (SPAD) is suggested due to sensitivity and accuracy. We have researched for applying a SPAD chip in our fusion system of time-of-fight (ToF) sensor and stereo camera. Our goal is to upsample of SPAD resolution using RGB stereo camera. Currently, we have 64 x 32 resolution SPAD ToF Sensor, even though there are higher resolution depth sensors such as Kinect V2 and Cube-Eye. This may be a weak point of our system, however we exploit this gap using a transition of idea. A convolution neural network (CNN) is designed to upsample our low resolution depth map using the data of the higher resolution depth as label data. Then, the upsampled depth data using CNN and stereo camera depth data are fused using semi-global matching (SGM) algorithm. We proposed simplified fusion method created for the embedded system.

Human Action Recognition Using Deep Data: A Fine-Grained Study

  • Rao, D. Surendra;Potturu, Sudharsana Rao;Bhagyaraju, V
    • International Journal of Computer Science & Network Security
    • /
    • v.22 no.6
    • /
    • pp.97-108
    • /
    • 2022
  • The video-assisted human action recognition [1] field is one of the most active ones in computer vision research. Since the depth data [2] obtained by Kinect cameras has more benefits than traditional RGB data, research on human action detection has recently increased because of the Kinect camera. We conducted a systematic study of strategies for recognizing human activity based on deep data in this article. All methods are grouped into deep map tactics and skeleton tactics. A comparison of some of the more traditional strategies is also covered. We then examined the specifics of different depth behavior databases and provided a straightforward distinction between them. We address the advantages and disadvantages of depth and skeleton-based techniques in this discussion.

Transformation of Stereoscopic Images for 3D Perception Improvement (입체영상의 3D 증강을 위한 입체영상 변환)

  • Gil, Jong In;Choi, Hwang Kyu;Kim, Manbae
    • Journal of Broadcast Engineering
    • /
    • v.17 no.6
    • /
    • pp.911-923
    • /
    • 2012
  • Recently, 3DTV and 3D displays have been released in the market. Accordingly, the production of stereoscopic images has gained much interest. Stereoscopic image being composed of left and right images are currently delivered to viewers without any modifications. The researches on the enhancement of depth perception using high-frequency components and the re-production of natural color by color compensation have been carried out for 2D images. The application of such 2D technologies to 3D stereoscopic images is an aim of this paper. This paper proposes the enhancement of 3D perception by color transformation. For this, we propose a stereo matching method for obtaining a depth map and two color transformation methods such as contrast transformation and background darkening. The effectiveness of the proposed method was verified through experiments.

Flood risk estimation with scenario-based, coupled river-overland hydrodynamic modeling (시나리오 기반 하천-제내지 연계 통합수리해석에 의한 홍수위험도 산정)

  • Lee, Jae Young;Nam, Myeong Jun;Kwon, Hyun Han;Kim, Ki Young
    • Journal of Korea Water Resources Association
    • /
    • v.49 no.9
    • /
    • pp.773-787
    • /
    • 2016
  • A coupled river-overland hydrodynamic model was applied to estimate flood risk by a scenario-based approach. The study area is Seongseo Industrial Complex in Daegu which is located near Nakdong river and Geumho river. Inundation depth and velocity at each time were calculated by applying a coupled 1D/2D hydrodynamic model to the target area of interest. The 2D inundation analysis for river and overland domain was performed with the scenario-based approach that there are levee overflow against 100/200 year high quantile (97.5%) design flood and levee break against 100/200 year normal quantile (50%) design flood. The level of flood risk was displayed for resident/industrial area using information about maximum depth and velocity of each node computed from the 2D inundation map. The research outcome would be very useful in establishing specified emergency action plans (EAP) in case of levee break and overflowing resulting from a flood.

3D Shape Recovery Using Image Focus through Nonlinear Total Variation (비선형 전변동을 이용한 초점거리 변화 기반의 3 차원 깊이 측정 방법)

  • Mahmood, Muhammad Tariq;Choi, Young Kyu
    • Journal of the Semiconductor & Display Technology
    • /
    • v.12 no.2
    • /
    • pp.27-32
    • /
    • 2013
  • Shape From Focus (SFF) is a passive optical technique to recover 3D structure of an object that utilizes focus information from 2D images of the object taken at different focus levels. Mostly, SFF methods use a single focus measure to compute image focus quality of each pixel in the image sequence. However, it is difficult to recover accurate 3D shape using a single focus measure, as different focus measures perform differently in diverse conditions. In this paper, a nonlinear Total Variation (TV) based approach is proposed for 3D shape recovery. To improve the result of surface reconstruction, several initial depth maps are obtained using different focus measures and the resultant 3D shape is obtained by diffusing them through TV. The proposed method is tested and evaluated by using image sequences of synthetic and real objects. The results and comparative analysis demonstrate the effectiveness of our method.

A Real-Time Stereoscopic Image Conversion Method Using Motion Parallax (운동 시차를 이용한 실시간 입체 영상 변환 방법)

  • Choi, Chul-Ho;Kwon, Byong-Heon;Choi, Myung-Ryul
    • The KIPS Transactions:PartB
    • /
    • v.10B no.4
    • /
    • pp.359-366
    • /
    • 2003
  • We propose a real-time stereoscopic image conversion method that can generate stereoscopic image with different perspective depth using motion parallax from 2-D image and offer realistic 3-D effect regardless of the direction and velocity of the moving object in the 2-D image. The stereoscopic image is generated by computing the motion parallax between adjacent two 2-D images using the proposed method for motion detection, region segmentation and depth map generation. The proposed method is suitable for real-time stereoscopic conversion processing on various image formats. It has been verified the proposed method by comparing between the stereoscopic image of the proposed method and that of MTD.

Implementation of an intelligent vision system for an adaptive path-planning of industrial AGV system (산업용 AGV 시스템의 적응적 경로설정을 위한 지능형 시각 시스템의 구현)

  • Ko, Jung-Hwan
    • 전자공학회논문지 IE
    • /
    • v.46 no.1
    • /
    • pp.23-30
    • /
    • 2009
  • In this paper, the intelligent vision system for an effective and intelligent path-planning of an industrial AGV system based on stereo camera system is proposed. The depth information and disparity map are detected in the inputting images of a parallel stereo camera. The distance between the industrial AGV system and the obstacle detected and the 2D Path coordinates obtained from the location coordinates, and then the relative distance between the obstacle and the other objects obtained from them. The industrial AGV system move automatically by effective and intelligent path-planning using the obtained 2D path coordinates. From some experiments on AGV system driving with the stereo images, it is analyzed that error ratio between the calculated and measured values of the distance between the objects is found to be very low value of 2.5% on average, respectably.