• Title/Summary/Keyword: Multi-view camera

Search Result 160, Processing Time 0.038 seconds

3D Reconstruction of an Indoor Scene Using Depth and Color Images (깊이 및 컬러 영상을 이용한 실내환경의 3D 복원)

  • Kim, Se-Hwan;Woo, Woon-Tack
    • Journal of the HCI Society of Korea
    • /
    • v.1 no.1
    • /
    • pp.53-61
    • /
    • 2006
  • In this paper, we propose a novel method for 3D reconstruction of an indoor scene using a multi-view camera. Until now, numerous disparity estimation algorithms have been developed with their own pros and cons. Thus, we may be given various sorts of depth images. In this paper, we deal with the generation of a 3D surface using several 3D point clouds acquired from a generic multi-view camera. Firstly, a 3D point cloud is estimated based on spatio-temporal property of several 3D point clouds. Secondly, the evaluated 3D point clouds, acquired from two viewpoints, are projected onto the same image plane to find correspondences, and registration is conducted through minimizing errors. Finally, a surface is created by fine-tuning 3D coordinates of point clouds, acquired from several viewpoints. The proposed method reduces the computational complexity by searching for corresponding points in 2D image plane, and is carried out effectively even if the precision of 3D point cloud is relatively low by exploiting the correlation with the neighborhood. Furthermore, it is possible to reconstruct an indoor environment by depth and color images on several position by using the multi-view camera. The reconstructed model can be adopted for interaction with as well as navigation in a virtual environment, and Mediated Reality (MR) applications.

  • PDF

High-resolution Depth Generation using Multi-view Camera and Time-of-Flight Depth Camera (다시점 카메라와 깊이 카메라를 이용한 고화질 깊이 맵 제작 기술)

  • Kang, Yun-Suk;Ho, Yo-Sung
    • Journal of the Institute of Electronics Engineers of Korea SP
    • /
    • v.48 no.6
    • /
    • pp.1-7
    • /
    • 2011
  • The depth camera measures range information of the scene in real time using Time-of-Flight (TOF) technology. Measured depth data is then regularized and provided as a depth image. This depth image is utilized with the stereo or multi-view image to generate high-resolution depth map of the scene. However, it is required to correct noise and distortion of TOF depth image due to the technical limitation of the TOF depth camera. The corrected depth image is combined with the color image in various methods, and then we obtain the high-resolution depth of the scene. In this paper, we introduce the principal and various techniques of sensor fusion for high-quality depth generation that uses multiple camera with depth cameras.

Multi-tracer Imaging of a Compton Camera (다중 추적자 영상을 위한 컴프턴 카메라)

  • Kim, Soo Mee
    • Progress in Medical Physics
    • /
    • v.26 no.1
    • /
    • pp.18-27
    • /
    • 2015
  • Since a Compton camera has high detection sensitivity due to electronic collimation and a good energy resolution, it is a potential imaging system for nuclear medicine. In this study, we investigated the feasibility of a Compton camera for multi-tracer imaging and proposed a rotating Compton camera to satisfy Orlov's condition for 3D imaging. Two software phantoms of 140 and 511 keV radiation sources were used for Monte-Carlo simulation and then the simulation data were reconstructed by listmode ordered subset expectation maximization to evaluate the capability of multi-tracer imaging in a Compton camera. And the Compton camera rotating around the object was proposed and tested with different rotation angle steps for improving the limited coverage of the fixed conventional Compton camera over the field-of-view in terms of histogram of angles in spherical coordinates. The simulation data showed the separate 140 and 511 keV images from simultaneous multi-tracer detection in both 2D and 3D imaging and the number of valid projection lines on the conical surfaces was inversely proportional to the decrease of rotation angle. Considering computation load and proper number of projection lines on the conical surface, the rotation angle of 30 degree was sufficient for 3D imaging of the Compton camera in terms of 26 min of computation time and 5 million of detected event number and the increased detection time can be solved with multiple Compton camera system. The Compton camera proposed in this study can be effective system for multi-tracer imaging and is a potential system for development of various disease diagnosis and therapy approaches.

Improved Polynomial Model for Multi-View Image Color Correction (다시점 영상 색상 보정을 위한 개선된 다항식 모델)

  • Jung, Jae-Il;Ho, Yo-Sung
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.38C no.10
    • /
    • pp.881-886
    • /
    • 2013
  • Even though a multi-view camera system is able to capture multiple images at different viewpoints, the color distributions of captured multi-view images can be inconsistent. This problem decreases the quality of multi-view images and the performance of post-image processes. In this paper, we propose an improved polynomial model for effectively correcting the color inconsistency problem. This algorithm is fully automatic without any pre-process and considers occlusion regions of the multi-view image. We use the 5th order polynomial model to define a relative mapping curve between reference and source views. Sometimes the estimated curve is seriously distorted if the dynamic range of extracted correspondences is quite low. Therefore we additionally estimate the first order polynomial model for the bottom and top regions of the dynamic range. Afterwards, colors of the source view are modified via these models. The proposed algorithm shows the good subjective results and has better objective quality than the conventional color correction algorithms.

Development of a Reliable Real-time 3D Reconstruction System for Tiny Defects on Steel Surfaces (금속 표면 미세 결함에 대한 신뢰성 있는 실시간 3차원 형상 추출 시스템 개발)

  • Jang, Yu Jin;Lee, Joo Seob
    • Journal of Institute of Control, Robotics and Systems
    • /
    • v.19 no.12
    • /
    • pp.1061-1066
    • /
    • 2013
  • In the steel industry, the detection of tiny defects including its 3D characteristics on steel surfaces is very important from the point of view of quality control. A multi-spectral photometric stereo method is an attractive scheme because the shape of the defect can be obtained based on the images which are acquired at the same time by using a multi-channel camera. Moreover, the calculation time required for this scheme can be greatly reduced for real-time application with the aid of a GPU (Graphic Processing Unit). Although a more reliable shape reconstruction of defects can be possible when the numbers of available images are increased, it is not an easy task to construct a camera system which has more than 3 channels in the visible light range. In this paper, a new 6-channel camera system, which can distinguish the vertical/horizontal linearly polarized lights of RGB light sources, was developed by adopting two 3-CCD cameras and two polarized lenses based on the fact that the polarized light is preserved on the steel surface. The photometric stereo scheme with 6 images was accelerated by using a GPU, and the performance of the proposed system was validated through experiments.

Real-time Tracking and Identification for Multi-Camera Surveillance System

  • Hong, Yo-Hoon;Song, Seung June;Rho, Jungkyu
    • International Journal of Internet, Broadcasting and Communication
    • /
    • v.10 no.1
    • /
    • pp.16-22
    • /
    • 2018
  • This paper presents a solution for personal profiling system based on user-oriented tracking. Here, we introduce a new way to identify and track humans by using two types of cameras: dome and face camera. Dome camera has a wide view angle so that it is suitable for tracking human movement in large area. However, it is difficult to identify a person only by using dome camera because it only sees the target from above. Thus, face camera is employed to obtain facial information for identifying a person. In addition, we also propose a new mechanism to locate human on targeted location by using grid-cell system. These result in a system which has the capability of maintaining human identity and tracking human activity (movement) effectively.

Displacement Measurement of Structure using Multi-View Camera & Photogrammetry (사진측량법과 다시점 카메라를 이용한 구조물의 변위계측)

  • Yeo, Jeong-Hyeon;Yoon, In-Mo;Jeong, Young-Kee
    • Proceedings of the Korean Institute of Information and Commucation Sciences Conference
    • /
    • v.9 no.1
    • /
    • pp.1141-1144
    • /
    • 2005
  • In this paper, we propose an automatic displacement system for testing stability of structure. Photogrammetry is a method which can measure accurate 3D data from 2D images taken from different locations and which is suitable for analyzing and measuring the displacement of structure. This paper consists of camera calibration, feature extraction using coded target & retro-reflective circle, 3D reconstruction and analyzing accuracy. Multi-view camera which is used for measuring displacement of structure is placed with different location respectively. Camera calibration calculates trifocal tensor from corresponding points in images, from which Euclidean camera is calculated. Especially, in a step of feature extraction, we utilize sub-pixel method and pattern recognition in order to measure the accurate 3D locations. Scale bar is used as reference to measure. the accurate value of world coordinate..

  • PDF

Pre-processing of Depth map for Multi-view Stereo Image Synthesis (다시점 영상 합성을 위한 깊이 정보의 전처리)

  • Seo Kwang-Wug;Han Chung-Shin;Yoo Ji-Sang
    • Journal of Broadcast Engineering
    • /
    • v.11 no.1 s.30
    • /
    • pp.91-99
    • /
    • 2006
  • Pre-processing is one of image processing techniques to enhance image quality or appropriately convert a given image into another form for a specific purpose. An 8 bit depth map obtained by a depth camera usually contains a lot of noisy components caused by the characteristics of depth camera and edges are also more distorted by the quality of a source object and illumination condition comparing with edges in RGB texture image. To reduce this distortion, we use noise removing filters, but they are only able to reduce noise components, so that distorted edges of depth map can not be properly recovered. In this paper, we propose an algorithm that can reduce noise components and also enhance the quality of edges of depth map by using edges in RGB texture. Consequently, we can reduce errors in multi-view stereo image synthesis process.

VHOE-based Multi-view Stereoscopic 3D Display System (VHOE광학판을 이용한 다시점 스테레오 입체영상 디스플레이 시스템)

  • Cho, Byung-Chul;Koo, Jung-Sik;Kim, Seung-Cheol;Kim, Eun-Soo
    • Proceedings of the Korean Institute of Electrical and Electronic Material Engineers Conference
    • /
    • 2002.04b
    • /
    • pp.42-44
    • /
    • 2002
  • The experimental model of the 8-view stereoscopic display system using the photopolymer-based VHOE is proposed. At first, the VHOE is implemented by angle-multiplexed recording of 8-view's diffraction gratings using the optimized exposure-time scheduling scheme in the photopolymer (HRF-150-100) and then. the VHOE-based 8-view stereoscopic display system is implemented by sequentially synchronizing the incident angles of the reference beam of the VHOE with the 8-view stereo images on the LCD pannel. Accordingly, from some experimental results using 8-view images generated by the toed-in stereo camera system, it is found that 8-view stereo images can be diffracted to eight different directions time-sequentially and there is some disparity between the stereo images.

  • PDF

Illumination Mismatch Compensation Algorithm based on Layered Histogram Matching by Using Depth Information (깊이 정보에 따른 레이어별 히스토그램 매칭을 이용한 조명 불일치 보상 기법)

  • Lee, Dong-Seok;Yoo, Ji-Sang
    • The Journal of Korean Institute of Communications and Information Sciences
    • /
    • v.35 no.8C
    • /
    • pp.651-660
    • /
    • 2010
  • In this paper, we implement an efficient histogram-based prefiltering to compensate the illumination mismatches in regions between neighboring views. In multi-view video, such illumination disharmony can primarily occur on account of different camera location and orientation and an imperfect camera calibration. This discrepancy can cause the performance decrease of multi-view video coding(MVC) algorithm. A histogram matching algorithm can be exploited to make up for these differences in a prefiltering step. Once all camera frames of a multi-view sequence are adjusted to a predefined reference through the histogram matching, the coding efficiency of MVC is improved. However general frames of multi-view video sequence are composed of several regions with different color composition and their histogram distribution which are mutually independent of each other. In addition, the location and depth of these objects from sequeuces captured from different cameras can be different with different frames. Thus we propose a new algorithm which classify a image into several subpartitions by its depth information first and then histogram matching is performed for each region individually. Experimental results show that the compression ratio for the proposed algorithm is improved comparing with the conventional image-based algorithms.