• Title/Summary/Keyword: 3D image reconstruction

Search Result 591, Processing Time 0.039 seconds

3D Image Correlator using Computational Integral Imaging Reconstruction Based on Modified Convolution Property of Periodic Functions

  • Jang, Jae-Young;Shin, Donghak;Lee, Byung-Gook;Hong, Suk-Pyo;Kim, Eun-Soo
    • Journal of the Optical Society of Korea
    • /
    • v.18 no.4
    • /
    • pp.388-394
    • /
    • 2014
  • In this paper, we propose a three-dimensional (3D) image correlator by use of computational integral imaging reconstruction based on the modified convolution property of periodic functions (CPPF) for recognition of partially occluded objects. In the proposed correlator, elemental images of the reference and target objects are picked up by a lenslet array, and subsequently are transformed to a sub-image array which contains different perspectives according to the viewing direction. The modified version of the CPPF is applied to the sub-images. This enables us to produce the plane sub-image arrays without the magnification and superimposition processes used in the conventional methods. With the modified CPPF and the sub-image arrays, we reconstruct the reference and target plane sub-image arrays according to the reconstruction plane. 3D object recognition is performed through cross-correlations between the reference and the target plane sub-image arrays. To show the feasibility of the proposed method, some preliminary experiments on the target objects are carried out and the results are presented. Experimental results reveal that the use of plane sub-image arrays enables us to improve the correlation performance, compared to the conventional method using the computational integral imaging reconstruction algorithm.

Research on Reconstruction Technology of Biofilm Surface Based on Image Stacking

  • Zhao, Yuyang;Tao, Xueheng;Lee, Eung-Joo
    • Journal of Korea Multimedia Society
    • /
    • v.24 no.11
    • /
    • pp.1472-1480
    • /
    • 2021
  • Image stacking technique is one of the key techniques for complex surface reconstruction. The process includes sample collection, image processing, algorithm editing, surface reconstruction, and finally reaching reliable conclusions. Since this experiment is based on laser scanning confocal microscope to collect the original contour information of the sample, it is necessary to briefly introduce the relevant principle and operation method of laser scanning confocal microscope. After that, the original image is collected and processed, and the data is expanded by interpolation method. Meanwhile, several methods of surface reconstruction are listed. After comparing the advantages and disadvantages of each method, one-dimensional interpolation and volume rendering are finally used to reconstruct the 3D model. The experimental results show that the final 3d surface modeling is more consistent with the appearance information of the original samples. At the same time, the algorithm is simple and easy to understand, strong operability, and can meet the requirements of surface reconstruction of different types of samples.

Generation of 3 Dimensional Image Model from Multiple Digital Photographs (다중 디지털 사진을 이용한 3차원 이미지 모델 생성)

  • 정태은;석정민;신효철;류재평
    • Proceedings of the Korean Society of Precision Engineering Conference
    • /
    • 2003.06a
    • /
    • pp.1634-1637
    • /
    • 2003
  • Any given object on the motor-driven turntable is pictured from 8 to 72 different views with a digital camera. 3D shape reconstruction is performed with the integrated software called by Scanware from these multiple digital photographs. There are several steps such as configuration, calibration, capturing, segmentation, shape creation, texturing and merging process during the shape reconstruction process. 3D geometry data can be exported to cad data such as Autocad input file. Also 3D image model is generated from 3D geometry and texture data, and is used to advertise the model in the internet environment. Consumers can see the object realistically from wanted views by rotating or zooming in the internet browsers with Scanbull spx plug-in. The spx format allows a compact saving of 3D objects to handle or download. There are many types of scan equipments such as laser scanners and photogrammetric scanners. Line or point scan methods by laser can generate precise 3D geometry but cannot obtain color textures in general. Reversely, 3D image modeling with photogrammetry can generate not only geometries but also textures from associated polygons. We got various 3D image models and introduced the process of getting 3D image model of an internet-connected watchdog robot.

  • PDF

Segment-based Foreground Extraction Dedicated to 3D Reconstruction (3차원 복원을 위한 세그멘트 기반의 전경물체 추출)

  • Kim, Jeong-Hwan;Park, An-Jin;Jeong, Gi-Cheol
    • 한국HCI학회:학술대회논문집
    • /
    • 2009.02a
    • /
    • pp.625-630
    • /
    • 2009
  • Researches of image-based 3D reconstruction have recently produced a number of good results, but they assumed that the accurate foreground to be reconstructed is already extracted from each input image. This paper proposes a novel approach to extract more accurate foregrounds by iteratively performing foreground extraction and 3D reconstruction in a manner similar to an EM algorithm on regions segmented in an initial stage, called segments. Here, the segments should preserve foreground boundaries to compensate for the boundary errors generated by visual hull, simple 3D reconstruction to minimize the computational time, and should also be composed of the small number of sets to minimize the user input. Therefore, we utilize image segmentation using the graph-cuts method, which minimizes energy function composed of data and smoothness terms, and the two methods are iteratively performed until the energy function is optimized. In the experiments, more accurate results of the foreground, especially in boundaries, were obtained, although the proposed method used a simple 3D reconstruction method.

  • PDF

Implementation of 3D Video using Time-Shortening Algorithm (시간단축 알고리즘을 통한 3D 동영상 구현)

  • Shin, Jin-Seob;Jeong, Chan-Woong
    • The Journal of the Institute of Internet, Broadcasting and Communication
    • /
    • v.20 no.6
    • /
    • pp.123-128
    • /
    • 2020
  • In this paper, we presents a new cone beam computerized tomography (CBCT) system for the reconstruction of 3 dimensional dynamic images. The system using cone beam has less the exposure of radioactivity than fan beam, relatively. In the system, the reconstruction 3-D image is reconstructed with the radiation angle of X-ray in the image processing unit and transmitted to the monitor. And in the image processing unit, the Three Pass Shear Matrices, a kind of Rotation-based method, is applied to reconstruct 3D image because it has less transcendental functions than the one-pass shear matrix to decrease a time of calculations for the reconstruction 3-D image in the processor. The new system is able to get 3~5 3-D images a second, reconstruct the 3-D dynamic images in real time. And we showed the Rotation-based method was good rather than existing reconstruction technique for 3D images, also found weakness and a solution for it.

Underwater 3D Reconstruction for Underwater Construction Robot Based on 2D Multibeam Imaging Sonar

  • Song, Young-eun;Choi, Seung-Joon
    • Journal of Ocean Engineering and Technology
    • /
    • v.30 no.3
    • /
    • pp.227-233
    • /
    • 2016
  • This paper presents an underwater structure 3D reconstruction method using a 2D multibeam imaging sonar. Compared with other underwater environmental recognition sensors, the 2D multibeam imaging sonar offers high resolution images in water with a high turbidity level by showing the reflection intensity data in real-time. With such advantages, almost all underwater applications, including ROVs, have applied this 2D multibeam imaging sonar. However, the elevation data are missing in sonar images, which causes difficulties with correctly understanding the underwater topography. To solve this problem, this paper concentrates on the physical relationship between the sonar image and the scene topography to find the elevation information. First, the modeling of the sonar reflection intensity data is studied using the distances and angles of the sonar beams and underwater objects. Second, the elevation data are determined based on parameters like the reflection intensity and shadow length. Then, the elevation information is applied to the 3D underwater reconstruction. This paper evaluates the presented real-time 3D reconstruction method using real underwater environments. Experimental results are shown to appraise the performance of the method. Additionally, with the utilization of ROVs, the contour and texture image mapping results from the obtained 3D reconstruction results are presented as applications.

The Analysis of Resolution on the Image Reconstnlction Algorithms for Ultrasonic Diffraction Tomography (초음파 회절 토모그라피 영상복원 알고리즘의 분해능 분석)

  • 구길모;황기환
    • The Journal of the Acoustical Society of Korea
    • /
    • v.18 no.5
    • /
    • pp.83-90
    • /
    • 1999
  • In this paper, we studied resolution to the FBP and BFP image reconstruction algorithms for ultrasonic diffraction tomography. In order to analyze the resolution to the tomographic images which can be reconstructed from the modified FBP image reconstruction algorithm by using fixed coordinate system and BFP image reconstruction algorithm which is suitable for plane structure object, we derived ambiguity functions to these algorithms and then analyzed lateral and depth resolution through simulation respectively. Simulation results show that the lateral and depth resolution to the FBP image reconstruction algorithm and the BFP image reconstruction algorithm was determined 0.27 λ, 0.70 λ and 0.39 λ, 0.98 λ at the 3dB respectively. These results imply that modified FBP and BFP image reconstruction algorithms for diffraction tomography is useful in the tomographic image reconstruction.

  • PDF

Rapid Implementation of 3D Facial Reconstruction from a Single Image on an Android Mobile Device

  • Truong, Phuc Huu;Park, Chang-Woo;Lee, Minsik;Choi, Sang-Il;Ji, Sang-Hoon;Jeong, Gu-Min
    • KSII Transactions on Internet and Information Systems (TIIS)
    • /
    • v.8 no.5
    • /
    • pp.1690-1710
    • /
    • 2014
  • In this paper, we propose the rapid implementation of a 3-dimensional (3D) facial reconstruction from a single frontal face image and introduce a design for its application on a mobile device. The proposed system can effectively reconstruct human faces in 3D using an approach robust to lighting conditions, and a fast method based on a Canonical Correlation Analysis (CCA) algorithm to estimate the depth. The reconstruction system is built by first creating 3D facial mapping from a personal identity vector of a face image. This mapping is then applied to real-world images captured with a built-in camera on a mobile device to form the corresponding 3D depth information. Finally, the facial texture from the face image is extracted and added to the reconstruction results. Experiments with an Android phone show that the implementation of this system as an Android application performs well. The advantage of the proposed method is an easy 3D reconstruction of almost all facial images captured in the real world with a fast computation. This has been clearly demonstrated in the Android application, which requires only a short time to reconstruct the 3D depth map.

Recent Trends of Weakly-supervised Deep Learning for Monocular 3D Reconstruction (단일 영상 기반 3차원 복원을 위한 약교사 인공지능 기술 동향)

  • Kim, Seungryong
    • Journal of Broadcast Engineering
    • /
    • v.26 no.1
    • /
    • pp.70-78
    • /
    • 2021
  • Estimating 3D information from a single image is one of the essential problems in numerous applications. Since a 2D image inherently might originate from an infinite number of different 3D scenes, thus 3D reconstruction from a single image is notoriously challenging. This challenge has been overcame by the advent of recent deep convolutional neural networks (CNNs), by modeling the mapping function between 2D image and 3D information. However, to train such deep CNNs, a massive training data is demanded, but such data is difficult to achieve or even impossible to build. Recent trends thus aim to present deep learning techniques that can be trained in a weakly-supervised manner, with a meta-data without relying on the ground-truth depth data. In this article, we introduce recent developments of weakly-supervised deep learning technique, especially categorized as scene 3D reconstruction and object 3D reconstruction, and discuss limitations and further directions.

CALOS : Camera And Laser for Odometry Sensing (CALOS : 주행계 추정을 위한 카메라와 레이저 융합)

  • Bok, Yun-Su;Hwang, Young-Bae;Kweon, In-So
    • The Journal of Korea Robotics Society
    • /
    • v.1 no.2
    • /
    • pp.180-187
    • /
    • 2006
  • This paper presents a new sensor system, CALOS, for motion estimation and 3D reconstruction. The 2D laser sensor provides accurate depth information of a plane, not the whole 3D structure. On the contrary, the CCD cameras provide the projected image of whole 3D scene, not the depth of the scene. To overcome the limitations, we combine these two types of sensors, the laser sensor and the CCD cameras. We develop a motion estimation scheme appropriate for this sensor system. In the proposed scheme, the motion between two frames is estimated by using three points among the scan data and their corresponding image points, and refined by non-linear optimization. We validate the accuracy of the proposed method by 3D reconstruction using real images. The results show that the proposed system can be a practical solution for motion estimation as well as for 3D reconstruction.

  • PDF