• Journal of Information Processing Systems
• /
• v.14 no.6
• /
• pp.1445-1456
• /
• 2018

Environment perception and three-dimensional (3D) reconstruction tasks are used to provide unmanned ground vehicle (UGV) with driving awareness interfaces. The speed of obstacle segmentation and surrounding terrain reconstruction crucially influences decision making in UGVs. To increase the processing speed of environment information analysis, we develop a CPU-GPU hybrid system of automatic environment perception and 3D terrain reconstruction based on the integration of multiple sensors. The system consists of three functional modules, namely, multi-sensor data collection and pre-processing, environment perception, and 3D reconstruction. To integrate individual datasets collected from different sensors, the pre-processing function registers the sensed LiDAR (light detection and ranging) point clouds, video sequences, and motion information into a global terrain model after filtering redundant and noise data according to the redundancy removal principle. In the environment perception module, the registered discrete points are clustered into ground surface and individual objects by using a ground segmentation method and a connected component labeling algorithm. The estimated ground surface and non-ground objects indicate the terrain to be traversed and obstacles in the environment, thus creating driving awareness. The 3D reconstruction module calibrates the projection matrix between the mounted LiDAR and cameras to map the local point clouds onto the captured video images. Texture meshes and color particle models are used to reconstruct the ground surface and objects of the 3D terrain model, respectively. To accelerate the proposed system, we apply the GPU parallel computation method to implement the applied computer graphics and image processing algorithms in parallel.

• Journal of Korea Multimedia Society
• /
• v.22 no.10
• /
• pp.1142-1148
• /
• 2019

Reconstruction of the three-dimensional (3D) environment is a key aspect of augmented reality and augmented virtuality, which utilize and incorporate a user's surroundings. Such reconstruction can be easily realized by employing a Kinect device. However, multiple Kinect devices are required for enhancing the reconstruction density and for spatial expansion. While employing multiple Kinect devices, they must be calibrated with respect to each other in advance, and a marker is often used for this purpose. However, a marker needs to be placed at each calibration, and the result of marker detection significantly affects the calibration accuracy. Therefore, a user-friendly, efficient, accurate, and marker-less method for calibrating multiple Kinect devices is proposed in this study. The proposed method includes a joint tracking algorithm for approximate calibration, and the obtained result is further refined by applying the iterative closest point algorithm. Experimental results indicate that the proposed method is a convenient alternative to conventional marker-based methods for calibrating multiple Kinect devices. Hence, the proposed method can be incorporated in various applications of augmented reality and augmented virtuality that require 3D environment reconstruction by employing multiple Kinect devices.

• Smart Media Journal
• /
• v.11 no.9
• /
• pp.75-80
• /
• 2022

Recently, research and development on immersive virtual reality(VR) technology to provide a realistic experience is being widely conducted. To provide realistic experience in immersive virtual reality for VR participants, virtual environments should consist of high-realistic environments using 3D reconstruction. In this paper, to acquire 3D information in real space using multiple cameras in the reconstruction process, we propose a novel method of optimal camera placement for accurate reconstruction to minimize distortion of 3D information. Through our approach in this paper, real 3D information can obtain with minimized errors during environment reconstruction, and it is possible to provide a more immersive experience with the created virtual environment.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2003.06a
• /
• pp.1634-1637
• /
• 2003

Any given object on the motor-driven turntable is pictured from 8 to 72 different views with a digital camera. 3D shape reconstruction is performed with the integrated software called by Scanware from these multiple digital photographs. There are several steps such as configuration, calibration, capturing, segmentation, shape creation, texturing and merging process during the shape reconstruction process. 3D geometry data can be exported to cad data such as Autocad input file. Also 3D image model is generated from 3D geometry and texture data, and is used to advertise the model in the internet environment. Consumers can see the object realistically from wanted views by rotating or zooming in the internet browsers with Scanbull spx plug-in. The spx format allows a compact saving of 3D objects to handle or download. There are many types of scan equipments such as laser scanners and photogrammetric scanners. Line or point scan methods by laser can generate precise 3D geometry but cannot obtain color textures in general. Reversely, 3D image modeling with photogrammetry can generate not only geometries but also textures from associated polygons. We got various 3D image models and introduced the process of getting 3D image model of an internet-connected watchdog robot.

• Journal of Biomedical Engineering Research
• /
• v.19 no.2
• /
• pp.189-198
• /
• 1998

3D medical image reconstruction techniques are useful to figure out complex 3D structures from the set of 2D sections. In the paper, 3D medical image reconstruction system is constructed under PC environment and programmed based on modular programming by using Visual C++ 4.2. The whole procedures are composed of data preparation, gradient estimation, classification, shading, transformation and ray-casting & compositing. Three speed optimization techniques are used for accelerating 3D medical image reconstruction technique. One is to reduce the rays when cast rays to reconstruct 3D medical image, another is to reduce the voxels to be calculated and the other is to apply early ray termination. To implement 3D medical image reconstruction system based on PC, speed optimization techniques are experimented and applied.

• Proceedings of the KSRS Conference
• /
• 2005.10a
• /
• pp.470-473
• /
• 2005

This paper proposes a reconstruction method for the shape and color information of 3-dimensional buildings. The proposed method is range scanning by laser range finder and image coordinates' color information mapping to laser coordinate by a fixed CCD camera on laser range finder. And we make a 'Far-View' using high-resolution satellite image. The 'Far-View' is created that the height of building using DEM after contours of building extraction. The user select a region of 'Far View' and then, appear detailed 3D-reconstruction of building The outcomes apply to city plan, 3D-environment game and movie background etc.

• 제어로봇시스템학회:학술대회논문집
• /
• 2005.06a
• /
• pp.1695-1700
• /
• 2005

In this paper, we propose an optimal thresholding method for the voxel coloring in the reconstruction of a 3D shape. Our purposed method is a new approach to resolve the trade-off error of the threshold value on determining the photo-consistency in the conventional method. Optimal thresholding value is decided to compare the surface voxel of photo-consistency with inside voxel on the optic ray of the center camera. As iterating the process of the voxels, the threshold value is approached to the optimal value for the individual surface voxel. And also, graph cut method is reduced to the surface noise on eliminating neighboring voxel. To verify the proposed algorithm, we simulated in the virtual and real environment. It is advantaged to speed up and accuracy of a 3D face reconstruction by applying the methods of optimal threshold and graph cut as compare with conventional algorithms.

• The Journal of the Korea Contents Association
• /
• v.13 no.11
• /
• pp.523-532
• /
• 2013

Since conventional methods for the reconstruction of 3D objects used a number of cameras or pictures, they required specific hardwares or they were sensitive to the photography environment with a lot of processing time. In this paper, we propose a 3D object reconstruction method using one photograph based on structured light in ubiquitous environments. We use color pattern of the conventional method for structured light. In this paper, we propose a novel pipeline consisting of various image processing techniques for line pattern extraction and matching, which are very important for the performance of the object reconstruction. And we propose the optimal cost function for the pattern matching. Using our method, it is possible to reconstruct a 3D object with efficient computation and easy setting in ubiquitous or mobile environments, for example, a smartphone with a subminiature projector like Galaxy Beam.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.33 no.6
• /
• pp.557-567
• /
• 2015

With the increasing demands of 3D spatial information in urban environment, the importance of point clouds generation techniques have been increased. In particular, for as-built BIM, the point clouds with the high accuracy and density is required to describe the detail information of building components. Since the terrestrial LiDAR has high performance in terms of accuracy and point density, it has been widely used for as-built 3D modelling. However, the high cost of devices is obstacle for general uses, and the image-based 3D reconstruction technique is being a new attraction as an alternative solution. This paper compares the image-based 3D reconstruction technique and the terrestrial LiDAR in point of establishing the as-built BIM of outdoor structures. The point clouds generated from the image-based 3D reconstruction technique could roughly present the 3D shape of a building, but could not precisely express detail information, such as windows, doors and a roof of building. There were 13.2~28.9 cm of RMSE between the terrestrial LiDAR scanning data and the point clouds, which generated from smartphone and DSLR camera images. In conclusion, the results demonstrate that the image-based 3D reconstruction can be used in drawing building footprint and wireframe, and the terrestrial LiDAR is suitable for detail 3D outdoor modeling.

• Proceedings of the KSRS Conference
• /
• 2004.10a
• /
• pp.128-131
• /
• 2004

In this paper, we describe reconstructed 3D-urban modeling techniques for laser scanner and CCD camera system, which are loading on the vehicle. We use two laser scanners, the one is horizon scanner and the other is vertical scanner. Horizon scanner acquires the horizon data of building for localization. Vertical scan data are main information for constructing a building. We compared extraction of edge aerial image with laser scan data. This method is able to correct the cumulative error of self-localization. Then we remove obstacles of 3D-reconstructed building. Real-texture information that is acquired with CCD camera is mapped by 3D-depth information. 3D building of urban is reconstructed to 3D-virtual world. These techniques apply to city plan. 3D-environment game. movie background. unmanned-patrol etc.