• Journal of the HCI Society of Korea
• /
• v.1 no.1
• /
• pp.53-61
• /
• 2006

In this paper, we propose a novel method for 3D reconstruction of an indoor scene using a multi-view camera. Until now, numerous disparity estimation algorithms have been developed with their own pros and cons. Thus, we may be given various sorts of depth images. In this paper, we deal with the generation of a 3D surface using several 3D point clouds acquired from a generic multi-view camera. Firstly, a 3D point cloud is estimated based on spatio-temporal property of several 3D point clouds. Secondly, the evaluated 3D point clouds, acquired from two viewpoints, are projected onto the same image plane to find correspondences, and registration is conducted through minimizing errors. Finally, a surface is created by fine-tuning 3D coordinates of point clouds, acquired from several viewpoints. The proposed method reduces the computational complexity by searching for corresponding points in 2D image plane, and is carried out effectively even if the precision of 3D point cloud is relatively low by exploiting the correlation with the neighborhood. Furthermore, it is possible to reconstruct an indoor environment by depth and color images on several position by using the multi-view camera. The reconstructed model can be adopted for interaction with as well as navigation in a virtual environment, and Mediated Reality (MR) applications.

• ETRI Journal
• /
• v.43 no.4
• /
• pp.594-602
• /
• 2021

Recently, quantitative and repetitive inspections of the old urban area were conducted because many structures exceed their designed lifetime. The health of a building can be validated from the condition of the outer wall, while the slant angle of the wall widely serves as an indicator of urban regeneration projects. Mostly, the inspector directly measures the inclination of the wall or partially uses 3D point measurements using a static light detection and ranging (LiDAR). These approaches are costly, time-consuming, and only limited space can be measured. Therefore, we propose a mobile mapping system and automatic slant map generation algorithm, configured to capture urban environments online. Additionally, we use the LiDAR-inertial mapping algorithm to construct raw point clouds with gravity information. The proposed method extracts walls from raw point clouds and measures the slant angle of walls accurately. The generated slant angle map is evaluated in indoor and outdoor environments, and the accuracy is compared with real tiltmeter measurements.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.29 no.1
• /
• pp.39-46
• /
• 2011

The present study introduces a comparison between 3D R-tree and octree which are noticeable candidates to index large point clouds gathered from a 3D terrestrial laser scanner. A query method, which is to find neighboring points within given distances, was devised for the comparison, and time lapses for the query along with memory usages were checked. From tests conducted on point clouds scanned from a building and a stone pagoda, it was shown that octree has the advantage of fast generation and query while 3D R-tree is more memory-efficient. Both index and leaf capacity were revealed to be ruling factors to get the best performance of 3D R-tree, while the number of level was of oetree.

• ETRI Journal
• /
• v.37 no.3
• /
• pp.606-616
• /
• 2015

In this paper, we propose a novel method for road recognition using 3D point clouds based on a Markov random field (MRF) framework in unstructured and complex road environments. The proposed method is focused on finding a solution for an analysis of traversable regions in challenging environments without considering an assumption that has been applied in many past studies; that is, that the surface of a road is ideally flat. The main contributions of this research are as follows: (a) guidelines for the best selection of the gradient value, the average height, the normal vectors, and the intensity value and (b) how to mathematically transform a road recognition problem into a classification problem that is based on MRF modeling in spatial and visual contexts. In our experiments, we used numerous scans acquired by an HDL-64E sensor mounted on an experimental vehicle. The results show that the proposed method is more robust and reliable than a conventional approach based on a quantity evaluation with ground truth data for a variety of challenging environments.

• International Journal of Internet, Broadcasting and Communication
• /
• v.13 no.1
• /
• pp.54-60
• /
• 2021

AR (Augmented Reality) is a technology that provides virtual content to the real world and provides additional information to objects in real-time through 3D content. In the past, a high-performance device was required to experience AR, but it was possible to implement AR more easily by improving mobile performance and mounting various sensors such as ToF (Time-of-Flight). Also, the importance of mobile augmented reality is growing with the commercialization of high-speed wireless Internet such as 5G. Thus, this paper proposes a system that can provide AR services via GNN (Graph Neural Network) using cameras and sensors on mobile devices. ToF of mobile devices is used to capture depth maps. A 3D point cloud was created using RGB images to distinguish specific colors of objects. Point clouds created with RGB images and Depth Map perform downsampling for smooth communication between mobile and server. Point clouds sent to the server are used for 3D object detection. The detection process determines the class of objects and uses one point in the 3D bounding box as an anchor point. AR contents are provided through app and web through class and anchor of the detected object.

• Journal of Broadcast Engineering
• /
• v.26 no.5
• /
• pp.553-565
• /
• 2021

Point cloud is a set of points for representing a 3D object, and consists of geometric information, which is 3D coordinate information, and attribute information, which is information representing color, reflectance, and the like. In this way of expressing, it has a vast amount of data compared to 2D images. Therefore, a process of compressing the point cloud data in order to transmit the point cloud data or use it in various fields is required. Unlike color information corresponding to all 2D geometric information constituting a 2D image, a point cloud represents a point cloud including attribute information such as color in only a part of the 3D space. Therefore, separate processing of geometric information is also required. Based on these characteristics of point clouds, MPEG under ISO/IEC standardizes V-PCC, which imitates point cloud images and compresses them into 2D DCT-based 2D image compression codecs, as a compression method for high-density point cloud data. This has limitations in accurately representing 3D spatial information to proceed with compression by converting 3D point clouds to 2D, and difficulty in processing non-existent points when utilizing 3D DCT. Therefore, in this paper, we present 3D Discrete Cosine Transform-based Point Cloud Compression (3DCT PCC), a method to compress point cloud data, which is a 3D image by utilizing 3D DCT, and confirm the efficiency of 3D DCT compared to V-PCC based on 2D DCT.

• Journal of the Korea Computer Graphics Society
• /
• v.24 no.3
• /
• pp.61-71
• /
• 2018

When triangular meshes are generated from the point clouds in global space reconstructed through camera pose estimation against captured RGB-D streams, the quality of the resulting meshes improves as more triangles are hired. However, for 3D reconstructed models beyond some size threshold, they become to suffer from the ugly-looking artefacts due to the insufficient precision of RGB-D sensors as well as significant burdens in memory requirement and rendering cost. In this paper, for the generation of 3D models appropriate for real-time applications, we propose an effective technique that extracts high-quality textures for moderate-sized meshes from the captured colors associated with the reconstructed point sets. In particular, we show that via a simple method based on the mapping between the 3D global space resulting from the camera pose estimation and the 2D texture space, textures can be generated effectively for the 3D models reconstructed from captured RGB-D image streams.

• Tunnel and Underground Space
• /
• v.17 no.3 s.68
• /
• pp.165-174
• /
• 2007

The technique, which reproduces the figures of objects from measured data of the objects using 3-D laser scanner, is called reverse engineering. Recently, research studies into applications of reverse engineering to rock engineering are increasing in number, in the discontinuity surveys for rock slopes out of man's reach, or rapid discontinuity surveys for wide range areas. For analysis of discontinuity using reverse engineering, a program for processing point clouds data from the 3-D laser scanner, for sampling from these point clouds data, and finally analyzing the discontinuity is needed. However, existing programs rarely have sufficient functions to properly analyze the discontinuities. In this study, a program was developed, which can automatically sample discontinuities from the point clouds data which measured in a rock slope using a 3-D laser scanner, and which can also undertake statistical analysis of the discontinuities. This developed program was verified by the application of discontinuity surveys in a rock slope and a tunnel. By undertaking the discontinuity survey using a 3-D laser scanner and the developed program, the feasibility and rapidity of such surveys is expected to improve in areas out of man's reach in geotechnical surveys. Taking into consideration the fact that the international level of related techniques is at a rudimentary stage, the possibility of prior occupation of a broad market is also expected.

• Proceedings of the Korean Society of Precision Engineering Conference
• /
• 2010.05a
• /
• pp.829-830
• /
• 2010

• Journal of Internet of Things and Convergence
• /
• v.9 no.6
• /
• pp.11-16
• /
• 2023

The technology of 3D reconstruction, primarily relying on point cloud data, is essential for digitizing objects or spaces. This paper aims to utilize reinforcement learning to achieve the acquisition of point clouds in a given environment. To accomplish this, a simulation environment is constructed using Unity, and reinforcement learning is implemented using the Unity package known as ML-Agents. The process of point cloud acquisition involves initially setting a goal and calculating a traversable path around the goal. The traversal path is segmented at regular intervals, with rewards assigned at each step. To prevent the agent from deviating from the path, rewards are increased. Additionally, rewards are granted each time the agent fixates on the goal during traversal, facilitating the learning of optimal points for point cloud acquisition at each traversal step. Experimental results demonstrate that despite the variability in traversal paths, the approach enables the acquisition of relatively accurate point clouds.