• Journal of Urban Science
• /
• v.7 no.2
• /
• pp.53-60
• /
• 2018

Digital Twin is a technology that creates a photocopy of real-world objects on a computer and analyzes the past and present operational status by fusing the structure, context, and operation of various physical systems with property information, and predicts the future society's countermeasures. In particular, 3D rendering technology (UAS, LiDAR, GNSS, etc.) is a core technology in digital twin. so, the research and application are actively performed in the industry in recent years. However, UAS (Unmanned Aerial System) and LiDAR (Light Detection And Ranging) have to be solved by compensating blind spot which is not reconstructed according to the object shape. In addition, the terrestrial LiDAR can acquire the point cloud of the object more precisely and quickly at a short distance, but a blind spot is generated at the upper part of the object, thereby imposing restrictions on the forward digital twin modeling. The UAS is capable of modeling a specific range of objects with high accuracy by using high resolution images at low altitudes, and has the advantage of generating a high density point group based on SfM (Structure-from-Motion) image analysis technology. However, It is relatively far from the target LiDAR than the terrestrial LiDAR, and it takes time to analyze the image. In particular, it is necessary to reduce the accuracy of the side part and compensate the blind spot. By re-optimizing it after fusion with UAS and Terrestrial LiDAR, the residual error of each modeling method was compensated and the mutual correction result was obtained. The accuracy of fusion-based 3D model is less than 1cm and it is expected to be useful for digital twin construction.

• The Journal of Korea Robotics Society
• /
• v.19 no.3
• /
• pp.293-310
• /
• 2024

In this paper, we propose an agent model for Language-Driven Zero-Shot Object Navigation (L-ZSON) tasks, which takes in a freeform language description of an unseen target object and navigates to find out the target object in an inexperienced environment. In general, an L-ZSON agent should able to visually ground the target object by understanding the freeform language description of it and recognizing the corresponding visual object in camera images. Moreover, the L-ZSON agent should be also able to build a rich spatial context map over the unknown environment and decide efficient exploration actions based on the map until the target object is present in the field of view. To address these challenging issues, we proposes AML (Agent Model for L-ZSON), a novel L-ZSON agent model to make effective use of AI foundation models such as Large Language Model (LLM) and Vision-Language model (VLM). In order to tackle the visual grounding issue of the target object description, our agent model employs GLEE, a VLM pretrained for locating and identifying arbitrary objects in images and videos in the open world scenario. To meet the exploration policy issue, the proposed agent model leverages the commonsense knowledge of LLM to make sequential navigational decisions. By conducting various quantitative and qualitative experiments with RoboTHOR, the 3D simulation platform and PASTURE, the L-ZSON benchmark dataset, we show the superior performance of the proposed agent model.

• Journal of Broadcast Engineering
• /
• v.14 no.1
• /
• pp.81-84
• /
• 2009

This paper explores the possibility of describing objects from the change in the shape according to the change in viewpoint. Specifically, we sample the shapes from various viewpoints of a 3-D model, and apply dimension reduction by locally linear embedding. A low dimensional distribution of points are constructed, and characteristics of the object are described from this distribution. Also, we propose two 3-D retrieval methods by applying the iterative closest point algorithm, and by applying Fourier transform and measuring similarity by modified Housdorff distance, and present experimental results. The proposed method shows that the change of shape according to the change in viewpoint can describe the characteristics of an object.

• Journal of the Korean Society of Manufacturing Technology Engineers
• /
• v.24 no.2
• /
• pp.166-171
• /
• 2015

In this study, an automation tool was developed for rapid evaluation of machine tool spindle designs with automated three-dimensional finite element analysis (3D FEA) using solid elements. The tool performs FEA with the minimum data of point coordinates to define the section of the spindle shaft and bearing positions. Using object-oriented programming techniques, the tool was implemented in the programming environment of a CAD system to make use of its objects. Its modules were constructed with the objects to generate the geometric model and then to convert it into the FE model of 3D solid elements at the workbenches of the CAD system using the point data. Graphic user interfaces were developed to allow users to interact with the tool. This tool is helpful for identification of a near optimal design of the spindle based on, for example, stiffness with multiple design changes and then FEAs.

• Proceedings of the Computational Structural Engineering Institute Conference
• /
• 2007.04a
• /
• pp.341-345
• /
• 2007

The objective of this paper is to introduce a project on developing construction method based estimation system. It means a 3D product model based estimation system to effectively and efficiently manage estimation process during the project life-cycle. This paper describes a outline and method for 3D based estimation system. Normally, it is not easy to take-off the quantity from 3D CAD model, because of all different depths of the quantity take off in each design development stage and nation. This study shows how to keep the balance of its depths in each design development stage such as schematic design, detail design, shop drawing, and so forth.

• Journal of KIBIM
• /
• v.6 no.4
• /
• pp.18-26
• /
• 2016

Recently, for the purpose of maintenance of facilities and energy, there have been growing cases of the 3D image scan-based reverse design technology mostly in the manufacturing field. In the MEP field, because of differences between design and physical model, the reverse technology has been utilized in factory facilities such as a semiconductor factory. Because 3D point clouds from scanning include accurate 3D object information, the efficiency of management works related to the complex MEP facilities can be enhanced. In this study, the reverse technology was surveyed, and the MEP facility management based on 3D image scanning was analyzed. Based on the results, a method of 3D image scan-based MEP facility management was proposed.

• 제어로봇시스템학회:학술대회논문집
• /
• 2003.10a
• /
• pp.798-802
• /
• 2003

The robustness and reliability of vision algorithms is the key issue in robotic research and industrial applications. In this paper, the robust real time visual tracking in complex scene is considered. A common approach to increase robustness of a tracking system is to use different models (CAD model etc.) known a priori. Also fusion of multiple features facilitates robust detection and tracking of objects in scenes of realistic complexity. Because voting is a very simple or no model is needed for fusion, voting-based fusion of cues is applied. The approach for this algorithm is tested in a 3D Cartesian robot which tracks a toy vehicle moving along 3D rail, and the Kalman filter is used to estimate the motion parameters, namely the system state vector of moving object with unknown dynamics. Experimental results show that fusion of cues and motion estimation in a tracking system has a robust performance.

• International conference on construction engineering and project management
• /
• 2022.06a
• /
• pp.893-903
• /
• 2022

Recently, computer vision (CV)-based safety monitoring (i.e., object detection) system has been widely researched in the construction industry. Sufficient and high-quality data collection is required to detect objects accurately. Such data collection is significant for detecting small objects or images from different camera angles. Although several previous studies proposed novel data augmentation and synthetic data generation approaches, it is still not thoroughly addressed (i.e., limited accuracy) in the dynamic construction work environment. In this study, we proposed a game engine-driven synthetic data generation model to enhance the accuracy of the CV-based object detection model, mainly targeting small objects. In the virtual 3D environment, we generated synthetic data to complement training images by altering the virtual camera angles. The main contribution of this paper is to confirm whether synthetic data generated in the game engine can improve the accuracy of the CV-based object detection model.

• Transactions of the Korean Society of Machine Tool Engineers
• /
• v.16 no.6
• /
• pp.110-116
• /
• 2007

This paper presents a new technique to implement the real-time recognition for shapes and model number of parts based on an active vision approach. The main focus of this paper is to apply a technique of 3D object recognition for non-contacting inspection of the shape and the external form state of precision parts based on the pattern recognition. In the field of computer vision, there have been many kinds of object recognition approaches. And most of these approaches focus on a method of recognition using a given input image (passive vision). It is, however, hard to recognize an object from model objects that have similar aspects each other. Recently, it has been perceived that an active vision is one of hopeful approaches to realize a robust object recognition system. The performance is illustrated by experiment for several parts and models.

• Journal of Digital Contents Society
• /
• v.13 no.2
• /
• pp.169-176
• /
• 2012

This paper presents a parallel object-oriented programming (OOP) platform for efficient visualization of three-dimensional content in CUDA environments. For this purpose, this paper discusses the features and limitations in implementing C++ object-oriented codes using CUDA and proposes the solutions. Also, it presents how to implement a 3D parallel visualization platform based on the MVC (Model/View/Controller) design pattern. Also, it provides sample implementations for integral MLS (iMLS) and signed distance fields (SDFs) based on the Marching Cubes and Raytracing. The proposed approach enables GPU parallel processing only by implementing simple interfaces. Based on this, developers can expect general benefits that are common in general OOP techniques including abstractization and inheritance. Though I implemented only two specific samples in this paper, I expect my approach can be widely applied to general computer graphics problems.