• Journal of Broadcast Engineering
• /
• v.26 no.3
• /
• pp.269-282
• /
• 2021

As the distribution of 3D content such as augmented reality and virtual reality increases, the importance of real-time computer animation technology is increasing. However, the computer animation process consists mostly of manual or marker-attaching motion capture, which requires a very long time for experienced professionals to obtain realistic images. To solve these problems, animation production systems and algorithms based on deep learning model and sensors have recently emerged. Thus, in this paper, we study four methods of implementing natural human movement in deep learning model and kinect camera-based animation production systems. Each method is chosen considering its environmental characteristics and accuracy. The first method uses a Kinect camera. The second method uses a Kinect camera and a calibration algorithm. The third method uses deep learning model. The fourth method uses deep learning model and kinect. Experiments with the proposed method showed that the fourth method of deep learning model and using the Kinect simultaneously showed the best results compared to other methods.

• The Journal of Korean Institute of Next Generation Computing
• /
• v.14 no.5
• /
• pp.31-39
• /
• 2018

Recently, there has been active studies to provide a user-friendly interface in a virtual reality environment by recognizing user hand gestures based on deep learning. However, most studies use separate sensors to obtain hand information or go through pre-process for efficient learning. It also fails to take into account changes in the external environment, such as changes in lighting or some of its hands being obscured. This paper proposes a hand gesture recognition method based on deep learning that is strong in external environments without the need for pre-process of RGB images obtained from general webcam. In this paper we improve the VGGNet and the GoogLeNet structures and compared the performance of each structure. The VGGNet and the GoogLeNet structures presented in this paper showed a recognition rate of 93.88% and 93.75%, respectively, based on data containing dim, partially obscured, or partially out-of-sight hand images. In terms of memory and speed, the GoogLeNet used about 3 times less memory than the VGGNet, and its processing speed was 10 times better. The results of this paper can be processed in real-time and used as a hand gesture interface in various areas such as games, education, and medical services in a virtual reality environment.

• Journal of the Korean Geosynthetics Society
• /
• v.19 no.4
• /
• pp.41-50
• /
• 2020

Since cracks in concrete structures expedite corrosion of reinforced concrete over a long period of time, regular on-site inspections are essential to ensure structural usability and prevent degradation. Most of the safety inspections of facilities rely on visual inspection with naked eye, so cost and time consuming are severe, and the reliability of results differs depending on the inspector. In this study, a portable measuring device that can be used for safety diagnosis and maintenance was developed as a device that measures the width and length of concrete cracks through image analysis of cracks photographed with a camera. This device captures the cracks found within a close distance (3 m), and accurately calculates the unit pixel size by laser distance measurement, and automatically calculates the crack length and width with the image processing algorithm developed in this study. In measurement results using the crack image applied to the experiment, the measurement of the length of a 0.3 mm crack within a distance of 3 m was possible with a range of about 10% error. The crack width showed a tendency to be overestimated by detecting surrounding pixels due to vibration and blurring effect during the binarization process, but it could be effectively corrected by applying the crack width reduction function.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.24 no.5
• /
• pp.646-654
• /
• 2020

This paper is to develop an electromagnetic wave-based sensor that can measure the spatial distribution of precipitation, and to a electromagnetic wave rain gauge (hereinafter, "EWRG") capable of simultaneously measuring rainfall, snowfall, and wind field, which are the core of heavy rain observation. Through this study, the LFM transmission and reception signals were theoretically analyzed. In addition, In order to develop a radar transceiver, LFM transceiver design and simulation were conducted. In this paper, we developed a K-BAND pulse-driven 6W SSPA(Solid State Power Amplifiers) transceiver using a small HMIC(Hybrid Microwave Integrated Circuit). It has more than 6W of output power and less than 5dB of receiving NF(Noise Figure) with short duty of 1% in high temperature environment of 65 degrees. The manufactured module emits LFM and Square Pulse waveform with the built-in waveform generator, and the receiver has more than 40dB of gain. The transceiver developed in this paper can be applied to the other small weather radar.

• The Journal of Korea Institute of Information, Electronics, and Communication Technology
• /
• v.14 no.1
• /
• pp.22-28
• /
• 2021

Multivariate processes, such as chemical and mechanical process, power plants are operated in a state where several facilities are complexly connected, the fault of a particular system can also have fatal consequences for the entire process. In addition, since process data is measured in an unstable environment, outlier is likely to be include in the data. Therefore, monitoring technology is essential, which can remove outlier from measured data and detect failures in advance. In this paper, data obtained from dynamic and multivariate process models was used to detect fault in various type of processes. The dynamic process is a simulation of a process with autoregressive property, and the multivariate process is a model that describes a situation when a specific sensor fault. Mahalanobis distance was used to remove outlier contained in the data generated by dynamic process model and multivariate process model, and fault detection was performed using ICA. For comparison, we compared performance with and a conventional single ICA method. The proposed fault detection method improves performance by 0.84%p for bias data and 6.82%p for drift data in the dynamic process. In the case of the multivariate process, the performance was improves by 3.78%p, therefore, the proposed method showed better fault detection performance.

• Journal of the Korean Society of Radiology
• /
• v.15 no.4
• /
• pp.409-414
• /
• 2021

In order to acquire an image from a gamma camera, linearity correction must be performed. To this end, digital coordinates are acquired by using a linearity map to accurately specify the location where the scintillator and gamma rays interact. In this study, a method for acquiring undistorted images and digital coordinates was developed using a lookup table and maximum likelihood position estimation without using a linearity map. The proposed method was verified by configuring a small gamma camera through DETECT2000 simulation. A gamma camera was constructed using a GAGG scintillator and a SiPM optical sensor, and a gamma-ray interaction was generated at the center of the scintillator, and a lookup table was prepared using the ratio of the signals obtained from the SiPM. Through the prepared lookup table and the maximum likelihood position estimation, the position of the signal obtained by the gamma-ray interaction was acquired as digital coordinates to compose an image. As a result, the linearity was maintained compared to the generally acquired image, the accuracy of the location where the gamma-ray interaction was generated was excellent, and the distance between the locations was uniform. Since the lookup table obtained through simulation is created using the ratio of the signal, it can be directly used in the experiment, and the position of the signal can be conveniently obtained with digital coordinates with corrected linearity without creating a linearity map.

• KIPS Transactions on Software and Data Engineering
• /
• v.11 no.3
• /
• pp.141-148
• /
• 2022

Recently, reinforcement learning combined with deep neural network technology has achieved remarkable success in various fields such as board games such as Go and chess, computer games such as Atari and StartCraft, and robot object manipulation tasks. However, such deep reinforcement learning describes states, actions, and policies in vector representation. Therefore, the existing deep reinforcement learning has some limitations in generality and interpretability of the learned policy, and it is difficult to effectively incorporate domain knowledge into policy learning. On the other hand, dNL-RRL, a new relational reinforcement learning framework proposed to solve these problems, uses a kind of vector representation for sensor input data and lower-level motion control as in the existing deep reinforcement learning. However, for states, actions, and learned policies, It uses a relational representation with logic predicates and rules. In this paper, we present dNL-RRL-based policy learning for transportation mobile robots in a manufacturing environment. In particular, this study proposes a effective method to utilize the prior domain knowledge of human experts to improve the efficiency of relational reinforcement learning. Through various experiments, we demonstrate the performance improvement of the relational reinforcement learning by using domain knowledge as proposed in this paper.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.39 no.6
• /
• pp.541-548
• /
• 2021

Recently, multispectral cameras are being actively utilized in various application fields such as agriculture, forest management, coastal environment monitoring, and so on, particularly onboard UAV's. Resultant multispectral images are typically georeferenced primarily based on the onboard GPS (Global Positioning System) and IMU (Inertial Measurement Unit)or accurate positional information of the pixels, or could be integrated with ground control points that are directly measured on the ground. However, due to the high cost of establishing GCP's prior to the georeferencing or for inaccessible areas, it is often required to derive the positions without such reference information. This study aims to provide a means to improve the georeferencing performance of a multispectral camera images without involving such ground reference points, but instead with the simultaneously onboard high resolution RGB camera. The exterior orientation parameters of the drone camera are first estimated through the bundle adjustment, and compared with the reference values derived with the GCP's. The results showed that the incorporation of the images from a high resolution RGB camera greatly improved both the exterior orientation estimation and the georeferencing of the multispectral camera. Additionally, an evaluation performed on the direction estimation from a ground point to the sensor showed that inclusion of RGB images can reduce the angle errors more by one order.

• Journal of the Korea Computer Graphics Society
• /
• v.27 no.5
• /
• pp.63-71
• /
• 2021

Among drone autonomous flight technologies, obstacle avoidance is a very important technology that can prevent damage to drones or surrounding environments and prevent danger. Although the LiDAR sensor-based obstacle avoidance method shows relatively high accuracy and is widely used in recent studies, it has disadvantages of high unit price and limited processing capacity for visual information. Therefore, this paper proposes an obstacle avoidance algorithm for drones using camera-based PPO(Proximal Policy Optimization) reinforcement learning, which is relatively inexpensive and highly scalable using visual information. Drone, obstacles, target points, etc. are randomly located in a learning environment in the three-dimensional space, stereo images are obtained using a Unity camera, and then YOLov4Tiny object detection is performed. Next, the distance between the drone and the detected object is measured through triangulation of the stereo camera. Based on this distance, the presence or absence of obstacles is determined. Penalties are set if they are obstacles and rewards are given if they are target points. The experimennt of this method shows that a camera-based obstacle avoidance algorithm can be a sufficiently similar level of accuracy and average target point arrival time compared to a LiDAR-based obstacle avoidance algorithm, so it is highly likely to be used.

• Journal of Korean Tunnelling and Underground Space Association
• /
• v.24 no.1
• /
• pp.39-55
• /
• 2022

This study carried out the laboratory tests for AE signal attenuation to determine the attenuation coefficient (α) of silo concrete in Gyeongju low and intermediate-level disposal environments. The concrete samples were prepared by satisfying the concrete mixing ratio used in the Gyeongju disposal silo, and these samples were additionally exposed depending on the temperature conditions and saturation and, dry condition. As a result of attenuation tests according to the transmission distance on three concrete specimens for each disposal condition, the AE amplitude and absolute energy measured on the saturated concrete were higher than that of the dry concrete in the initial range of the signal transmission distance, but the α of the saturated concrete was higher than that of the dry concrete. Regardless of the saturation and dry conditions, the α tended to decrease as the temperature increases. The α had a more major influence on the saturation and dry condition than the temperature condition, which means that the saturation and dry condition is the main consideration in measuring the signal attenuation of a concrete disposal structure. The α of concrete in the disposal environment expect to be used to predict the integrity of silos concrete in Gyeongju low and intermediate-level disposal environments by estimating the actual AE parameter values at the location of cracks and to determine the optimum location of sensors.