• Journal of the Korean Association of Geographic Information Studies
• /
• v.22 no.1
• /
• pp.140-153
• /
• 2019

Cloase-range image information from drones and ground-based camera has been frequently used in the field of disaster mitigation with 3D modeling and mapping. In addition, the utilization of virtual reality(VR) is being increased by implementing realistic 3D models with the VR technology simulating disaster circumstances in large scale. In this paper, we created a VR training program by extracting realistic 3D models from close-range images from unmanned aircraft and digital camera on hand and observed several issues occurring during the implementation and the effectiveness in the case of a VR application in training for disaster mitigation. First of all, we built up a scenario of disaster and created 3D models after image processing with the close-range imagery. The 3D models were imported into Unity, a software for creation of augmented/virtual reality, as a background for android-based mobile phones and VR environment was created with C#-based script language. The generated virtual reality includes a scenario in which the trainer moves to a safe place along the evacuation route in the event of a disaster, and it was considered that the successful training can be obtained with virtual reality. In addition, the training through the virtual reality has advantages relative to actual evacuation training in terms of cost, space and time efficiencies.

• Journal of the Korea Society of Computer and Information
• /
• v.26 no.1
• /
• pp.127-133
• /
• 2021

In this study, an augmented reality-based make-up tool was built to analyze the user's face shape based on face-type reference model data and to provide virtual makeup by providing face-type makeup. To analyze the face shape, first recognize the face from the image captured by the camera, then extract the features of the face contour area and use them as analysis properties. Next, the feature points of the extracted face contour area are normalized to compare with the contour area characteristics of each face reference model data. Face shape is predicted and analyzed using the distance difference between the feature points of the normalized contour area and the feature points of the each face-type reference model data. In augmented reality-based virtual makeup, in the image input from the camera, the face is recognized in real time to extract the features of each area of the face. Through the face-type analysis process, you can check the results of virtual makeup by providing makeup that matches the analyzed face shape. Through the proposed system, We expect cosmetics consumers to check the makeup design that suits them and have a convenient and impact on their decision to purchase cosmetics. It will also help you create an attractive self-image by applying facial makeup to your virtual self.

• KIPS Transactions on Software and Data Engineering
• /
• v.10 no.3
• /
• pp.99-108
• /
• 2021

There are unrestricted conditions on the driver's face inside the vehicle, such as changes in lighting, partial occlusion and various changes in the driver's condition. In this paper, we propose a face identification system in an unrestricted vehicle environment. The proposed method uses a near-infrared (NIR) camera to minimize the changes in facial images that occur according to the illumination changes inside and outside the vehicle. In order to process a face exposed to extreme light, the normal face image is changed to a simulated overexposed image using mean and variance for training. Thus, facial classifiers are simultaneously generated under both normal and extreme illumination conditions. Our method identifies a face by detecting facial landmarks and aggregating the confidence score of each landmark for the final decision. In particular, the performance improvement is the highest in the class where the driver wears glasses or sunglasses, owing to the robustness to partial occlusions by recognizing each landmark. We can recognize the driver by using the scores of remaining visible landmarks. We also propose a novel robust rejection and a new evaluation method, which considers the relations between registered and unregistered drivers. The experimental results on our dataset, PolyU and ORL datasets demonstrate the effectiveness of the proposed method.

• Journal of the Korea Society of Computer and Information
• /
• v.27 no.11
• /
• pp.181-190
• /
• 2022

In this paper, we use a LiDAR sensor and an image camera to detect a left-turning waiting vehicle in two ways, unlike the existing image-type or loop-type left-turn detection system, and a left-turn traffic signal corresponding to the waiting length of the left-turning lane. A system that can efficiently assign a system is introduced. For the LiDAR signal transmitted and received by the LiDAR sensor, the left-turn waiting vehicle is detected in real time, and the image by the video camera is analyzed in real time or at regular intervals, thereby reducing unnecessary computational processing and enabling real-time sensitive processing. As a result of performing a performance test for 5 hours every day for one week with an intersection simulation using an actual signal processor, a detection rate of 99.9%, which was improved by 3% to 5% compared to the existing method, was recorded. The advantage is that 99.9% of vehicles waiting to turn left are detected by the LiDAR sensor, and even if an intentional omission of detection occurs, an immediate response is possible through self-correction using the video, so the excessive waiting time of vehicles waiting to turn left is controlled by all lanes in the intersection. was able to guide the flow of traffic smoothly. In addition, when applied to an intersection in the outskirts of which left-turning vehicles are rare, service reliability and efficiency can be improved by reducing unnecessary signal costs.

• ETRI Journal
• /
• v.36 no.5
• /
• pp.791-798
• /
• 2014

As a new hybrid broadcasting service, augmented broadcasting shows enhanced broadcasting content on a large TV screen, while augmented reality (AR) on a mobile device augments additional graphical content onto an input image from the device's own camera to provide useful and convenient information for users. A one-sided broadcasting service using AR has already been attempted in virtual advertisements during sport broadcasts. However, because its augmentation is preprocessed before the video image is transmitted, the viewer at home may have no influence on this formation; and no interaction for the user is possible unless the viewer has a direct connection to the content provider. Augmented broadcasting technology enables viewers to watch mixed broadcasting content only when they want such service and to watch original broadcasting content when they do not. To realize an augmented broadcasting service, the most important issue is to resolve the hybrid content synchronization over heterogeneous broadcast and broadband networks. This paper proposes a novel hybrid content synchronization scheme for an augmented broadcasting service and presents its implementation and results in a terrestrial DTV environment.

• ETRI Journal
• /
• v.26 no.3
• /
• pp.218-228
• /
• 2004

Using stereo images with ephemeris data from the Korea Multi-Purpose Satellite-1 electro-optical camera (KOMPSAT-1 EOC), we performed geometric modeling for three-dimensional (3-D) positioning and evaluated its accuracy. In the geometric modeling procedures, we used ephemeris data included in the image header file to calculate the orbital parameters, sensor attitudes, and satellite position. An inconsistency between the time information of the ephemeris data and that of the center of the image frame was found, which caused a significant offset in satellite position. This time inconsistency was successfully adjusted. We modeled the actual satellite positions of the left and right images using only two ground control points and then achieved 3-D positioning using the KOMPSAT-1 EOC stereo images. The results show that the positioning accuracy was about 12-17 m root mean square error (RMSE) when 6.6 m resolution EOC stereo images were used along with the ephemeris data and only two ground control points (GCPs). If more accurate ephemeris data are provided in the near future, then a more accurate 3-D positioning will also be realized using only the EOC stereo images with ephemeris data and without the need for any GCPs.

• Journal of Broadcast Engineering
• /
• v.2 no.2
• /
• pp.216-224
• /
• 1997

In this paper, we propose a depth information extraction method for intermediate image synthesis. As stereo matching method, MBS(Multiple-Baseline Stereo) method has been proposed, in which the matching accuracy increases by using the multiple camera, but there are some inherent problems such as computational complexity, boundary overreach(BO) in depth map, and occlusion. So, we propose the modified version of MBS so called Multi-Resolution MBS(MR-MBS). Moreover, we also propose an adaptive occlusion area processing technique to improve the accuracy of the depth information in occlusion area.

• Journal of Integrative Natural Science
• /
• v.9 no.2
• /
• pp.155-160
• /
• 2016

Applying image processing techniques to education, the face of the learner is photographed, and expression and movement are detected from video, and the system which estimates degree of concentration of the learner is developed. For one learner, the measuring system is designed in terms of estimating a degree of concentration from direction of line of learner's sight and condition of the eye. In case of multiple learners, it must need to measure each concentration level of all learners in the classroom. But it is inefficient because one camera per each learner is required. In this paper, position in the face region is estimated from video which photographs the learner in the class by the difference between frames within the motion direction. And the system which detects the face direction by the face part detection by template matching is proposed. From the result of the difference between frames in the first image of the video, frontal face detection by Viola-Jones method is performed. Also the direction of the motion which arose in the face region is estimated with the migration length and the face region is tracked. Then the face parts are detected to tracking. Finally, the direction of the face is estimated from the result of face tracking and face parts detection.

• Journal of computational fluids engineering
• /
• v.20 no.2
• /
• pp.96-102
• /
• 2015

In this study, the green water phenomena on rectangular shaped structure is numerically simulated by STAR-CCM+ to investigate the flow pattern including the velocity profiles in bubbly water flow. 5 phases of the formation of green water in front of and over the rectangular shaped structure is simulated at the design condition which is scaled down by 1:125 from FPSO operating in GOM. All numerical results are compared with the experimental results performed in a two dimensional wave flume. The water deformation due to the green water are obtained by the high speed CCD camera with employing the shadow graphy technique, which is allowed to take the bubbly water flow into images. A series of image taken by shadow graphy technique is analyzed with MQD method to calculate the velocity in bubbly water flow.

• International Journal of Contents
• /
• v.10 no.4
• /
• pp.63-68
• /
• 2014

In this paper, we propose a smart system that can optically recognize a music score within a document and can play the music after recognition. Many historic handwritten documents have now been digitalized. Converting images of a music score within documents into digital files is particularly difficult and requires considerable resources because a music score consists of a 2D structure with both staff lines and symbols. The proposed system takes an input image using a mobile device equipped with a camera module, and the image is optimized via preprocessing. Binarization, music sheet correction, staff line recognition, vertical line detection, note recognition, and symbol recognition processing are then applied, and a music file is generated in an XML format. The Music XML file is recorded as digital information, and based on that file, we can modify the result, logically correct errors, and finally generate a MIDI file. Our system reduces misrecognition, and a wider range of music score can be recognized because we have implemented distortion correction and vertical line detection. We show that the proposed method is practical, and that is has potential for wide application through an experiment with a variety of music scores.