• Journal of the Korean Institute of Intelligent Systems
• /
• v.21 no.4
• /
• pp.512-517
• /
• 2011

In this paper, we propose an Active Shape Model (ASM) and Lucas-Kanade (LK) optical flow-based feature extraction and analysis method for analyzing the emotional features from facial images. Considering the facial emotion feature regions are described by Facial Action Coding System, we construct the feature-related shape models based on the combination of landmarks and extract the LK optical flow vectors at each landmarks based on the centre pixels of motion vector window. The facial emotion features are modelled by the combination of the optical flow vectors and the emotional states of facial image can be estimated by the probabilistic estimation technique, such as Bayesian classifier. Also, we extract the optimal emotional features that are considered the high correlation between feature points and emotional states by using common spatial pattern (CSP) analysis in order to improvise the operational efficiency and accuracy of emotional feature extraction process.

• Journal of the Korean Society for Railway
• /
• v.9 no.2 s.33
• /
• pp.137-144
• /
• 2006

The Extradosed PSC bridge is one of the best alternates which not only covers the longer span than PSC box girder and also performs the role of landmark facility with much cheaper cost than cable stayed bridge. Since the cable-stayed long span bridge is more flexible than general medium span bridges and railway bridges can be experienced resonance phenomenon by repeated equidistant axle loading of the train, it is inevitable to consider the dynamic behavior on impact, deflection and so on. In the present study, the dynamic behavior of an Extradosed PSC railway bridge subjected to moving train forces is analyzed. As well as trains which operate in conventional railway tines, KTX train is also considered. For the estimation of dynamic performances of the Extradosed PSC bridge, vertical deflection, accelerations of the slab, end rotation of the girder and impact on pylons and cables are discussed.

• Journal of Korea Multimedia Society
• /
• v.20 no.11
• /
• pp.1720-1728
• /
• 2017

Active shape model is widely used in the field of image processing especially on arbitrary meaningful shape extraction from single gray level image. Cootes et. al. showed efficient detection of variable shape from image by using covariance and mean shape from learning. There are two stages of learning and testing. Hahn applied enhanced shape alignment method rather than using Cootes's rotation and scale scheme. Hahn did not modified the profile itself. In this paper, the method using directional one dimensional profile is proposed to enhance Cootes's one dimensional profile and the shape alignment algorithm of Hahn is combined. The performance of the proposed method was superior to Cootes's and Hahn's. Average landmark estimation error for each image was 27.72 pixels and 39.46 for Cootes's and 33.73 for Hahn's each.

• Journal of Computational Design and Engineering
• /
• v.1 no.1
• /
• pp.1-12
• /
• 2014

In this paper, we propose a new method of reconstructing the hand models for individuals, which include the link structure models, the homologous skin surface models and the homologous tetrahedral mesh models in a reference posture. As for the link structure model, the local coordinate system related to each link consists of the joint rotation center and the axes of joint rotation, which can be estimated based on the trajectories of optimal markers on the relative skin surface region of the subject obtained from the motion capture system. The skin surface model is defined as a three-dimensional triangular mesh, obtained by deforming a template mesh so as to fit the landmark vertices to the relative marker positions obtained motion capture system. In this process, anatomical dimensions for the subject, manually measured by a caliper, are also used as the deformation constraints.

• The Transactions of The Korean Institute of Electrical Engineers
• /
• v.59 no.11
• /
• pp.2048-2057
• /
• 2010

Is this paper, a pedestrian inertial navigation system with vision is proposed. The navigation system using inertial sensors has problems that it is difficult to determine the initial position and the position error increases over time. To solve these problems, a vision system in addition to an inertial navigation system is used, where a camera is attached to a pedestrian. Landmarks are installed to known positions so that the position and orientation of a camera can be computed once a camera views the landmark. Using this position information, estimation errors in the inertial navigation system is compensated.

• The Journal of Korea Robotics Society
• /
• v.14 no.1
• /
• pp.14-21
• /
• 2019

In the ground environment, mobile robot research uses sensors such as GPS and optical cameras to localize surrounding landmarks and to estimate the position of the robot. However, an underwater environment restricts the use of sensors such as optical cameras and GPS. Also, unlike the ground environment, it is difficult to make a continuous observation of landmarks for location estimation. So, in underwater research, artificial markers are installed to generate a strong and lasting landmark. When artificial markers are acquired with an underwater sonar sensor, different types of noise are caused in the underwater sonar image. This noise is one of the factors that reduces object detection performance. This paper aims to improve object detection performance through distortion and rotation augmentation of training data. Object detection is detected using a Faster R-CNN.

• Ocean Systems Engineering
• /
• v.10 no.4
• /
• pp.435-449
• /
• 2020

This paper proposes a method to estimate the underwater target object's yaw angle using a sonar image. A simulator modeling imaging mechanism of a sonar sensor and a generative adversarial network for style transfer generates realistic template images of the target object by predicting shapes according to the viewing angles. Then, the target object's yaw angle can be estimated by comparing the template images and a shape taken in real sonar images. We verified the proposed method by conducting water tank experiments. The proposed method was also applied to AUV in field experiments. The proposed method, which provides bearing information between underwater objects and the sonar sensor, can be applied to algorithms such as underwater localization or multi-view-based underwater object recognition.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2021.06a
• /
• pp.180-182
• /
• 2021

본 논문은 눈 랜드마크 위치 검출과 시선 방향 벡터 추정이 하나의 딥러닝 네트워크로 통합된 시선 추정 네트워크를 제안한다. 제안하는 네트워크는 Stacked Hourglass Network[1]를 백본(Backbone) 구조로 이용하며, 크게 랜드마크 검출기, 특징 맵 추출기, 시선 방향 추정기라는 세 개의 부분으로 구성되어 있다. 랜드마크 검출기에서는 눈 랜드마크 50개 포인트의 좌표를 추정하며, 특징 맵 추출기에서는 시선 방향 추정을 위한 눈 이미지의 특징 맵을 생성한다. 그리고 시선 방향 추정기에서는 각 출력 결과를 조합하고 이를 통해 최종 시선 방향 벡터를 추정한다. 제안하는 네트워크는 UnityEyes[2] 데이터셋을 통해 생성된 가상의 합성 눈 이미지와 랜드마크 좌표 데이터를 이용하여 학습하였으며, 성능 평가는 실제 사람의 눈 이미지로 구성된 MPIIGaze[3] 데이터 셋을 이용하였다. 실험을 통해 시선 추정 오차는 0.0396 MSE(Mean Square Error)의 성능을 보였으며, 네트워크의 추정 속도는 42 FPS(Frame Per Second)를 나타내었다.

• Korean Journal of Remote Sensing
• /
• v.23 no.4
• /
• pp.297-309
• /
• 2007

The first Korean geostationary weather satellite, Communications, Oceanography and Meteorology Satellite (COMS) will be launched in 2008. The ground station for COMS needs to perform geometric correction to improve accuracy of satellite image data and to broadcast geometrically corrected images to users within 30 minutes after image acquisition. For such a requirement, we developed automated and fast geometric correction techniques. For this, we generated control points automatically by matching images against coastline data and by applying a robust estimation called RANSAC. We used GSHHS (Global Self-consistent Hierarchical High-resolution Shoreline) shoreline database to construct 211 landmark chips. We detected clouds within the images and applied matching to cloud-free sub images. When matching visible channels, we selected sub images located in day-time. We tested the algorithm with GOES-9 images. Control points were generated by matching channel 1 and channel 2 images of GOES against the 211 landmark chips. The RANSAC correctly removed outliers from being selected as control points. The accuracy of sensor models established using the automated control points were in the range of $1{\sim}2$ pixels. Geometric correction was performed and the performance was visually inspected by projecting coastline onto the geometrically corrected images. The total processing time for matching, RANSAC and geometric correction was around 4 minutes.

• Journal of the Korean Institute of Intelligent Systems
• /
• v.14 no.5
• /
• pp.577-582
• /
• 2004

This paper describes position estimation algorithm using neural network for the navigation of the vision-based Wheeled Mobile Robot (WMR) in a corridor with taking ceiling lamps as landmark. From images of a corridor the lamp's line on the ceiling in corridor has a specific slope to the lateral position of the WMR. The vanishing point produced by the lamp's line also has a specific position to the orientation of WMR. The ceiling lamps has a limited size and shape like a circle in image. Simple image processing algorithms are used to extract lamps from the corridor image. Then the lamp's line and vanishing point's position are defined and calculated at known position of WMR in a corridor To estimate the lateral position and orientation of WMR from an image, the relationship between the position of WMR and the features of ceiling lamps have to be defined. Data set between position of WMR and features of lamps are configured. Neural network are composed and teamed with data set. Back propagation algorithm(BPN) is used for learning. And it is applied in navigation of WMR in a corridor.