• Journal of Korea Multimedia Society
• /
• v.24 no.8
• /
• pp.1020-1025
• /
• 2021

Facial alignment is very important task for human life. And facial landmark detection is one of the instrumental methods in face alignment. We introduce the stacked hourglass networks with transposed convolutional layers for facial landmark detection. our method substitutes nearest neighbor upsampling for transposed convolutional layer. Our method returns better accuracy in facial landmark detection compared to stacked hourglass networks with nearest neighbor upsampling.

• Journal of Broadcast Engineering
• /
• v.24 no.4
• /
• pp.564-572
• /
• 2019

With the development of deep learning, the performance of facial landmark detection methods has been greatly improved. The heat map regression method, which is a representative facial landmark detection method, is widely used as an efficient and robust method. However, the landmark coordinates cannot be directly obtained through a single network, and the accuracy is reduced in determining the landmark coordinates from the heat map. To solve these problems, we propose to combine integral regression with the existing heat map regression method. Through experiments using various datasets, we show that the proposed integral regression network significantly improves the performance of facial landmark detection.

• KSII Transactions on Internet and Information Systems (TIIS)
• /
• v.9 no.9
• /
• pp.3685-3700
• /
• 2015

To avoid influences caused by pose, illumination and facial expression variations, we propose a robust three-step algorithm based on ASM and POEM for facial landmark localization. Firstly, Model Selection Factor is utilized to achieve a pose-free initialized shape. Then, we use the global shape model of ASM to describe the whole face and the texture model POEM to adjust the position of each landmark. Thirdly, a second localization is presented to discriminatively refine the subtle shape variation for some organs and contours. Experiments are conducted in four main face datasets, and the results demonstrate that the proposed method accurately localizes facial landmarks and outperforms other state-of-the-art methods.

• Maxillofacial Plastic and Reconstructive Surgery
• /
• v.42
• /
• pp.17.1-17.11
• /
• 2020

Background: To evaluate the facial asymmetry, three-dimensional computed tomography (3D-CT) has been used widely. This study proposed a method to quantify facial asymmetry based on 3D-CT. Methods: The normal standard group consisted of twenty-five male subjects who had a balanced face and normal occlusion. Five anatomical landmarks were selected as reference points and ten anatomical landmarks were selected as measurement points to evaluate facial asymmetry. The formula of facial asymmetry index was designed by using the distances between the landmarks. The index value on a specific landmark indicated zero when the landmarks were located on the three-dimensional symmetric position. As the asymmetry of landmarks increased, the value of facial asymmetry index increased. For ten anatomical landmarks, the mean value of facial asymmetry index on each landmark was obtained in the normal standard group. Facial asymmetry index was applied to the patients who had undergone orthognathic surgery. Preoperative facial asymmetry and postoperative improvement were evaluated. Results: The reference facial asymmetry index on each landmark in the normal standard group was from 1.77 to 3.38. A polygonal chart was drawn to visualize the degree of asymmetry. In three patients who had undergone orthognathic surgery, it was checked that the method of facial asymmetry index showed the preoperative facial asymmetry and the postoperative improvement well. Conclusions: The current new facial asymmetry index could efficiently quantify the degree of facial asymmetry from 3D-CT. This method could be used as an evaluation standard for facial asymmetry analysis.

• The Korean Journal of Applied Statistics
• /
• v.31 no.5
• /
• pp.539-554
• /
• 2018

Effective interaction between user and device is considered an important ability of IoT devices. For some applications, it is necessary to recognize human facial expressions in real time and make accurate judgments in order to respond to situations correctly. Therefore, many researches on facial image analysis have been preceded in order to construct a more accurate and faster recognition system. In this study, we constructed an automatic recognition system for facial expressions through two steps - a facial recognition step and a classification step. We compared various models with different sets of data with pixel information, landmark coordinates, Euclidean distances among landmark points, and arctangent angles. We found a fast and efficient prediction model with only 30 principal components of face landmark information. We applied several prediction models, that included linear discriminant analysis (LDA), random forests, support vector machine (SVM), and bagging; consequently, an SVM model gives the best result. The LDA model gives the second best prediction accuracy but it can fit and predict data faster than SVM and other methods. Finally, we compared our method to Microsoft Azure Emotion API and Convolution Neural Network (CNN). Our method gives a very competitive result.

• Journal of Convergence for Information Technology
• /
• v.11 no.7
• /
• pp.1-6
• /
• 2021

The purpose of this study is to improve the performance of the artificial neural network system for facial image analysis through the image landmark selection technique. For landmark selection, a CNN-based multi-layer ResNet model for classification of facial image age is required. From the configured ResNet model, a heat map that detects the change of the output node according to the change of the input node is extracted. By combining a plurality of extracted heat maps, facial landmarks related to age classification prediction are created. The importance of each pixel location can be analyzed through facial landmarks. In addition, by removing the pixels with low weights, a significant amount of input data can be reduced.

• Journal of information and communication convergence engineering
• /
• v.11 no.3
• /
• pp.207-215
• /
• 2013

In this paper, we address the challenging computer vision problem of obtaining a reliable facial expression analysis from a naturally interacting person. We propose a system that combines a 3D generic face model, 3D head tracking, and 2D tracker to track facial landmarks and recognize expressions. First, we extract facial landmarks from a neutral frontal face, and then we deform a 3D generic face to fit the input face. Next, we use our real-time 3D head tracking module to track a person's head in 3D and predict facial landmark positions in 2D using the projection from the updated 3D face model. Finally, we use tracked 2D landmarks to update the 3D landmarks. This integrated tracking loop enables efficient tracking of the non-rigid parts of a face in the presence of large 3D head motion. We conducted experiments for facial expression recognition using both framebased and sequence-based approaches. Our method provides a 75.9% recognition rate in 8 subjects with 7 key expressions. Our approach provides a considerable step forward toward new applications including human-computer interactions, behavioral science, robotics, and game applications.

• Journal of the Institute of Electronics and Information Engineers
• /
• v.50 no.5
• /
• pp.199-207
• /
• 2013

Spin images representing efficiently surface features of 3D mesh models have been used to detect facial landmark points. However, at a certain point, different normal direction can lead to quite different spin images. Moreover, since 3D points are projected to the 2D (${\alpha}-{\beta}$) space during spin image generation, surface features cannot be described clearly. In this paper, we present a method to detect 3D facial landmark using improved spin images by partitioning the search area with respect to angle. By generating sub-spin images for angular partitioned 3D spaces, more unique features describing corresponding surfaces can be obtained, and improve the performance of landmark detection. In order to generate spin images robust to inaccurate surface normal direction, we utilize on averaging surface normal with its neighboring normal vectors. The experimental results show that the proposed method increases the accuracy in landmark detection by about 34% over a conventional method.

• Imaging Science in Dentistry
• /
• v.37 no.1
• /
• pp.45-51
• /
• 2007

Purpose : This study aimed to identify the range of normal facial asymmetry using three-dimensional CT and to develop a simple method of diagnosis of facial asymmetry. Materials and Methods : Twenty eight adults with normal occlusion (16 males and 12 females; mean age 24 years and 1 month) were selected whose faces were assessed to be symmetric by an orthodontist. Three-dimensional reconstructions were obtained utilizing spiral CT scans and an oral and maxillofacial radiologist evaluated nineteen anatomic landmarks in three-dimensional coordinates. Facial asymmetry index of each landmark was caluculated. Results : The range of normal facial asymmetry of each landmark was identified using mean and standard deviation of facial asymmetry index. Conclusions : The range of normal facial asymmetry identified in this study may be used as a diagnostic standard for facial asymmetry analysis.

• Journal of IKEEE
• /
• v.25 no.4
• /
• pp.613-618
• /
• 2021

Facial expression recognition has long been established as a subject of continuous research in various fields. In this paper, the relationship between each landmark is analyzed using the features obtained by calculating the distance between the facial landmarks in the image, and five facial expressions are classified. We increased data and label reliability based on our labeling work with multiple observers. In addition, faces were recognized from the original data and landmark coordinates were extracted and used as features. A genetic algorithm was used to select features that are relatively more helpful for classification. We performed facial recognition classification and analysis with the method proposed in this paper, which shows the validity and effectiveness of the proposed method.