• Journal of the Korean Institute of Intelligent Systems
• /
• v.19 no.4
• /
• pp.478-484
• /
• 2009

Automatic speech recognition(ASR) is attractive technique in trend these day that seek convenient life. Although many approaches have been proposed for ASR but the performance is still not good in noisy environment. Now-a-days in the state of art in speech recognition, ASR uses not only the audio information but also the visual information. In this paper, We present a novel lip detection method for visual speech recognition in mobile environment. In order to apply visual information to speech recognition, we need to extract exact lip regions. Because eye-detection is more easy than lip-detection, we firstly detect positions of left and right eyes, then locate lip region roughly. After that we apply K-means clustering technique to devide that region into groups, than two lip corners and lip center are detected by choosing biggest one among clustered groups. Finally, we have shown the effectiveness of the proposed method through the experiments based on samsung AVSR database.

• Journal of the Korea Convergence Society
• /
• v.9 no.8
• /
• pp.1-8
• /
• 2018

In the field of biometric security such as face and iris recognition, it is essential to extract facial features such as eyes and lips. In this paper, we have studied a method of detecting eye and lip region in face image using faster R-CNN. The faster R-CNN is an object detection method using deep running and is well known to have superior performance compared to the conventional feature-based method. In this paper, feature maps are extracted by applying convolution, linear rectification process, and max pooling process to facial images in order. The RPN(region proposal network) is learned using the feature map to detect the region proposal. Then, eye and lip detector are learned by using the region proposal and feature map. In order to examine the performance of the proposed method, we experimented with 800 face images of Korean men and women. We used 480 images for the learning phase and 320 images for the test one. Computer simulation showed that the average precision of eye and lip region detection for 50 epoch cases is 97.7% and 91.0%, respectively.

• The KIPS Transactions:PartB
• /
• v.16B no.6
• /
• pp.443-450
• /
• 2009

This paper develops a novel technique of face detection using brightness distribution in the surrounding area of eye. The proposed face detection consists of facial component candidate extraction, facial component candidate filtering through eye-lip combination, left/right eye classification using brightness distribution, face verification confirming edges in nose region. Because the proposed technique don't use any skin color, it can detect multiple faces in color images with complicated backgrounds and different illumination levels. The experimental results reveal that the proposed technique is better than the traditional techniques in terms of detection ratio.

• Journal of KIISE:Software and Applications
• /
• v.29 no.5
• /
• pp.311-318
• /
• 2002

In this paper, we propose an efficient method for recognizing pupils and lip in a human face. Pupils are detected by a cost function, which uses features based on the eye's shape and a relation between pupil and eyebrow. The inner boundary of lip is detected by weighted vectors based on lip's shape and on the difference of gray level between lip and face skin. These vectors extract four feature points of lip : the top of the upper lip, the bottom of the lower lip, and the two corners. The experiments have been performed for many images and show very encouraging result.

• Proceedings of the Korean Society of Computer Information Conference
• /
• 2009.01a
• /
• pp.173-176
• /
• 2009

본 논문에서는 피부색 정보와 눈, 입의 위치를 찾아 실시간으로 얼굴을 인식하는 랩을 제안한다. 먼저 노이즈를 제거하여 얼굴 후보 영역을 지정한다. 지정된 얼굴 후보 영역에서 눈과 입을 찾고, 찾은 눈과 입 사이의 영역에서 에지를 탐색하여 코의 존재 유무를 검증하고 이를 바탕으로 얼굴인지 판단하는 절차를 따른다. 제안한 기법은 피부색 검출을 위해 YCbCr 을 이용하여 피부 영역을 찾고 지정한 피부 영역에서 노이즈를 제거한 후, Eye Map의 EyeMapC 연산을 통해 눈을 Lip Map을 통해 입을 찾는다. 찾아낸 눈과 입의 사이의 영역에서 Canny Edge 연산을 수행하여 코의 존재 유무를 판단하여 최종적인 얼굴 영역을 판별하는 방법을 제안한다.

• Journal of Korea Multimedia Society
• /
• v.18 no.9
• /
• pp.1019-1026
• /
• 2015

In this paper, we propose a new method of eye, face, and lip makeup techniques on the target face image from several makeup examples without losing detail features such as eyelids, eyebrows, hair. After detection of the feature layer for the skin, we applied our makeup techniques to the target face by using a blending technique. We used a cartoon rendering using bilateral filter. In order to smoothly makeup the target face, we created two Gaussian Weight maps for natural skin makeup effects. Our method did not need to perform complex operations, so the makeup results are so natural. Our experimental results show good performances in various makeups.

• Journal of the Korea Institute of Information and Communication Engineering
• /
• v.13 no.12
• /
• pp.2547-2554
• /
• 2009

In this paper, we proposed a face detection algorithm and a hardware implementation method for ROI(Region Of Interest) of AF(Auto Focusing). We used face features in skin regions of YCbCr color space for face detection. The face features are the number of skin pixels in face regions, edge pixels in eye regions, and shadow pixels in lip regions. The each feature was statistically selected by 2,000 sample pictures of face. The proposed algorithm detects two faces that are closer center of the image for considering the effectiveness of hardware resource. The detected faces are displayed by rectangle for ROI of AF, and the rectangles are represented by positions in the image about starting point and ending point of the rectangles. The proposed face detection method was verified by using FPGA boards and mobile phone camera sensor.

• The KIPS Transactions:PartB
• /
• v.10B no.4
• /
• pp.465-472
• /
• 2003

For an effective pre-treatment process of a face input image, it is necessary to detect each of face components, calculate the face area, and estimate the rotary angle of the face. A proposed method of this study can estimate an robust result under such renditions as some different levels of illumination, variable fate sizes, fate rotation angels, and background color similar to skin color of the face. The first step of the proposed method detects the estimated face area that can be calculated by both adapted skin color Information of the band-wide HSV color coordinate converted from RGB coordinate, and skin color Information using histogram. Using the results of the former processes, we can detect a lip area within an estimated face area. After estimating a rotary angle slope of the lip area along the X axis, the method determines the face shape based on face information. After detecting eyes in face area by matching a partial template which is made with both eyes, we can estimate Y axis rotary angle by calculating the eye´s locations in three dimensional space in the reference of the face area. As a result of the experiment on various face images, the effectuality of proposed algorithm was verified.