• Journal of the Korean Institute of Intelligent Systems
• /
• v.19 no.4
• /
• pp.478-484
• /
• 2009

Automatic speech recognition(ASR) is attractive technique in trend these day that seek convenient life. Although many approaches have been proposed for ASR but the performance is still not good in noisy environment. Now-a-days in the state of art in speech recognition, ASR uses not only the audio information but also the visual information. In this paper, We present a novel lip detection method for visual speech recognition in mobile environment. In order to apply visual information to speech recognition, we need to extract exact lip regions. Because eye-detection is more easy than lip-detection, we firstly detect positions of left and right eyes, then locate lip region roughly. After that we apply K-means clustering technique to devide that region into groups, than two lip corners and lip center are detected by choosing biggest one among clustered groups. Finally, we have shown the effectiveness of the proposed method through the experiments based on samsung AVSR database.

• Proceedings of the Korea Information Processing Society Conference
• /
• 2004.11a
• /
• pp.887-890
• /
• 2004

임의 영상에서 얼굴 영역을 검출하고 얼굴 특징점 정보를 획득하는 기술은 얼굴 인식 및 표정 인식 시스템에서 중요한 역할을 한다. 본 논문은 색도 정보와 Top-hat 연산을 이용함으로써 얼굴의 유효 특징점을 효과적으로 검출할 수 있는 방법을 제안한다. 제안한 방법은 얼굴 영역 검출, 눈/눈썹 특징추출, 입술 특징추출의 세 과정으로 나눈다. 얼굴 영역은 $YC_{b}C_{r}$을 이용하여 피부색 영역을 추출한 후 모폴로지 연산과 분할을 통해 획득하고, 눈/눈썹 특징점은 BWCD(Black & White Color Distribution) 변환과 Top-hat 연산을 이용하며. 입술 특징점은 눈/눈썹과의 지정학적 상관관계와 입술 색상분포를 이용하는 방법을 사용한다. 실험을 수행한 결과. 제안한 방법이 다양한 영상에 대해서도 효과적으로 얼굴의 유효 특징점을 검출할 수 있음을 확인하였다.

• KIPS Transactions on Software and Data Engineering
• /
• v.9 no.12
• /
• pp.431-438
• /
• 2020

In this paper, the method to extract lip contour by multiple threshold is proposed. Spyridonos et. el. proposed a method to extract lip contour. First step is get Q image from transform of RGB into YIQ. Second step is to find lip corner points by change point detection and split Q image into upper and lower part by corner points. The candidate lip contour can be obtained by apply threshold to Q image. From the candidate contour, feature variance is calculated and the contour with maximum variance is adopted as final contour. The feature variance 'D' is based on the absolute difference near the contour points. The conventional method has 3 problems. The first one is related to lip corner point. Calculation of variance depends on much skin pixels and therefore the accuracy decreases and have effect on the split for Q image. Second, there is no analysis for color systems except YIQ. YIQ is a good however, other color systems such as HVS, CIELUV, YCrCb would be considered. Final problem is related to selection of optimal contour. In selection process, they used maximum of average feature variance for the pixels near the contour points. The maximum of variance causes reduction of extracted contour compared to ground contours. To solve the first problem, the proposed method excludes some of skin pixels and got 30% performance increase. For the second problem, HSV, CIELUV, YCrCb coordinate systems are tested and found there is no relation between the conventional method and dependency to color systems. For the final problem, maximum of total sum for the feature variance is adopted rather than the maximum of average feature variance and got 46% performance increase. By combine all the solutions, the proposed method gives 2 times in accuracy and stability than conventional method.

• Journal of Korea Multimedia Society
• /
• v.21 no.11
• /
• pp.1279-1287
• /
• 2018

In this paper, a new type of color coordinate conversion is proposed as modified CIEXYZ from RGB to compress the color gamut. The proposed segmentation includes principal component analysis for the optimal projection of a feature vector into a one-dimensional feature. The final step adopted for lip segmentation is Otsu's threshold for a two-class problem. The performance of the proposed method was better than that of conventional methods, especially for the chromatic feature.

• Journal of the Institute of Electronics Engineers of Korea SC
• /
• v.45 no.6
• /
• pp.123-131
• /
• 2008

In Oriental medicine, the status of a tongue is the important indicator to diagnose the condition of one's health like the physiological and the clinicopathological changes of internal organs in a body. A tongue diagnosis is not only convenient but also non-invasive, and therefore widely used in Oriental medicine. However, the tongue diagnosis is affected by examination circumstances like a light source, patient's posture, and doctor's condition a lot. To develop an automatic tongue diagnosis system for an objective and standardized diagnosis, segmenting a tongue region from a facial image captured and classifying tongue coating are inevitable but difficult since the colors of a tongue, lips, and skin in a mouth are similar. The proposed method includes preprocessing, over-segmenting, detecting the edge with a local minimum over a shading area from the structure of a tongue, correcting local minima or detecting the edge with the greatest color difference, selecting one edge to correspond to a tongue shape, and smoothing edges, where preprocessing consists of down-sampling to reduce computation time, histogram equalization, and edge enhancement, which produces the region of a segmented tongue. Finally, the systematic procedure separated only a tongue region from a face image with a tongue, which was obtained from a digital tongue diagnosis system. Oriental medical doctors' evaluation for the results illustrated that the segmented region excluding a non-tongue region provides important information for the accurate diagnosis. The proposed method can be used for an objective and standardized diagnosis and for an u-Healthcare system.

• Proceedings of the Korean Society of Medical Physics Conference
• /
• 2003.09a
• /
• pp.70-70
• /
• 2003

경피적관상동맥성형술(CPTCA)이나 스텐트삽입술 후에 발생하는 재협착을 방지하기 위한 방사선을 조사하는 방법 중에 베타 입자를 방출하는 액체 선원을 catheter풍선 내에 넣어 일정 시간 방사선 조사 시키는 방법이 있다. 조사시킬 혈관의 길이가 길어 한번의 방사선 조사가 어려울 경우 영역을 분할하여 두 번에 나누어 조사할 경우가 있다. 조사영역의 겹치는 부근의 흡수선량이 고선량이나 저선량이 되는가를 알기 위하여 두 풍선간의 접근 거리에 따른 혈관내벽의 흡수선량 분포를 알아보았다. 풍선내의 액체 선원은 Ho-l66을 이용하였고 Ho-l66의 물리적 반감기는 26.8시간이고 최대에너지 1.85 MeV, 평균에너지 0.69 MeV와 최대에너지 1.77 MeV, 평균에너지 0.65 MeV를 갖는 베타 입자를 방출한다. Ho-l66 의 방사선 흡수선량을 측정하기 위하여 GafChromic 필름(Nuclear Associates, Carle Place, NY, USA)을 이용하였고, 방사선이 조사된 필름의 optical density는 videodensitometer(Wellhofer, Schwarzen-bruck, Germany)를 이용하여 값을 읽었다. Catheter 풍선은 직경이 3 mm 이고 길이가 20 mm인 것을 이용하였다. 혈관 내벽의 최대 흡수선량을 표준화하여 겹치는 부분의 흡수선량 분포를 접근 거리에 따라 구하였다. 또한 몬테카를로 시abf레이션으로 확인하였다. 두 풍선의 겹치는 부근의 선량 분포는 풍선 중앙에서 중앙사이의 거리가 21 mm 일 때 중앙에서 20% 증가하였고, 거리가 22 mm일 때와 23 mm일 때 각각 10%와 40%의 감소를 보였다. 풍선 도자의 풍선 안에 베타입자 방출 액체 선원을 넣어 혈관내벽에 방사선 조사하는 방법은 비정거리가 짧아 혈관 내벽 부근에만 방사선을 조사시키고 그 외 중요 장기에는 영향을 덜 미치는 장점이 있다. 그러나 혈관 내벽 표면으로 부터의 거리에 따라 흡수선량이 급격히 떨어지는 분포를 이루기 때문에 두 개의 풍선이 겹치는 부근의 흡수선량은 아주 작은 접근 거리에서도 급격한 변화를 보였다. 따라서 시술 중에 겹치는 부분을 아주 적게 분할하여 정확하게 차례차례로 조사시키기 위해서는 신중한 거리 조정을 하여야 한다.

• Journal of Korea Multimedia Society
• /
• v.22 no.1
• /
• pp.27-34
• /
• 2019

In this paper, a new type of lip feature is proposed as distance metric in CIELUV color system. The performance of the proposed feature was tested on face image database, Helen dataset from University of Illinois. The test processes consists of three steps. The first step is feature extraction and second step is principal component analysis for the optimal projection of a feature vector. The final step is Otsu's threshold for a two-class problem. The performance of the proposed feature was better than conventional features. Performance metrics for the evaluation are OverLap and Segmentation Error. Best performance for the proposed feature was OverLap of 65% and 59 % of segmentation error. Conventional methods shows 80~95% for OverLap and 5~15% of segmentation error usually. In conventional cases, the face database is well calibrated and adjusted with the same background and illumination for the scene. The Helen dataset used in this paper is not calibrated or adjusted at all. These images are gathered from internet and therefore, there are no calibration and adjustment.

• Journal of Korea Multimedia Society
• /
• v.8 no.11
• /
• pp.1439-1448
• /
• 2005

In this paper, after similarity of color information in above toro and geometry position analysis of important characteristic information in face and abstraction object that is inputted detects face area using comparison, describe about method to do user certification using ratio information and hair spring degree. Face abstraction algorithm that use color information has comparative advantages than face abstraction algorithm that use form information because have advantage that is not influenced facial degree or site etc. that tip. Because is based on color information, change of lighting or to keep correct performance because is sensitive about color such as background similar to complexion is difficult. Therefore, can be used more efficiently than method to use color information as that detect characteristic information of eye and lips etc. that is facial importance characteristic element except color information and similarity for each object achieves comparison. This paper proposes system that eye and mouth's similarity that calculate characteristic that is ratio red of each individual after divide face by each individual and is segmentalized giving weight in specification calculation recognize user confirming similarity through search. Could experiment method to propose and know that the awareness rate through analysis with the wave rises.