• Title/Summary/Keyword: Lip Extraction

Search Result 88, Processing Time 0.022 seconds

Extraction of Lip Region using Chromaticity Transformation and Fuzzy Clustering (색도 변환과 퍼지 클러스터링을 이용한 입술영역 추출)

  • Kim, Jeong Yeop
    • Journal of Korea Multimedia Society
    • /
    • v.17 no.7
    • /
    • pp.806-817
    • /
    • 2014
  • The extraction of lip region is essential to Lip Reading, which is a field of image processing to get some meaningful information by the analysis of lip movement from human face image. Many conventional methods to extract lip region are proposed. One is getting the position of lip by using geometric face structure. The other discriminates lip and skin regions by using color information only. The former is more complex than the latter, however it can analyze black and white image also. The latter is very simple compared to the former, however it is very difficult to discriminate lip and skin regions because of close similarity between these two regions. And also, the accuracy is relatively low compared to the former. Conventional analysis of color coordinate systems are mostly based on specific extraction scheme for lip regions rather than coordinate system itself. In this paper, the method for selection of effective color coordinate system and chromaticity transformation to discriminate these two lip and skin region are proposed.

Lip Region Extraction by Gaussian Classifier (가우스 분류기를 이용한 입술영역 추출)

  • Kim, Jeong Yeop
    • Journal of Korea Multimedia Society
    • /
    • v.20 no.2
    • /
    • pp.108-114
    • /
    • 2017
  • Lip reading is a field of image processing to assist the process of sound recognition. In some environment, the capture of sound signal usually has significant noise and therefore, the recognition rate of sound signal decreases. Lip reading can be a good feature for the increase of recognition rates. Conventional lip extraction methods have been proposed widely. Maia et. al. proposed a method by the sum of Cr and Cb. However, there are two problems as follows: the point with maximum saturation is not always regarded as lips region and the inner part of lips such as oral cavity and teeth can be classified as lips. To solve these problems, this paper proposes a method which adopts the histogram-based classifier for the extraction of lips region. The proposed method consists of two stages, learning and test. The amount of computation is minimized because this method has no color conversion. The performance of proposed method gives 66.8% of detection rate compared to 28% of conventional ones.

Three-dimensional changes in lip vermilion morphology of adult female patients after extraction and non-extraction orthodontic treatment

  • Liu, Zhi-Yu;Yu, Jie;Dai, Fan-Fan;Jiang, Ruo-Ping;Xu, Tian-Min
    • The korean journal of orthodontics
    • /
    • v.49 no.4
    • /
    • pp.222-234
    • /
    • 2019
  • Objective: To investigate the three-dimensional lip vermilion changes after extraction and non-extraction orthodontic treatment in female adult patients and explore the correlation between lip vermilion changes and incisor changes. Methods: Forty-seven young female adult patients were enrolled in this study (skeletal Class III patients were excluded), including 34 lip-protruding patients treated by extraction of four first premolars (18 patients requiring mini-implants for maximum anchorage control and 16 patients without mini-implants) and 13 patients requiring non-extraction treatment. Nine angles, seven distances, and the surface area of the lip vermilion were measured by using pre- and post-treatment three-dimensional facial scans. Linear and angular measurements of incisors were performed on lateral cephalograms. Results: There were no significant changes in the vermilion measurements in the non-extraction group. The vermilion angle, vermilion height, central bow angle, height/width ratio, and vermilion surface area decreased significantly after the orthodontic treatment in the extraction groups, but the upper/lower vermilion proportion remained unchanged. Significant correlations were found between the changes in incisor position and those in vermilion angles, vermilion height, and surface area. Conclusions: Extraction of the four first premolars probably produced an aesthetic improvement in lip vermilion morphology. However, the upper/lower vermilion proportion remained unchanged. The variations in the vermilion were closely related to incisor changes, especially the upper incisor inclination changes.

Performance Comparison and Verification of Lip Parameter Selection Methods in the Bimodal Speech ]Recognition System (입술 파라미터 선정에 따른 바이모달 음성인식 성능 비교 및 검증)

  • 박병구;김진영;임재열
    • The Journal of the Acoustical Society of Korea
    • /
    • v.18 no.3
    • /
    • pp.68-72
    • /
    • 1999
  • The choice of parameters from various lip information and the robustness of extracting lip parameters play important roles in the performance of bimodal speech recognition system. In this paper, lip parameters are extracted by using an automatic extraction algorithm and inner lip parameters effect on the recognition rate more than outer lip parameters. Compared with a manual extraction algorithm, the automatic extraction method is evaluated about its robustness.

  • PDF

Comparison of Soft Tissue Changes between Adolescents and Adults in Class II Malocclusion Treatment (청소년 및 성인 환자에서 II급 부정교합 치료시 연조직 변화에 관한 비교)

  • Chang, Na-Young;Cho, Jin-Hyoung;Lee, You-Mee;Kang, Kyung-Hwa
    • Journal of Oral Medicine and Pain
    • /
    • v.34 no.3
    • /
    • pp.277-294
    • /
    • 2009
  • The purpose of this study was to evaluate the soft tissue changes of class II adolescents and adults in respect to extraction or nonextraction. The study included 68 patients from Wonkwang Dental Hospital were categorized to adolescent extraction group, adolescent nonextraction group, adult extraction group, adult nonextraction group. Cephalometric tracing of each patient was done to compare pretreatment and posttreatment of each group, to compare the changes between groups. And among the variables that showed significancy, correlation analysis and simple linear regression were done. The results were as follows. 1. In both adolescents and adults after extraction treatment, nasolabial angle significantly increased and in both subjects after non extraction treatment, nasolabial angle significantly decreased. 2. In extraction subjects, there were positive correlation between the amount of treatment changes of vertical-U1 and E line-upper lip, the changes of vertical-L1 and E line-lower lip, the changes of vertical-L1 and vertical-Li. 3. In extraction subjects, simple regression equations of E line-upper lip, E line-lower lip, Li were calculated by regression analysis. According to the results above, it could be considered that the effect of the extraction or nonextraction treatment was greater than the effect of growth.

Robust Lip Extraction and Tracking of the Mouth Region

  • Min, Duk-Soo;Kim, Jin-Young;Park, Seung-Ho;Kim, Ki-Jung
    • Proceedings of the IEEK Conference
    • /
    • 2000.07b
    • /
    • pp.927-930
    • /
    • 2000
  • Visual features of lip area play an important role in the visual speech information. We are concerned about correct lip area as region of interest (ROI). In this paper, we propose a robust and fast method for locating the mouth corners. Also, we define a region of interest at mouth during speech. A method, which we have used, only uses the horizontal and vertical image operators at mouth area. This searching is performed by fitting the ROI-template to image with illumination control. Most of the lip extraction algorithms are dependent on luminosity of image. We just used the binary image where the variable threshold is applied. The variable threshold varies to illumination condition. In order to control those variations, the gray-tone is converted to binary image by threshold, which is obtained through Multiple Linear Regression Analysis (MLRA) about divided 2D special region. Thus we obtained the region of interest at mouth area, which is the robust extraction about illumination. A region of interest is automatically extracted.

  • PDF

Changes in maximum lip-closing force after extraction and nonextraction orthodontic treatments

  • Choi, Tae-Hyun;Kim, So-Hyun;Kim, Cheul;Kook, Yoon-Ah;Larson, Brent E.;Lee, Nam-Ki
    • The korean journal of orthodontics
    • /
    • v.50 no.2
    • /
    • pp.120-128
    • /
    • 2020
  • Objective: The aims of the present study were to evaluate the changes in the maximum lip-closing force (MLF) after orthodontic treatment with or without premolar extractions and verify the correlation of these changes with dentoskeletal changes. Methods: In total, 17 women who underwent nonextraction orthodontic treatment and 15 women who underwent orthodontic treatment with extraction of all four first premolars were included in this retrospective study. For all patients, lateral cephalograms and dental models were measured before (T0) and after (T1) treatment. In addition, MLF was measured at both time points using the Lip De Cum LDC-110R® device. Statistical analyses were performed to evaluate changes in clinical variables and MLF and their correlations. Results: Both groups showed similar skeletal patterns, although the extraction group showed greater proclination of the maxillary and mandibular incisors and lip protrusion compared to the nonextraction group at T0. MLF at T0 was comparable between the two groups. The reduction in the arch width and depth and incisor retroclination from T0 to T1 were more pronounced in the extraction group than in the nonextraction group. MLF in the extraction group significantly increased during the treatment period, and this increase was significantly greater than that in the nonextraction group. The increase in MLF was found to be correlated with the increase in the interincisal angle and decrease in the intermolar width, arch depth, and incisor-mandibular plane angle. Conclusions: This study suggests that MLF increases to a greater extent during extraction orthodontic treatment than during nonextraction orthodontic treatment.

Lip Detection using Color Distribution and Support Vector Machine for Visual Feature Extraction of Bimodal Speech Recognition System (바이모달 음성인식기의 시각 특징 추출을 위한 색상 분석자 SVM을 이용한 입술 위치 검출)

  • 정지년;양현승
    • Journal of KIISE:Software and Applications
    • /
    • v.31 no.4
    • /
    • pp.403-410
    • /
    • 2004
  • Bimodal speech recognition systems have been proposed for enhancing recognition rate of ASR under noisy environments. Visual feature extraction is very important to develop these systems. To extract visual features, it is necessary to detect exact lip position. This paper proposed the method that detects a lip position using color similarity model and SVM. Face/Lip color distribution is teamed and the initial lip position is found by using that. The exact lip position is detected by scanning neighbor area with SVM. By experiments, it is shown that this method detects lip position exactly and fast.

Lip Feature Extraction using Contrast of YCbCr (YCbCr 농도 대비를 이용한 입술특징 추출)

  • Kim, Woo-Sung;Min, Kyung-Won;Ko, Han-Seok
    • Proceedings of the IEEK Conference
    • /
    • 2006.06a
    • /
    • pp.259-260
    • /
    • 2006
  • Since audio speech recognition is affected by noise in real environment, visual speech recognition is used to support speech recognition. For the visual speech recognition, this paper suggests the extraction of lip-feature using two types of image segmentation and reduced ASM. Input images are transformed to YCbCr based images and lips are segmented using the contrast of Y/Cb/Cr between lip and face. Subsequently, lip-shape model trained by PCA is placed on segmented lip region and then lip features are extracted using ASM.

  • PDF

A STUDY ON THE CHANCES OF THE SOFT TISSUE PROFILE FOLLOWING ORTHODONTIC TREATMENT BY DIGITAL SUBTRACTION METHOD (교정치료에 따른 측모 연조직의 변화에 관한 계수공제 영상측정법적 연구)

  • Cho, Won-Tak;Yu, Dong-Hwan
    • The korean journal of orthodontics
    • /
    • v.27 no.3 s.62
    • /
    • pp.411-420
    • /
    • 1997
  • The propose of this study was to quantify the changes of soft tissue profile following orthodontic treatment and to evaluate the relationship of those to the skeletal elements. Pre-and post-treatment lateral cephalometric head films of 40 cases(20 extraction cases, 20 non-extraction cases) were traced, and the changes following treatment were measured and quantified by digital subtraction method, and statisticall analyzed. The obtained results were as follows; 1. in extraction group, the change of upper lip area(UL) was $558.60\pm355.17$ pixels, that of lower lip area(LL) was $941.15\pm364.07$ pixels. But, in non-extraction group the change of uper lip area(UL) was $125.65\pm404.16$ pixels, that of lower lip area(LL) was $104.05\pm440.93$ pixels, which was significantly lesser than those in extraction group. 2. In extraction group, there was significant correlationship between upper lip area change(UL) and difference of upper incisor point(${\Delta}UIP$). Lower lip area change(LL) was significantly correlated with difference of upper incisor(${\Delta}UIP$), difference of Franlrfort upper incisor angle(${\Delta}FUIA$) or difference of interincisal angle(${\Delta}IIA$). 3. In extraction group, the ratio of difference of upper incisor point(${\Delta}UIP$) to difference of labrale superius(${\Delta}LSP$) was 1.68; difference of lower incisor point(${\Delta}LIP$) to difference of labrale inferius(${\Delta}LI$) was 1.19; difference of upper incisor point(${\Delta}UIP$) to increment in upper lip thickness(${\Delta}TUL$) was 1.95. 4. In non-extraction group, there was a significant correlationship between upper lip area change(UL) and difference of upper incisor point(${\Delta}UIP$).

  • PDF