• Journal of Korea Multimedia Society
• /
• v.14 no.11
• /
• pp.1373-1382
• /
• 2011

In this study, we propose an automated smile analysis system for self smile training. The proposed system detects the face area from the input image with the AdaBoost algorithm, followed by identifying facial features based on the face shape model generated by using an ASM(active shpae model). Once facial features are identified, the lip line and teeth area necessary for smile analysis are detected. It is necessary to judge the relationship between the lip line and teeth for smiling degree analysis, and to this end, the second differentiation of the teeth image is carried out, and then individual the teeth areas are identified by means of histogram projection on the vertical axis and horizontal axis. An analysis of the lip line and individual the teeth areas allows for an automated analysis of smiling degree of users, enabling users to check their smiling degree on a real time basis. The developed system in this study exhibited an error of 8.6% or below, compared to previous smile analysis results released by dental clinics for smile training, and it is expected to be used directly by users for smile training.

• Proceedings of the Korean Society of Broadcast Engineers Conference
• /
• 2009.01a
• /
• pp.267-272
• /
• 2009

Video digests provide an effective way of confirming a video content rapidly due to their very compact form. By watching a digest, users can easily check whether a specific content is worth seeing in full. The impression created by the digest greatly influences the user's choice in selecting video contents. We propose a novel method of automatic digest creation that evokes a joyful impression through the created digest by exploiting smile/laughter facial expressions as emotional cues of joy from video. We assume that a digest presenting smiling/laughing faces appeals to the user since he/she is assured that the smile/laughter expression is caused by joyful events inside the video. For detecting smile/laughter faces we have developed a neural network based method for classifying facial expressions. Video segmentation is performed by automatic shot detection. For creating joyful digests, appropriate shots are automatically selected by shot ranking based on the smile/laughter detection result. We report the results of user trials conducted for assessing the visual impression with automatically created 'joyful' digests produced by our system. The results show that users tend to prefer emotional digests containing laughter faces. This result suggests that the attractiveness of automatically created video digests can be improved by extracting emotional cues of the contents through automatic facial expression analysis as proposed in this paper.