• Journal of the Korea Computer Graphics Society
• /
• v.18 no.3
• /
• pp.9-16
• /
• 2012

In this paper, we present a new method for reconstructing detailed facial expression from roughly captured data with a small number of markers. Because of the difference in the required capture resolution between the full-body capture and the facial expression capture, they hardly have been performed simultaneously. However, for generating natural animation, a simultaneous capture for body and face is essential. For this purpose, we provide a method for capturing the detailed facial expression only with a small number of markers. Our basic idea is to build a database for the facial expressions and apply the principal component analysis for reducing the dimensionality. The dimensionality reduction enables us to estimate the full data from a part of the data. We justify our method by applying it to dynamic scenes to show the viability of the method.

• Korean Journal of Cognitive Science
• /
• v.11 no.2
• /
• pp.53-58
• /
• 2000

This paper reconstructs local region of a facial expression image from extracted feature points of facial expression image using FCM(Fuzzy C-Meang) clustering algorithm with Gabor wavelets. The feature extraction in a face is two steps. In the first step, we accomplish the edge extraction of main components of face using average value of 2-D Gabor wavelets coefficient histogram of image and in the next step, extract final feature points from the extracted edge information using FCM clustering algorithm. This study presents that the principal components of facial expression images can be reconstructed with only a few feature points extracted from FCM clustering algorithm. It can also be applied to objects recognition as well as facial expressions recognition.

• Proceedings of the Korean Association of Geographic Inforamtion Studies Conference
• /
• 2003.04a
• /
• pp.369-376
• /
• 2003

최근 고해상력을 가진 줌 렌즈 CCD(Charge Coupled Device) 카메라가 출시되면서 디지털 영상을 쉽게 취득할 수 있게 되어 일상적인 활용에서부터 컴퓨터 시각(computer vision)이나 사진측량과 같은 전문적인 분야에 이르기까지 다양하게 응용할 수 있는 계기가 마련되고 있다. 현재 상용되고 있는 일반 줌 렌즈 CCD 카메라는 영상을 취득하는 데 많은 장점을 갖고 있으나 실제 영상 취득과정에서 다양한 줌의 이동으로 인하여 표정요소계산 및 카메라 렌즈 오차검정에 상당한 어려움이 발생하여 이에 대한 연구가 진행되어오고 있다. 본 연구에서는 기존에 비측량용 카메라에서 취득된 영상을 해석하는 기법으로 사진측량 분야에서 사용되어온 DLT(Direct Linear Transformation) 모델식과 컴퓨터 시각(computer vision)분야에서 카메라 검정 및 3차원 복원에 사용되고 있는 Tsai 모델식을 도입ㆍ적용하여 표정요소계산 및 3차원 복원정확도를 비교 분석하였다. 그 결과 Tsai 모델식에 의한 결과가 DLT 모델식에 의한 결과보다 정확도 및 안정성면에서 향상된 결과를 보여주고 있어서 Tsai 모델식에 대한 사용이 기대된다.

• Proceedings of the KSRS Conference
• /
• 2000.04a
• /
• pp.143-148
• /
• 2000

레이저 프로파일링 시스템의 등장으로, 기존에는 얻을 수 없었던 도시 지역에 대한 DTM 취득이 가능해졌고, 더욱 정확한 정사투영영상 또한 제작할 수 있게 되었다. 하지만, 높이 변화를 보이는 자연지물과 인공구조물이 있는 지역에 대해 기존의 정사투영사진 제작기법이 적용될 때, 폐색이나 이중매핑과 같은 문제가 발생하게 된다. 특히 고층건물이 밀집되어 있는 도심지에서 이러한 현상은 두드러져 정사투영영상의 품질을 저해하는 주요한 원인이 된다. 따라서, 본 연구에서는 카메라의 외부표정요소와 DTM을 이용하여 폐색영역을 탐지하고, 폐색이 안된 다른 영상의 정보를 통해 폐색영역을 복원하여 더욱 완전한 정사투영을 제작할 수 있는 알고리즘을 제안하였다. 제안된 알고리즘에 의해 자연지물이나 인공고조물에 의한 폐색영역을 탐지할 수 있었고 폐색영역의 많은 부분을 부가영상을 이용하여 복원하였다. 건물에 대한 사전지식을 이용하여 폐색영역을 탐지하는 국내 연구가 있지만, 본 연구는 건물에 대한 부가정보나 모델링을 사용하지 않고 DTM과 카메라 외부표정요소만을 이용하여 폐색영역을 탐지한다는 점에서 이러한 연구들과 차별성을 가진다.

• Journal of KIISE:Software and Applications
• /
• v.32 no.6
• /
• pp.570-579
• /
• 2005

Facial expression recognition technology that has potentialities for applying various fields is appling on the man-machine interface development, human identification test, and restoration of facial expression by virtual model etc. Using sequential facial images, this study proposes a simpler method for detecting human facial expressions such as happiness, anger, surprise, and sadness. Moreover the proposed method can detect the facial expressions in the conditions of the sequential facial images which is not rigid motion. We identify the determinant face and elements of facial expressions and then estimates the feature regions of the elements by using information about color, size, and position. In the next step, the direction patterns of feature regions of each element are determined by using optical flows estimated gradient methods. Using the direction model proposed by this study, we match each direction patterns. The method identifies a facial expression based on the least minimum score of combination values between direction model and pattern matching for presenting each facial expression. In the experiments, this study verifies the validity of the Proposed methods.

• The Journal of the Korea institute of electronic communication sciences
• /
• v.8 no.8
• /
• pp.1187-1193
• /
• 2013

In this paper, we present realistic 3D head modeling and facial expression systems. For 3D head modeling, we perform generic model fitting to make individual head shape and texture mapping. To calculate the deformation function in the generic model fitting, we determine correspondence between individual heads and the generic model. Then, we reconstruct the feature points to 3D with simultaneously captured images from calibrated stereo camera. For texture mapping, we project the fitted generic model to image and map the texture in the predefined triangle mesh to generic model. To prevent extracting the wrong texture, we propose a simple method using a modified interpolation function. For generating 3D facial expression, we use the vector muscle based algorithm. For more realistic facial expression, we add the deformation of the skin according to the jaw rotation to basic vector muscle model and apply mass spring model. Finally, several 3D facial expression results are shown at the end of the paper.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.18 no.1
• /
• pp.51-57
• /
• 2000

With the emergence of laser mapping systems, higher resolution DTM of urban area can be acquired and can be used to generate precise orthoimage. But, when the conventional orthoimage generation methods are applied to the area containing features with height difference such as cliffs, bridges, banks. elevated highways and buildings, they cause problems such as occlusion and double mapping. Therefore, this study proposes a new algorithm by modifying and refining conventional orthoimage generation methods. With this algorithm, areas which have occlusion are detected from the base image using camera orientation parameters and DTM. Also, detected areas are restored using alternative images which does not have occlusion in that area. This study can be distinguished from the other studies in the aspects that the proposed algorithm in this paper doesn't need information on building and that uses DTM data and orientation parameters.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.26 no.6
• /
• pp.633-641
• /
• 2008

This study introduces the method of detecting and restoring occlusion areas by using epipolar algorithm and K-means classification algorithm for true ortho-photo generation. In the past, the techniques of detecting occlusion areas are using the reference images or information of buildings. But, in this study the occlusion areas can be automatically detected by using DTM data and exterior orientation parameters. The detected occlusion areas can be restored by using anther images or the computed values which are determined in K-means classification algorithm. In addition, this method takes advantages of applying epipolar algorithm in order to find same location in overlapping areas among images.

• Proceedings of the Korean Information Science Society Conference
• /
• 2001.04b
• /
• pp.613-615
• /
• 2001

본 논문은 동영상 내의 얼굴을 특정인 얼굴로 자동 변환 및 정합하는 기술을 제안한다. 얼굴에 나타난 동작이나 표정은 높은 자유도로 인하여 기존에 사용되어온 2차원적이고 고정된 물체 위주의 동영상 정합 기술로는 자연스러운 결과물을 얻기가 어렵다. 본 논문에서는 입력 받은 정면 유사방향의 사진으로부터 3차원 얼굴 모델을 복원한다. 각 프레임에 등장한 얼굴의 3차원 방향을 추출하여 복원한 3차원 얼굴 모델에 적용한 후 대체할 얼굴 영역에 저합시킨다. 정합 과정 시 비디오 프레임 내의 조명효과와 얼굴색 등을 분석하고 3차원 얼굴 모델에 블렌딩하여 비디오 프레임과 자연스럽게 정합할 수 있도록 한다.

• Journal of the Korean Society of Surveying, Geodesy, Photogrammetry and Cartography
• /
• v.21 no.3
• /
• pp.229-236
• /
• 2003

This study recorded an object using a digital video recorder, and then tried to estimate 3-D positional information and to reconstruct an image. Firstly, the accuracy of measurement results from a video recorder was evaluated and tested for an applicability, then it applied to a real object to construct 3-D digital model. This study assumed that there is no lens distortion in a video recorder, and all bundles should precisely pass through the projection center of a lens. The image size for orientations is determined by the size of CCD chip and the number of pixels. The average squared error from the result by a digital video recorder and that by triangular survey from 1-second theodolite shows 0.0173m error in x,y coordinates. Without knowing the accurate information on the lens distortion and the coordinates of the projection center, this study reasonably produces acceptable results in the reconstruction of 3-D model. In consequence, this study found that the image from a digital video camera can be reconstructed 3-D model only from the information on a camera type.