• 한국멀티미디어학회논문지
• /
• 제22권6호
• /
• pp.655-664
• /
• 2019

In this paper, we propose a novel way of combining multiple deep convolutional neural network (DCNN) architectures which work well for accurate video face identification by adopting a serial combination of 3D and 2D DCNNs. The proposed method first divides an input video sequence (to be recognized) into a number of sub-video sequences. The resulting sub-video sequences are used as input to the 3D DCNN so as to obtain the class-confidence scores for a given input video sequence by considering both temporal and spatial face feature characteristics of input video sequence. The class-confidence scores obtained from corresponding sub-video sequences is combined by forming our proposed class-confidence matrix. The resulting class-confidence matrix is then used as an input for learning 2D DCNN learning which is serially linked to 3D DCNN. Finally, fine-tuned, serially combined DCNN framework is applied for recognizing the identity present in a given test video sequence. To verify the effectiveness of our proposed method, extensive and comparative experiments have been conducted to evaluate our method on COX face databases with their standard face identification protocols. Experimental results showed that our method can achieve better or comparable identification rate compared to other state-of-the-art video FR methods.

• 대한전자공학회:학술대회논문집
• /
• 대한전자공학회 1999년도 추계종합학술대회 논문집
• /
• pp.540-543
• /
• 1999

We propose a face tracking algorithm using skin-color based segmentation and a robust Hausdorff distance. First, we present L＊a＊b＊ color model and face segmentation algorithm. A face is segmented from the first frame of input video sequences using skin-color map. Then, we obtain an initial face model with Laplacian operator. For tracking, a robust Hausdorff distance is computed and the best possible displacement t. is selected. Finally, the previous face model is updated using the displacement t. It is robust to some noises and outliers. We provide an example to illustrate the proposed tracking algorithm in video sequences obtained from CCD camera.

• 한국멀티미디어학회논문지
• /
• 제20권8호
• /
• pp.1175-1186
• /
• 2017

Human emotion recognition is one of the promising applications in the era of artificial super intelligence. Thus far, facial expression traits are considered to be the most widely used information cues for realizing automated emotion recognition. This paper proposes a novel facial expression recognition (FER) method that works well for recognizing emotion from image sequences. To this end, we develop the so-called weighted soft voting classification (WSVC) algorithm. In the proposed WSVC, a number of classifiers are first constructed using different and multiple feature representations. In next, multiple classifiers are used for generating the recognition result (namely, soft voting) of each face image within a face sequence, yielding multiple soft voting outputs. Finally, these soft voting outputs are combined through using a weighted combination to decide the emotion class (e.g., anger) of a given face sequence. The weights for combination are effectively determined by measuring the quality of each face image, namely "peak expression intensity" and "frontal-pose degree". To test the proposed WSVC, CK+ FER database was used to perform extensive and comparative experimentations. The feasibility of our WSVC algorithm has been successfully demonstrated by comparing recently developed FER algorithms.

• 한국정보과학회논문지:소프트웨어및응용
• /
• 제26권11호
• /
• pp.1332-1341
• /
• 1999

본 논문에서는 시간에 따라 위치 및 회전각도가 변하는 얼굴 영상을 분석하여 눈과 입을 추출하는 방법을 제안한다. 동영상에서의 얼굴 영역을 효과적으로 추적하기 위해 간편화된 칼만 필터를 제안하며, 예측된 얼굴 영역 내에서 얼굴의 회전 각도를 고려하여 수직 및 수평 프로파일을 적용함으로써 좀 더 정교하게 얼굴 구성요소를 추출한다. 제안한 방법의 효율성은 실험 결과를 통하여 보인다.Abstract We propose the method that extracts eyes and mouth of human by analysing facial image sequences which can change their positions and orientations along the time. We propose the simplified Kalman filter to track the area of human face efficiently in image sequences. We also devise the method of slant-compensation, so that the facial components could be extracted more accurately by using vertical and horizontal profiles of the compensated images. Finally, we show the effectiveness of the suggested method through experimental results.

• 한국방송∙미디어공학회:학술대회논문집
• /
• 한국방송공학회 2009년도 IWAIT
• /
• pp.714-718
• /
• 2009

3D reconstruction of a human face from an image sequence remains an important problem in computer vision. We propose a method, based on a factorization algorithm, that reconstructs a 3D face model from short image sequences exhibiting rotational motion. Factorization algorithms can recover structure and motion simultaneously from one image sequence, but they usually require that all feature points be well tracked. Under rotational motion, however, feature tracking often fails due to occlusion and frame out of features. Additionally, the paucity of images may make feature tracking more difficult or decrease reconstruction accuracy. The proposed 3D reconstruction approach can handle short image sequences exhibiting rotational motion wherein feature points are likely to be missing. We implement the proposal as a reconstruction method; it employs image sequence division and a feature tracking method that uses Active Appearance Models to avoid the failure of feature tracking. Experiments conducted on an image sequence of a human face demonstrate the effectiveness of the proposed method.

• 한국정보전자통신기술학회논문지
• /
• 제9권6호
• /
• pp.546-552
• /
• 2016

We present a quantitative evaluation of an algorithm for model-based face recognition. The algorithm actively learns how individual faces vary through video sequences, providing on-line suppression of confounding factors such as expression, lighting and pose. By actively decoupling sources of image variation, the algorithm provides a framework in which identity evidence can be integrated over a sequence. We demonstrate that face recognition can be considerably improved by the analysis of video sequences. The method presented is widely applicable in many multi-class interpretation problems.

• 융합신호처리학회 학술대회논문집
• /
• 한국신호처리시스템학회 2006년도 하계 학술대회 논문집
• /
• pp.45-48
• /
• 2006

This paper presents an approach to visual information based temporal indexing of video sequences. The objective of this work is the integration of an automatic face detection and a matching system for video indexing. The face detection is done using color information. The matching stage is based on the Principal Component Analysis (PCA) followed by the Minimax Probability Machine (MPM). Using PCA one feature vector is calculated for each face which is detected at the previous stage from the video sequence and MPM is applied to these feature vectors for matching with the training faces which are manually indexed after extracting from video sequences. The integration of the two stages gives good results. The rate of 86.3% correctly classified frames shows the efficiency of our system.

• ETRI Journal
• /
• 제27권6호
• /
• pp.806-809
• /
• 2005

The main goal of this research is automatic video analysis using a face recognition technique. In this paper, an automatic video management system is introduced with a variety of functions enabled, such as index, edit, summarize, and retrieve multimedia data. The automatic management tool utilizes MPEG-7 visual descriptors to generate a video index for creating a summary. The resulting index generates a preview of a movie, and allows non-linear access with thumbnails. In addition, the index supports the searching of shots similar to a desired one within saved video sequences. Moreover, a face recognition technique is utilized to personalbased video summarization and indexing in stored video data.

• 한국정보통신학회논문지
• /
• 제11권5호
• /
• pp.977-984
• /
• 2007

동영상으로부터 움직임 분석 및 색상정보를 이용한 실시간 얼굴 추적 방법을 제안한다. 시간미분연산에 의하여 실시간으로 입력되는 동영상으로부터 움직임 영역을 검출한 후, 컬러공간 융합 필터링에 의하여 얼굴 영역 후보 화소를 검출하고 눈, 입등 얼굴 구성 요소 검출에 의하여 얼굴 영역의 실시간 추적을 행하였다. 얼굴 구성요소의 참조 템플릿을 구축한 후 신규 입력되는 연속영상의 얼굴 영역으로부터 템플릿 매칭을 행함으로써 추출된 얼굴 영역의 신뢰도를 판정하는 방법으로 얼굴 영역 추적의 안정도를 향상시켰다.

• Journal of Information Processing Systems
• /
• 제5권2호
• /
• pp.41-68
• /
• 2009

Face recognition presents a challenging problem in the field of image analysis and computer vision, and as such has received a great deal of attention over the last few years because of its many applications in various domains. Face recognition techniques can be broadly divided into three categories based on the face data acquisition methodology: methods that operate on intensity images; those that deal with video sequences; and those that require other sensory data such as 3D information or infra-red imagery. In this paper, an overview of some of the well-known methods in each of these categories is provided and some of the benefits and drawbacks of the schemes mentioned therein are examined. Furthermore, a discussion outlining the incentive for using face recognition, the applications of this technology, and some of the difficulties plaguing current systems with regard to this task has also been provided. This paper also mentions some of the most recent algorithms developed for this purpose and attempts to give an idea of the state of the art of face recognition technology.