Design and Implementation of a Bimodal User Recognition System using Face and Audio

얼굴과 음성 정보를 이용한 바이모달 사용자 인식 시스템 설계 및 구현

  • 김명훈 (원광대학교 컴퓨터 공학과) ;
  • 이지근 (원광대학교 컴퓨터 공학과) ;
  • 소인미 (원광대학교 컴퓨터 공학과) ;
  • 정성태 (원광대학교 전기전자및정보공학부)
  • Published : 2005.11.01


Recently, study of Bimodal recognition has become very active. In this paper we propose a Bimodal user recognition system that uses face information and audio information. Face recognition consists of face detection step and face recognition step. Face detection uses AdaBoost to find face candidate area. After finding face candidates, PCA feature extraction is applied to decrease the dimension of feature vector. And then, SVM classifiers are used to detect and recognize face. Audio recognition uses MFCC for audio feature extraction and HMM is used for audio recognition. Experimental results show that the Bimodal recognition can improve the user recognition rate much more than audio only recognition, especially in the Presence of noise.