The Design and Implementation of a Performance Evaluation Tool for the Face Recognition System

얼굴인식시스템 성능평가 도구의 설계 및 구현

  • 신우창 (서경대학교 인터넷정보학과)
  • Published : 2007.08.31


Face recognition technology has lately attracted considerable attention because of its non-intrusiveness, usability and applicability. Related companies insist that their commercial products show the recognition rates more than 95% according to their self-testing. But, the rates cannot be admitted as official recognition rates. So, performance evaluation methods and tools are necessary to objectively measure the accuracy and performance of face recognition systems. In this paper, I propose a reference model for biometrics recognition evaluation tools, and implement an evaluation tool for the face recognition system based on the proposed reference model.


  1. 김학일 외 10인, "ISO/IEC 국제표준기반의 BioAPI 표준적합성 시험도구 개선(v2.0)", 한국정보보호진흥원, 기술표준연구 05-02 최종연구보고서, 2005
  2. 문현준 외 3인, "얼굴인식시스템 성능시험 도구 개발", 한국정보보호진흥원 기술표준연구 04-04 최종연구보고서, 2004
  3. 변혜란 외 7인, "얼굴인식 시스템 성능평가 방법론 연구", 한국정보보호진흥원 평가 1 연구 02-04 최종연구보고서, 2002
  4. (주)워치비젼, "연구용 얼굴 DB 확대 구축", 한국정보보호진흥원 기술표준연구 04-01, 최종연구보고서 부록(A), 2004
  5. Blackburn D. M., J. M. Bone, and P. J. Phillips, "FRVT 2000 Evaluation Report", FRVT 2000 documents, February 2001
  6. ISO/IEC JTC 1/SC 37, Biometric Application Programming Interface-Part 1 : BioAPI Specification, ISO Standards, April 2006
  7. ISO/IEC JTC 1/SC 37, Biometric Performance Testing and Reporting-Part 1 : Test Principles and Framework, ISO Standards FCD, 2005
  8. Grother P. J., R. J. Micheals, and P. J. Phillips, "Face Recognition Vendor Test 2002 Performance Metrics", Proceedings 4th International Conference on Audio Visual Based Person Authentication, 2003
  9. Phillips P. J., P. Rauss, and S. Der, "FERET (FacE REcognition Technology) Recognition Algorithm Development and Test Report", ARL-TR-995, U. S. Army Research Laboratory, 1996
  10. Phillips P. J., H. Wechsler, J. Huang, and P. Rauss, "The FERET Database and Evaluation Procedure for Face Recognition Algorithms", Image and Vision Computing Journal, Vol.16, No.5(1998), pp. 295-306
  11. Phillips P. J., H. Moon, S. A. Rizvi, and P. J. Rauss, "The FERET Evaluation Methodology for Face-recognition Algorithms", IEEE trans. Pattern Analysis and Machine Intelligence, Vol.22, No.10(2000)
  12. Phillips P. J., A. Martin, C. L. Wilson, and M. Przybocki, "An Introduction to Evaluating Biometric Systems", IEEE Computer, February 2000, pp.56-63
  13. Phillips P. J., P. Grother, R. J. Micheals, D. M. Blackburn, E Tabassi, and J. M. Bone. "FRVT 2002 : Overview and Summary", FRVT 2002 documents, March 2003
  14. Phillips P. J., P. Grother, R. J. Micheals, D. M. Blackburn, E Tabassi, and J. M. Bone. "FRVT 2002 : Evaluation Report", FRVT 2002 documents, March 2003
  15. Phillips P. J., W. T. Scruggs, A. J. O'Toole, P. J. Flynn, K. W. Bowyer, C. L. Schott, M. Sharpe. "FRVT 2006 and ICE 2006 Large-Scale Results", NIST 7408, March 2007
  16. Rizvi S., P. J. Phillips, and H. Moon, "The FERET Verification Testing Protocol for Face Recognition Algorithms", Image and Vision Computing Journal, 1998
  17. The BioAPI Consortium, BioAPI Specification Version 1.1, March 2001