Journal of the Korea Society of Computer and Information (한국컴퓨터정보학회논문지)

Korean Society of Computer Information (한국컴퓨터정보학회)
권호 표지
DOI QR코드

DOI QR Code

Implementing Augmented Reality By Using Face Detection, Recognition And Motion Tracking

얼굴 검출과 인식 및 모션추적에 의한 증강현실 구현

  • Lee, Hee-Man (Dept. of Multimedia Engineering, Seowon University)
  • 이희만 (서원대학교 멀티미디어학과)
  • Received : 2011.11.14
  • Accepted : 2011.12.19
  • Published : 2012.01.31
Download PDF
⟨ Previous Next ⟩

Abstract

Natural User Interface(NUI) technologies introduce new trends in using devices such as computer and any other electronic devices. In this paper, an augmented reality on a mobile device is implemented by using face detection, recognition and motion tracking. The face detection is obtained by using Viola-Jones algorithm from the images of the front camera. The Eigenface algorithm is employed for face recognition and face motion tracking. The augmented reality is implemented by overlapping the rear camera image and GPS, accelerator sensors' data with the 3D graphic object which is correspond with the recognized face. The algorithms and methods are limited by the mobile device specification such as processing ability and main memory capacity.

내추럴 유저 인터페이스 기술(NUI)의 발달은 게임이나 컴퓨터 사용 및 기타 전자기기 사용법에 일대 변화를 가져오고 있다. 본 논문에서는 스마트 폰 사용자의 얼굴을 식별하고 또한 얼굴 움직임 동작을 감지하여 증강현실을 구현한다. 모바일 기기의 전면 카메라를 이용하여 얼굴의 위치를 Viola-Jones방법을 사용하여 검색하고 검색한 얼굴의 식별 및 움직임 검출을 Eigenface 알고리즘을 사용하며, 식별된 사람에 대응되는 그래픽스 오브젝트를 GPS나 가속도 센서 등의 정보와 후면 카메라의 영상과 함께 합성하는 증강현실 시스템을 구현한다. 증강현실 시스템은 모바일 기기의 성능에 적합한 알고리즘 및 방법으로 구현하여야 한다.

Keywords

References

  1. Mantro Press, "Smart Phone And Web Revolution," pp.19-37, ISBN:978-89-6305-064-5, Sep., 2010.
  2. Seong-Yoon Shin, Byung-Seok Choi, Yang-Won-Rhee, "Color Recognition and Phoneme Pattern Segmentation of Hangeul Using Augmented Reality," Journal of The Korea Society of Computer and Information, Vol.15, No.6, pp.29-35, June, 2010. https://doi.org/10.9708/jksci.2010.15.6.029
  3. Hag-hee Kim, "Implementation of augmented reality and object tracking using multiple camera," Journal of The Korea Society of Computer and Information, Vol.16, No.6,pp.89-97, June, 2011.
  4. Hag-hee Kim, "Techniques on Multi-Marker for the Implementation of Augmented Reality," Journal of The Korea Society of Computer and Information, Vol.15, No.11, pp.109-116, Nov., 2010.
  5. Eun-Young Kim, Dong-Yeol Oh, "A Realtime Music Editing and Playback System in An Augmented Reality Environments," Journal of The Korea Society of Computer and Information, Vol.16, No.6, pp.79-88, June, 2011.
  6. Chong Woo Woo, Doohee Lee, "A Development of a Framework for Building Knowledge based Augmented Reality System," Journal of The Korea Society of Computer and Information, Vol.16, No.7, 49-58, July, 2011.
  7. Constantine Kotropoulos, Ioannis Pitas, "Rule-Based Face Detection in Frontal Views," Proc. of IEEE Int. Conf. on Acoustics, Speech and Signal Processing (ICASSP 97), Vol. IV. 1997.
  8. Kyung-Shik, Jang, "Facial Features Detection Using Heuristic Cost Function," The KIPS transactions. Part B., Vol.8B, No.2, pp.183-188, 2001
  9. Bo Whan Won, Ja Young Koo, "Rotated Face Detection Using Symmetry Detection," Journal of The Korea Society of Computer and Information, Vol.16, No.1, pp.53-59, Jan., 2011.
  10. Chulhan Lee, minYi Jung, Jongsun Kim, "A Method of Generating Changeable Face Template for Statistical Appearance-Based Face Recognition," Journal of the Institute of Electronics Engineers of Korea. SP, Vol.44, No..314, pp.27-36, 2007.
  11. Viola, P, Jones, M, "Rapid object detection using a boosted cascade of simple features," IEEE Computer Vision and Pattern Recognition, Vol.1, pp.511-518, Apr. 2001.
  12. A. R. Mohan and N. Sudha, "Fast face detection using boosted eigenfaces," IEEE Symposium on Industrial Electronics & Applications, Vol.2, pp.1002 -1006, 2009.
  13. Hyun-Chul Kim, Daijin Kim, "Face Recognition using LDA Mixture Model," Journal of KIISE, Vol.32, No.8, 693-833, Aug., 2005.
  14. C. C. Tsai et al, "Face Detection Using Eigenface and Neural Network," IEEE Intl. Conf. on Systems, Man and Cybernetics, Vol.5, pp.4343-4347, 2006.
  15. Kung-Ah Lee, Dae-Jong Lee, "Face Recognition Using Wavelet Coefficients and Hidden Markov Model," Journal of Fuzzy Logic and Intelligent Systems , Vol.13, No.6, pp.673-678, Dec., 2003. https://doi.org/10.5391/JKIIS.2003.13.6.673
  16. Viola and Jones, "Rapid object detection using boosted cascade of simple features," Computer Vision and Pattern Recognition, pp.1-9, 2001.
  17. Papageorgiou, Oren and Poggio, "A general framew ork for object detection," International Conference on Computer Vision, pp.555-562, 1998.
  18. Rob Schapire, "Strength of Weak Learnability," Machine Learning, vol.5, pages 197-227. 1990.
  19. Yoav Freund, Robert E. Schapire, "A Decision-Theoretic Generalization of on-Line Learning and an Application to Boosting," Vol.904, pp.23-37, 1995.
  20. L. Sirovich and M. Kirby, "Low-dimensional procedure for the characterization of human faces," Journal of the Optical Society of America A 4: 519-524, 1987. https://doi.org/10.1364/JOSAA.4.000519