Journal of Korea Multimedia Society (한국멀티미디어학회논문지)

Korea Multimedia Society (한국멀티미디어학회)
권호 표지

Online Face Avatar Motion Control based on Face Tracking

  • Wei, Li (Department of Information Communication Engineering, TongMyong University) ;
  • Lee, Eung-Joo (Department of Information Communication Engineering, TongMyong University)
  • Published : 2009.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, a novel system for avatar motion controlling by tracking face is presented. The system is composed of three main parts: firstly, LCS (Local Cluster Searching) method based face feature detection algorithm, secondly, HMM based feature points recognition algorithm, and finally, avatar controlling and animation generation algorithm. In LCS method, face region can be divided into many small piece regions in horizontal and vertical direction. Then the method will judge each cross point that if it is an object point, edge point or the background point. The HMM method will distinguish the mouth, eyes, nose etc. from these feature points. Based on the detected facial feature points, the 3D avatar is controlled by two ways: avatar orientation and animation, the avatar orientation controlling information can be acquired by analyzing facial geometric information; avatar animation can be generated from the face feature points smoothly. And finally for evaluating performance of the developed system, we implement the system on Window XP OS, the results show that the system can have an excellent performance.

Keywords

References

  1. Haibo Wangy, Chunhong Pan, Christophe Chaillou, Jeremy Ringard, "An Online Face Avatar under Natural Head Movement," IEEE International Conf. on Automatic Face and Gesture Recognition (ECAG08), Amsterdam, Sep. 16, 2008.
  2. Xiaozhou Wei, Zhiwei Zhu, Lijun Yin and Qiang Ji, "A Real Time Face Tracking and Animation System," IEEE International Conf. on Computer Vision and Pattern Recognition Workshop, pp. 71-71, June 27. 02. 2004.
  3. C. Tomasi and T. Kanade, "Detection and Tracking of Point Features," Carnegie Mellon University Technical Report, (CMU-CS-91-132), Apr. 1991.
  4. Matthew Turk, Changbo Hu, Rogeria Feris, Farshid Lashkari, Andy Beall, "TLA Based Face Tracking," The 15th International Conference on Vision Interface, May 2002.
  5. Feng Jiao, Stan Li, Heung-Yeung Shum, Dale Schuurmans, "Face Alignment Using Statistical Models and Wavelet Features," Proc. of IEEE CVPR, 2003.
  6. Z. Zhang, "Feature-based facial expression recognition: Experiments with a multi-layer perception," Technical Report INRIA, pp. 335, 1998.
  7. P. Viola and M. Jones , "Robust Real-time Object Detection" , Proc. of 2nd International Workshop on Statistical and Computational Theories of Vision- Modeling, Learning, Computing and Sampling, pp. 1-25, July 2001.
  8. L. Rabiner, "A Tutorial on Hidden Markov Models and Selected Applications in Speech Recognition," Proc. of IEEE, Vol.77, No.2, pp. 257-286, 1989. https://doi.org/10.1109/5.18626
  9. Lou and H.-L. "Implementing the Viterbi algorithm," IEEE Journal on Signal Processing Magazine, Vol.12, No.5, pp. 42-52, Sept. 1995. https://doi.org/10.1109/79.410439
  10. Li Wei, E. J. Lee and S. Y. Ok, "Automatic Camera Pose Determination from a Single Face Image," Journal of Korea Multimedia Society, Vol.10, No.12, pp. 1566-1576, Dec. 2007.
  11. Li Wei, E.J. Lee, "Human Head Mouse System Based on Facial Gesture Recognition," Journal of Korea Multimedia Society, Vol.10, No.12, pp. 1591-1600, Dec. 2007.
  12. Z. Zhu, K. Fujimura, Q. Ji, "Real- Time Eye Detection and Tracking Under Various Light Conditions and Face Orientations", 2002 ACM SIGCHI Symposium on Eye Tracking Research & Applications, New Orleans, LA, 2002.