Face Deformation Technique for Efficient Virtual Aesthetic Surgery Models

효과적인 얼굴 가상성형 모델을 위한 얼굴 변형 기법

  • Park Hyun (Dept. of Computer Science and Engineering, Hanyang University) ;
  • Moon Young Shik (Dept. of Computer Science and Engineering, Hanyang University)
  • 박현 (한양대학교 컴퓨터공학과) ;
  • 문영식 (한양대학교 컴퓨터공학과)
  • Published : 2005.05.01

Abstract

In this paper, we propose a deformation technique based on Radial Basis Function (RBF) and a blending technique combining the deformed facial component with the original face for a Virtual Aesthetic Surgery (VAS) system. The deformation technique needs the smoothness and the accuracy to deform the fluid facial components and also needs the locality not to affect or distort the rest of the facial components besides the deformation region. To satisfy these deformation characteristics, The VAS System computes the degree of deformation of lattice cells using RBF based on a Free-Form Deformation (FFD) model. The deformation error is compensated by the coefficients of mapping function, which is recursively solved by the Singular Value Decomposition (SVD) technique using SSE (Sum of Squared Error) between the deformed control points and target control points on base curves. The deformed facial component is blended with an original face using a blending ratio that is computed by the Euclidean distance transform. An experimental result shows that the proposed deformation and blending techniques are very efficient in terms of accuracy and distortion.

본 논문에서는 가상성형 시스템에 적합한 Radial Basis Function(RBF) 기반의 변형 기법과 변형된 얼굴 구성 요소를 얼굴 영상에 혼합하는 기법을 제시한다. 가상성형을 위한 변형 기법은 유동적인 얼굴 구성 요소들을 변형함에 있어 부드러움과 정확성을 가져야 하고 변형 부위 이외의 다른 얼굴 구성 요소에는 왜곡을 주지 않는 지역성도 가져야 한다. 이를 위해 제안된 가상성형 시스템은 자유형태 변형 모델을 기반으로 RBF에 의해 격자들의 변형 정도를 계산한다. 성형의 정확성을 위해 변형 오차는 기준곡선 정점들의 목표 위치와 실제 변형된 위치 사이의 오차제곱합을 이용하여 Singular Value Decomposition(SVD)에 의해 반복적으로 RBF 매핑 함수의 계수들을 계산하여 보정한다. 변형된 얼굴 구성 요소는 Euclidean Distance Transform(EDT)에 의해 계산된 혼합 비율을 사용하여 원본 얼굴 영상과 합성된다. 제안된 변형 기법과 합성 기법은 가상성형 결과의 정확도와 왜곡 측면에서 우수한 성능을 보인다는 것을 실험적으로 확인하였다.

Keywords

References

  1. 김영인, '해부학적 연조직 변형모델에 기반한 얼굴 기형 수술의 3차원 가시화,' 고려대학교 학위논문, 2001
  2. D. Massaro, Perceiving Talking Faces: From Speech Perception to a Behavioral Principle, MIT Press, 1998
  3. E. Keeve, S. Girod, R. Kininis, and B. Girod, 'Deformable Modeling of Facial Tissue for Craniofacial Surgery Simulation,' Computer Aided Surgery, Vol. 3, pp.228-238, March 1999 https://doi.org/10.1002/(SICI)1097-0150(1998)3:5<228::AID-IGS2>3.0.CO;2-I
  4. Y. Wu, P. Beylot and N. M. Thalmann, 'Skin Aging Estimation by Facial Simulation,' Computer Animation 1999. pp.210-219, May 1999 https://doi.org/10.1109/CA.1999.781214
  5. R. M. Koch, M. H. Gross and E. R. Crals, 'Simulating Facial Surgery Using Finite Element Models,' SIGGRAPH 96 Conference Proceeding, pp.421-428, August 1996 https://doi.org/10.1145/237170.237281
  6. S. Y. Lee, G. Wolberg, K. Y. Chwa and S. Y. Shin, 'Image Metamorphosis with Scattered Feature Constraints,' IEEE Transaction on Visualization and Computer Graphics, Vol. 2, No. 4, December 1996 https://doi.org/10.1109/2945.556502
  7. J. Gomes, L. Darsa, B. Costa and L. Velho, Warping and Morphing of Graphical Objects, Morgan Kaufmann Publishers, 1999
  8. T. Beier and S. Neely, 'Feature-Based Image Metamorphosis,' 19th Annual Conference on Computer Graphics and Interactive Techniques, Vol. 26, pp.35-42, 1992 https://doi.org/10.1145/133994.134003
  9. D. T. Lin and H. Huang, 'Facial Expression Morphing and Animation with Local Warping Methods,' ICIAP, 1999 https://doi.org/10.1109/ICIAP.1999.797661
  10. J. Y. Noh, D. Fidaleo and U. Neumann, 'Animated Deformations With Radial Basis Functions,' Virtual Reality Software and Technology, VRST 2000 https://doi.org/10.1145/502390.502422
  11. T. Milliron, R. J. Jensen, and R. Barzel, 'A Framework for Geometric Warps and Deformations,' ACM Transaction on Graphics, Vol. 21, No.1, pp.20-51, January 2002 https://doi.org/10.1145/504789.504791
  12. A. W. Toga, Brain Warping, Academic Press, 1999
  13. M. Eck, 'Interpolation Methods for Reconstruction of 3D Surfaces from Sequences of Planar Slices,' CAD und Computergraphic, Vol. 13, No. 5, pp.109-120, Feb. 1991
  14. D. Ruprecht and H. Muller, 'Image Warping with Scattered Data Interpolation,' IEEE Computer Graphics and Applications, Vol. 15, No.2, pp.37-43, 1995 https://doi.org/10.1109/38.365004
  15. H. Breu, J. Gil, D. Kirkpatrick and M. Weman, 'Linear Time Euclidean Distance Transform Algorithm,' IEEE Transaction on Pattern Analysis and Machine Intelligence, Vol. 17, No. 5, pp.529-533, May 1995 https://doi.org/10.1109/34.391389
  16. K. Rohr, 'Spline-Based Elastic Image Registration,' In Annual Scientific Conf. GAMM'2003, pp.22-23, March 2003
  17. T. Schoepflin, V. Chalana, D. R. Haynor and Y. M. Kim, 'Video Object Tracking With a Sequential Hierarchy of Template Deformations,' IEEE Transaction on Circuits and System for Video Technology, Vol. 11, No. 11, pp.1171-1182, 2001 https://doi.org/10.1109/76.964784