Segmentation and Tracking Algorithm for Moving Speaker in the Video Conference Image

화상회의 영상에서 움직이는 화자의 분할 및 추적 알고리즘

  • Choi Woo-Young (Division of Electronic, Information & Communication Eng., Myongji University) ;
  • Kim Han-Me (Dept. of Electronic Eng., Graduate School of Myongji Universty)
  • 최우영 (명지대학교 전자정보통신공학부) ;
  • 김한메 (명지대학교 대학원 전자공학과)
  • Published : 2002.07.01

Abstract

In this paper, we propose the algorithm for segmenting the moving speaker and tracking its movement in the video conference image. For real time processing, we simplify the algorithm which is processed in the order of the segmenting and the tracking step. In the segmenting step, the speaker object is segmented from the image by using both the motion information obtained from the difference method and the illuminance information of image. The reference mask image is created from segmented speaker object. In the tracking step, the moving speaker is tracked by using simple block matching algorithm of which computation time is reduced by discarding the blocks which are classified into the unuseful blocks. In the simulation, we can get the good result of segmenting and tracking the moving speaker by applying the proposed algorithm to several test images.

본 논문에서는 화상회의 영상 데이터에서 화자를 분할하고, 그 움직임을 추적하는 알고리즘을 제안하였다. 실시간 처리가 가능하도록 화자 분할과 움직임 추적 순으로 처리되는 알고리즘으로 단순화하였다. 분할 한계에서는 차분 방법에 의해 구한 움직임 정보와 영상의 밝기 정보를 사용하여 화자를 분할하였다. 분할된 화자로부터 기준 마스크 영상을 생성하였다. 움직임 추적 단계에서는 움직임 추적에 불필요한 블록들은 제외함으로써 빠르게 움직임을 추적할 수 있는 블록정합 알고리즘을 사용하여 추적하였다. 시뮬레이션에서 여러 시험 영상에 제안한 알고리즘을 적용하여 움직이는 화자를 분할하고, 그 움직임를 추적하는 올바른 결과를 얻을 수 있었다.

Keywords

References

  1. IEEE International Conference on Acoustics, Speech, and Signal Processing v.6 Motion-driven Object Segmentation in Scale-space E. Izuierdo M.;M. Ghanbari
  2. IEEE Trans. Circuits Syst. Video Technol. v.9 no.4 Disparity/Segmentation Analysis:Matching with an Adaptive Window and Depth-Driven Segmentation E. Izquierdo
  3. IEEE Second Workshop on Multimedia Signal Processing Fast Video Object Segmentation using Affine Motion and Gradient-based Color Clustering Ju Guo;Jungwon Kim;Kuo, C.-C.J.
  4. Vision, Image and Signal processing, IEE Proceedings v.146 no.3 Segmentation and Tracking of Moving Objects for Content-Based Video Coding T. Meier;K. N. Ngan
  5. IEEE Trans. Circuits Syst. Video Technol. v.10 no.4 Semi-automatic Video Object Segmentation in the Presence of Occlusion C. Toklu;A. Murat Tekalp;A. Tanju Erdem
  6. Image and Vision Computing v.19 no.5 Moving Object Segmentation in Video Sequences by User Interaction and Automatic Object Tracking Munchurl Kim;J.G. Jeon;J.S. Kwak;M.H. Lee;C. Ahn
  7. Image and video compression for multimedia engineering : fundamentals, algorithms, and standards Y. Q. Shi;H. Sun
  8. IEEE Trans. Commun. v.29 Displacement Measurement and its Application in Interframe Image Coding J. R. Jain;A. K. Jain
  9. Proc. National Telecommun. Conf. Motion Compensated Interframe Coding for Video Conferencing T. Koga;K. Iinuma;A. Hirano;Y. Iijima;T. Ishiguro
  10. IEEE Inter. Conf. on Commun. Predictive Coding based on Efficient Motion Estimation R. Srinivasan;K. R. Rao
  11. IEEE Trans. Commun. v.38 no.7 The Cross Search Algorithm for Motion Estimation M. Ghanbari
  12. Proc. IEEE ICASSP'87 An Efficient Block Matching Algorithm for Motion Compensated Coding A. Puri;H. M. Hang;D. L. Schilling