The Transactions of the Korea Information Processing Society (한국정보처리학회논문지)

Korea Information Processing Society (한국정보처리학회)
권호 표지

A Block Based Temporal Segmentation Algorithm for Motion Pictures

동영상의 시간적 블록기반 영상분할 알고리즘

  • 이재도 (대구보건대학) ;
  • 박준호 (경운대학교 컴퓨터공학과) ;
  • 전대성 (대구미래대학 멀티미디어정보과학과) ;
  • 윤영우 (영남대학교 컴퓨터공학과) ;
  • 김상곤 (울산현대공업고등학교)
  • Published : 2000.05.01
Download PDF
⟨ Previous Next ⟩

Abstract

For the object-based video compression at very low bit rate, vieo segmentation is an essential part. In this paper, we propose a temporal video segmentation algorithms for motion pictures which is based on blocks. The algorithm is composed of three steps: (1) the change-detection, (2) the block merging, and (3) the block segmentation. The first step separates the change-detected region from background. Here, a new method for removing the uncovered region without motion estimation is presented. The second step, which is further divided into three substeps, estimates motions for the change-detected region and merges blocks with similar motions. The merging conditions for each substep as criteria are also given. The final step, the block segmentation, segments the boundary block that is excluded from the second step on a pixel basis. After describing our algorithm in detail, several experimental results along the processing order are shown step by step. The results demonstrate that the proposed algorithm removes the uncovered region effectively and produced objects that are segmented well.

Keywords

References

  1. ISO/IEC JTC1/SC29/WG11 N2459, 'Overview of the MPEG-4 Standard,' Atlantic City, Oct. 1998
  2. MPEG-4 Video Group, MPEG-4 Video Verifimtion Model Version, and Signal Processing, Munich, Germany, pp.2657-2660, April 1997
  3. F.Pereira, MPEG-4 : A New Challenge for the Representation of Audio- Visual Information, keynote speach at Picture Coding Symposium res '96, Melbourne, March, 1996
  4. P. Gerken, 'Object-Based Analysis-Synthesis Goding of Image Sequences at Very Low Bit Rates,' IEEE Transaction on Circuits and Systems for Video Technology: Special Issue on Very Low Bit Rate Video Coding. Vol.4, No.3, pp.228-235, June 1994 https://doi.org/10.1109/76.305868
  5. M. Hotter, 'Object-oriented analysis- synthesis cod ing based on moving two-demensional objects,' Signal Processing: Image Communication, Vol.2, No.4, pp.409-428, December 1990 https://doi.org/10.1016/0923-5965(90)90027-F
  6. H.G.Musmann, M.Hotter, J.Ostermann, 'Object-oriented analysis-synthesis coding of moving images,' Signal Processing Communication, Vol.1, No. 2, pp.117 -138, October 1989 https://doi.org/10.1016/0923-5965(89)90005-2
  7. J. Ostermann, 'Object-oriented analysis-synthesis Goding(OOASC) based on the source model of mov ing flexible 3D objects,' IEEE Trans. on Image Processing, Vol.3, No.5, September 1994 https://doi.org/10.1109/83.334972
  8. Norbert DIEHL, Signal Processing, Object-Orient ed Motion Estimation And Segmentation In Image Sequences, pp.23-56, 1991
  9. Michael DIEHL and Robert THOMA, Signal Processing, Image Segmentation Based On Objeded Oriented Mapping Parameter Estimation, pp.315-334, 1988
  10. CCITT, 'Draft revision of recommendation H.261 : Video coder for audio visual services at p ${\times}$ 64kbit/s,' Study Group XV, WNP/1/Q4, Specialist group on coding for visual telephony, Doc, No. 584, November 1989
  11. ITU-T, 'Video coding for narrow telecommunication channel at 64kbit/s,' Draft Recommendation H.263, January 1995
  12. Philippe Salembier, Signal Processing, Morpho logical Multiscale Segmentation for Image Coding, pp.359-386, 1994
  13. Milan Sonka, et. aI., Image Processing, Analysis and Machine Vision, pp.112-191, Chapman & hall Comp., 1993
  14. L. Vincent and P. Soille, 'Watersheds in digital spaces : an effecient algorithm based immersion simulations,' IEEE Trans. on PAMI, Vol.13, No.6, pp.583-598, June 1991 https://doi.org/10.1109/34.87344
  15. Luis Torres and Murat Kunt, Video Coding, pp.79-124, Academic Pub., 1996
  16. ISO/IEC JTC1/SC29/WG11 M2365, 'Core Experiment N2 : Preliminary FUB Result on combination of Automatic Segmentation Techniques,' Stockholm, July 1997
  17. ISO/IEC JTC1/SC29/WG11 2702, 'Description of automatic segmentation techniques developed and tested for MPEG-4 version 1,' Oct. 1997
  18. Roland Mech and Michael Wollhorn, ICASSP '97 Proceedings, A Noise Robust Method for Segmentation of Moving Objects in Video Sequences, pp. 2657-2660, 1997 https://doi.org/10.1109/ICASSP.1997.595335
  19. A. Murat Tekalp, Digital Video Processing, pp. 198-218, Prentice-Hall, 1995
  20. F.Dufaux and F.Moscheni, 'Motion Estimation Techniques for digital TV : a review and a new contribution,' Proc. IEEE, Vol.83, No.6, pp.858-876, June 1995 https://doi.org/10.1109/5.387089
  21. J. G. Choi, S.W.Lee and S.D.Kim, 'Segmentation and motion estimation of moving objects for object-oriented coding.' Proc. IEEE Int. Conf. Acoust., Speech and Signal Processing, Detroit, Ml. May 9-12, pp.2431-2434, 1995 https://doi.org/10.1109/ICASSP.1995.479984
  22. G. Adiv, 'Determining three-dimensional motion and structure from optical flow generated by several moving objects,' IEEE Trans. on PAMI, Vol.7, No.4, pp.384-401, July 1985
  23. Jae Gark Choi and Seong-Dae Kim, Signal Processing. Multi-stage Segmentation of Optical Flow Field, pp.109-118, 1996 https://doi.org/10.1016/S0165-1684(96)00100-4
  24. Jae Gark Choi, el. aI., Video Technology, Spatio-Temporal Video Segmentation Using a Joint Similarity Measure, pp.279-286. 1997 https://doi.org/10.1109/76.564107
  25. ISO/IEC JTC1/SC29/WG11 MPEG97/m2383, 'Combined Algorithm of ETRI, FUB and UH on core experiment N2 for automatic segmentation algorithm of moving objects,' July 1997
  26. ISO/IEC JTC1/SC29/WG11 MPEG97/m2091, 'Automatic segmentation based on spatio-temporal information,' April 1997
  27. S. Colonnese, U.Mascia, G.Russo, and C.Tabacco, 'Core Experiment N2 : Preliminary FUB Results on combination of FUB and UH Automatic Segmentation Techniques,' Contribution Decument number MPEG97/M1974 Bristol Meeting of ISO/IEC/JTCV SC29/WG11, April 1997