The KIPS Transactions:PartB (정보처리학회논문지B)

Korea Information Processing Society (한국정보처리학회)
권호 표지

Video Data Scene Segmentation Method Using Region Segmentation

영역분할을 사용한 동영상 데이터 장면 분할 기법

  • 염성주 (광운대학교 대학원 컴퓨터과학과) ;
  • 김우생 (광운대학교 컴퓨터공학부)
  • Published : 2001.10.01
Download PDF
⟨ Previous Next ⟩

Abstract

Video scene segmentation is fundamental role for content based video analysis. In this paper, we propose a new region based video scene segmentation method using continuity test for each object region which is segmented by the watershed algorithm for all frames in video data. For this purpose, we first classify video data segments into classes that are the dynamic and static sections according to the object movement rate by comparing the spatial and shape similarity of each region. And then, try to segment each sections by grouping each sections by comparing the neighbor section sections by comparing the neighbor section similarity. Because, this method uses the region which represented on object as a similarity measure, it can segment video scenes efficiently without undesirable fault alarms by illumination and partial changes.

동영상 데이터의 장면 분할은 내용기반 분석을 위해 필요한 기초작업이다. 본 논문에서는 동영상의 매 프레임을 워터쉐드 알고리즘을 통해 객체 중심의 작은 영역들로 나누어 각 영역이 연속적인 프레임 상에서 계속 존재하는가를 파악하는 방법을 통해 장면을 구분하는 새로운 영역기반 장면 분할 기법을 제안한다. 이를 위해 각 영역들에 대한 형태와 공간상의 유사도를 측정해 영역들의 움직임 정도에 따라 동영상 데이터를 동적 구간과 정적 구간으로 나누고 인접한 구간간의 유사도에 따라 그룹화 하는 방법을 통해 장면 분할을 시도한다. 제안하는 기법은 객체들을 표현하는 각 영역을 비교 대상으로 삼기 때문에 명암 변화나 변화에도 오검출 하지 않으면서 효과적으로 장면을 구분해낼수 있는 장점을 갖는다.

Keywords

References

  1. ISO/IEC JTC1/SC29/WG11, 'MPEG-7 Requirements Document V.5,' MPEG98/N2208, Tokyo, March, 1998
  2. John S. Boreczky, Lawrence A. Rowe, 'Comparision of video shot boundary detection techniques,' in Storage & Retrieval for Image and Video Database IV, Proc. of SPIE 2670, pp.170-179, 1996 https://doi.org/10.1117/12.234794
  3. W. Zhao, J. Wang, D. Bhat, K. Sakiewicz, N. Nandhakumar, W. Chang, 'Improving Color Based Video Shot Detection,' IEEE Int. Conf. On Multimedia Computing and Systems, Vol.2, pp.752-756, 1999 https://doi.org/10.1109/MMCS.1999.778579
  4. http://www.youngdosc.co.kr/~cinemos/transition.htm
  5. Yoshinobu Tonomura, 'Video handling based on structured information for hypermedia systems,' ACM Proc. of international conference on Multimedia Information Systems '91, pp.333-344, 1991
  6. Akio Nagasaka, Yuzuru Tanaka, 'Automatic Video indexing and full video search for object appearance,' 2nd Working Conference on Visual Database Systems, Oct., 1991
  7. Hirotada Ueda, Takafumi Miyatake, Satoshi Toshizawa, 'IMPACT : An Interactive natural motion picture dedicated Multimedia Authoring system,' CHI'91 Conference Proceedings, pp.343-350, 1991
  8. Jurgen Stauder, Henri Nicolas, 'Motion-Based Video Indexing Evaluating Object Shading,' In Proceedings of ICIP, Kobe, October, 1999 https://doi.org/10.1109/ICIP.1999.817114
  9. 추호진, 이광호, 최철, 최영괸, 윤핑영, 조성민, 박장춘, '비디오 시퀀스에서의 영역분할을 이용한 장면전환 검출 방법의 제안', 한국정보처리학회 춘계 학술발표논문집, 제 8권 제1호, pp.879-882, 2001
  10. HJ, Zhang, A. Kankanhalli, S. W. Smoliar, 'Automatic partitioning of full-motion video,' Multimedia Systems, Vol1, No.1, pp.10-28, 1993 https://doi.org/10.1007/BF01210504
  11. W. A. C. Fernando, C. N. Canagarajah, D. R. Bull, 'Wipe Scene Change Detection in Video Sequences,' In Proceedingd of ICIP-99, 1999 https://doi.org/10.1109/ICIP.1999.817120
  12. Min Wu, Wayne Wolf, Bede Liu, 'An Algorithm For Wipe Detection,' In Proceedings of ICIP-98, Chicago, 1998
  13. Dalong Li, Hanqing Lu, 'Model Based Video Segmentation,' The IEEE Workshop on Signal Processing Systems, pp.120-129, 2000 https://doi.org/10.1109/SIPS.2000.886710
  14. C. W. Ngo, T. C. Pong, R. T. Chin, 'Detection of Gradual Transitions through Temporal Slice Analysis,' Proc. IEEE CVPR99, pp.36-41, June, 1999 https://doi.org/10.1109/CVPR.1999.786914
  15. J. Bescos, J. M. Martinez, J. Cabrera, J. M. Menedez, G. Cisneros, 'Gradual Shot Transition Detection Based on Multidimensional Clustering,' Proceedings of the 4th IEEE Southwest Symposium on Image Analysis and Interpretation, 2000 https://doi.org/10.1109/IAI.2000.839570
  16. Emile Sahouria, Avideh Zakkor, 'Content Analysis of Video Using Principal Components,' IEEE Transactions on circuits and systems for video technology, Vol.9, No.8, Dec. 1999 https://doi.org/10.1109/76.809163
  17. Ramin Zabih, Justin Miller, Kevin Mai, 'A Feature-Based Algorithm for Detecting and Classifying Scene Breaks,' ACM Multimedia, pp.189-200, 1995 https://doi.org/10.1145/217279.215266
  18. W. J. Heng, K. N. Ngam, 'The Implementation of Object-Based Shot Boundary Detection using Edge Tracing and Tracking,' IEEE International Conference on Image Processing (ICIP '99), Japan, 1999
  19. H. Yu, G. Bozdagi, S. Harrington, 'Feature-based Hierarchical Video Segmantation,' ICIP'97, Santa Barbara, Sep, 1997 https://doi.org/10.1109/ICIP.1997.638817
  20. 임문철, 김우생, '동시정보 행렬 분석을 이용한 워터쉐드 영상분할', 한국정보처리학회논문지, 제8-B권 제1호, 2001
  21. Minerva Yeung, Boon-Lock Yeo, Bede Liu, 'Extracting Stroy Units from Long Programs for Video Browsing and Navigation,' Proceedings of Multimedia '96, pp.296-305, 1996 https://doi.org/10.1109/MMCS.1996.534991
  22. Makoto Miyahara, Yasuhiro Yoshida, 'Mathematical transform of (R, G, B) color data to Munsell (H, V, C) color data,' SPIE Visual Communication and Image Processing '88, Vol.1001, pp.650-657, 1988