Journal of the Institute of Electronics Engineers of Korea CI (전자공학회논문지CI)

The Institute of Electronics and Information Engineers (대한전자공학회)
권호 표지

Region-based Content Retrieval Algorithm Using Image Segmentation

영상 분할을 이용한 영역기반 내용 검색 알고리즘

  • 이강현 (조선대학교 전자공학과)
  • Published : 2007.09.25
Download PDF
⟨ Previous Next ⟩

Abstract

As the availability of an image information has been significantly increasing, necessity of system that can manage an image information is increasing. Accordingly, we proposed the region-based content retrieval(CBIR) algorithm based on an efficient combination of an image segmentation, an image texture, a color feature and an image's shape and position information. As a color feature, a HSI color histogram is chosen which is known to measure spatial of colors well. We used active contour and CWT(complex wavelet transform) to perform an image segmentation and extracting an image texture. And shape and position information are obtained using Hu invariant moments in the luminance of HSI model. For efficient similarity computation, the extracted features(color histogram, Hu invariant moments, and complex wavelet transform) are combined and then precision and recall are measured. As a experimental result using DB that was supported by www.freefoto.com. the proposed image retrieval engine have 94.8% precision, 82.7% recall and can apply successfully image retrieval system.

영상 정보의 이용이 증가함에 따라 영상을 효율적으로 관리할 수 있는 시스템의 필요성이 증가하고 있다. 이에 따라, 본 논문에서는 영상 분할 알고리즘, 색상 특성, 질감, 그리고 영상의 형태와 위치 정보의 효율적인 결합에 근거한 영역기반 내용 검색 알고리즘을 제안한다. 색상 특징으로는 색상의 공간적인 상관관계를 잘 나타내는 HSI 색상 히스토그램을 선택하였고, 영상의 분할과 질감특성은 각각 Active control와 CWT(Complex wavelet transform)를 사용하였다. 그리고 형태와 위치 특징들은 HSI의 휘도 성분에서 불변 모멘트를 이용하여 추출하였다. 효율적인 유사도 측정을 위해 추출된 특징(색상 히스토그램, Hu 불변 모멘트, CWT)을 결합하여 정확도와 재현율을 측정하였다. www. freefoto.com에서 제공하는 DB를 사용하여 실험한 결과, 제안된 검색엔진은 94.8%의 정확도와 82.7%의 재현율을 가지며 성공적으로 영상 검색 시스템에 응용할 수 있다.

Keywords

References

  1. M. J. Swain and D. H. Ballard, 'Color indexing,' Int. J. Comput. Vis., vol. 7, no. 1, pp. 11-32, 1991 https://doi.org/10.1007/BF00130487
  2. M. Stricker and M. Orengo, 'Similarity of color images,' SPIE: Storage Retrieval Image and Video Database III, vol. 2420, pp. 381-392, Feb. 1995
  3. Y. Gong, H. Zhang, H. Chuant, and M. Skauuchi, 'An image database system with content capturing and fast image indexing abilities,' in Proc. Int. Conf. Multimedia Computing and Systems,May 1994, pp. 121-130
  4. 'ISO/IEC 15938-3/FDIS Information Technology-Multimedia Content Description Interface-part 3 Visual,' ISO/IEC/JTC1/SC29/ WG11, Doc. N4358, Sydney, Australia. July 2001
  5. Kian-Lee Tan, Beng Chin Ooi, Chia Yeow Yee, 'An Evaluation of Color-Spatial Retrieval Techniques for large Databases,' Multimedia Tools and Applications, vol. 14, pp. 55-78, 2001 https://doi.org/10.1023/A:1011359607594
  6. R. M. Haralick, K. Shanmugam, and I. Dinstein, 'Texture features for image classification,' IEEE Trans. Syst. Man Cybern., vol. 8, pp. 610-621, Nov. 1973
  7. K. S. Thyagarajan, T. Nguyen, and C. Persons, 'A maximum likelihood approach to texture classification using wavelet transform,' in Proc. of IEEE Conf. on Image Processing, pp. 640-644, Austin, USA, Nov. 1994
  8. Jing Huang, S. Ravi Kumar, Mandar Mitra, Wei-Jing Zhu, and Ramin Zabih, 'Image indexing using color correlograms,' in Proc. of Recognition, pp. 762-768, Virginia, USA, July 1997
  9. J. R. Smith, S. F. Chang, 'Integrated Spatial and Feature Image Query,' Multimedia Systems, vol. 7, pp. 129-140, March 1999 https://doi.org/10.1007/s005300050116
  10. Y. Rui and T. S. Huang, 'Image retrieval: Current techniques, promising directions, and open issues,' J. Visual Communication and Image Representation, vol. 10, no. 4, pp. 39-62, Oct. 1999 https://doi.org/10.1006/jvci.1999.0413
  11. L. Cinque, S. Levialdi, K.A. Olsen, A. Pellicano, 'Color-Based Image Retrieval Using Spatial Chromatic Histograms,' In Proc. of the Multimedia Systems, vol. 2, pp. 969-973, June 1999
  12. D. Feng, W. C. Siu, and H. J. Zhang, Multimedia Information Retrieval and Management-Technological Fundamentals and Applications, Springer, pp. 4-24, 2003
  13. M. Flickner, H. Sawhney, W. Niblack, and J. Ashley, 'Query by image and video content: The QBIC system,' IEEE Computer, vol. 28, no. 9, pp. 23-32, Sep. 1995
  14. W. Y. Ma and B. S. Manjunath, 'Netra: A toolbox for navigating large image database,' in Proc. Int. Conf. Image Processing, vol. 1, 1997, pp. 568-571
  15. J. R. Smith and S. F. Chang, 'VisualSEEk: A fully automated contentbased image query system,' ACM Multimedia, pp. 87-98, 1996
  16. M. Carson, S. Thomas, J. M. Belongie, and J. Malik, 'Blobworld: A system for region-based image indexing and retrieval,' in Proc. Int. Conf. Visual Information Systems, 1999, pp. 509-516
  17. J. Li, J. Z.Wang, and G.Wiederhold, 'IRM: Integrated region matching for image retrieval,' ACM Multimedia, pp. 147-156, 2000
  18. ByoungChul Ko, Hyeran Byun, 'FRIP: A Region-Based Image Retrieval Tool Using Automatic Image Segmentation and Stepwise Boolean AND Matching,' IEEE Multimedia, Vol. 7, NO. 1, Feb. 2005
  19. B. Moghaddam, H. Biermann, and D. Margaritis, 'Defining image content with multiple regions-of-interest,' in Proc. IEEE Workshop on CBAIVL, 1999, pp. 89-93
  20. Q. Tian, Y. Wu, and S. Thomas, 'Combine user defined region-of-interest and spatial layout for image retrieval,' in Proc. IEEE Int. Conf. Image Processing, vol. 3, 2000, pp. 746-749
  21. Chunming Li, Chenyang Xu, Changfeng Gui, and Martin D. Fox, 'Level Set Evolution Without Re-initialization: A New Variational Formulation,' IEEE Computer Society Conf. on Computer Vision and Pattern Recognition Proc., CVPR'05, 2005
  22. N. G. Kingsbury, 'Image processing with complex wavelet,' Phil. Trans. Roy. Soc. London A, vol. 357, pp. 2543-2560, Sep. 1999 https://doi.org/10.1098/rsta.1999.0447
  23. Papoulis, 'Probability, Random Variables, and Stochastic Processes,' McGraw Hill, 1965
  24. Morton Nadler and Eric P. Smith, 'Pattern Recognition Engineering,' Wiley-Interscience, pp.197-199, 1993
  25. Cho-Huak Teh and Roland T. Chin, 'On Digital Approximation of Moment invariants,' Computer Vision, Graphics, And Image Processing, Vol. 33, pp. 318-326, 1986 https://doi.org/10.1016/0734-189X(86)90180-5
  26. M. K. Hu, 'Pattern recognition by moment invariants,' Proc. IEEE, vol. 49, no. 9, pp. 1428,Sept. 1961
  27. Y. K. Chun, J. K. Sung and N. C. Kim, 'Image Retrieval using Multiresolution Color and Texture Features in Wavelet Transform Domain,' Journal of The Institute of Electronics Engineers of Korea, Vol. 43-SP, NO. 1, January 2006