Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

GLIBP: Gradual Locality Integration of Binary Patterns for Scene Images Retrieval

  • Received : 2015.05.26
  • Accepted : 2016.01.19
  • Published : 2018.04.30
Download PDF
⟨ Previous Next ⟩

Abstract

We propose an enhanced version of the local binary pattern (LBP) operator for texture extraction in images in the context of image retrieval. The novelty of our proposal is based on the observation that the LBP exploits only the lowest kind of local information through the global histogram. However, such global Histograms reflect only the statistical distribution of the various LBP codes in the image. The block based LBP, which uses local histograms of the LBP, was one of few tentative to catch higher level textural information. We believe that important local and useful information in between the two levels is just ignored by the two schemas. The newly developed method: gradual locality integration of binary patterns (GLIBP) is a novel attempt to catch as much local information as possible, in a gradual fashion. Indeed, GLIBP aggregates the texture features present in grayscale images extracted by LBP through a complex structure. The used framework is comprised of a multitude of ellipse-shaped regions that are arranged in circular-concentric forms of increasing size. The framework of ellipses is in fact derived from a simple parameterized generator. In addition, the elliptic forms allow targeting texture directionality, which is a very useful property in texture characterization. In addition, the general framework of ellipses allows for taking into account the spatial information (specifically rotation). The effectiveness of GLIBP was investigated on the Corel-1K (Wang) dataset. It was also compared to published works including the very effective DLEP. Results show significant higher or comparable performance of GLIBP with regard to the other methods, which qualifies it as a good tool for scene images retrieval.

Keywords

References

  1. A. W. M. Smeulders, M. Worring, S. Santini, A. Gupta, and R. Jain, "Content-based image retrieval at the end of the early years," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 22, no. 12, pp. 1349-1380, 2000. https://doi.org/10.1109/34.895972
  2. M. J. Swain and D. H. Ballard, "Color indexing," International Journal of Computer Vision, vol. 7, no. 1, pp. 11-32, 1991. https://doi.org/10.1007/BF00130487
  3. M. A. Stricker and M. Orengo, "Similarity of color images," in Proceedings of the SPIE 2420: Storage and Retrieval for Image and Video Databases III. Bellingham, WA: International Society for Optics and Photonics, 1995, pp. 381-393.
  4. G. Pass and R. Zabih, "Histogram refinement for content-based image retrieval," in Proceedings of the 3rd IEEE Workshop on Applications of Computer Vision, Sarasota, FL, 1996, pp. 96-100.
  5. R. M. Haralick, "Statistical and structural approaches to texture," Proceeding of the IEEE, vol. 67, no. 5, pp. 786-804, 1979. https://doi.org/10.1109/PROC.1979.11328
  6. T. Ojala, M. Pietikainen, and D. Harwood, "A comparative study of texture measures with classification based on feature distributions," Pattern Recognition, vol. 29, no. 1, pp. 51-59, 1996. https://doi.org/10.1016/0031-3203(95)00067-4
  7. S. Murala, A. B. Gonde, and R. P. Maheshwari, "Color and texture features for image indexing and retrieval," in Proceedings of the IEEE International Advance Computing Conference, Patiala, India, 2009, pp. 1411-1416.
  8. S. M. Singh and K. Hemachandran, "Content-based image retrieval using color moment and Gabor texture feature," International Journal of Computer Science Issues, vol. 9, no. 5, pp. 299-309, 2012.
  9. M. Singha and K. Hemachandran, "Content based image retrieval using color and texture," Signal & Image Processing, vol. 3, no. 1, pp. 39-57, 2012. https://doi.org/10.5121/sipij.2012.3104
  10. X. Y. Wang, Y. J. Yu, and H. Y. Yang, "An effective image retrieval scheme using color, texture and shape features," Computer Standards & Interfaces, vol. 33, no. 1, pp. 59-68, 2011. https://doi.org/10.1016/j.csi.2010.03.004
  11. M. V. Lande, P. Bhanodiya, and P. Jain, "An effective content-based image retrieval using color, texture and shape feature," in Intelligent Computing, Networking, and Informatics. New Delhi, India: Springer, 2014, pp. 1163-1170.
  12. J. Wan, D. Wang, S. C. H. Hoi, P. Wu, J. Zhu, Y. Zhang, and J. Li, "Deep learning for content-based image retrieval: a comprehensive study," in Proceedings of the 22nd ACM International Conference on Multimedia, Orlando, FL, 2014, pp. 157-166.
  13. Q. Xu, S. Jiang, W. Huang, F. Ye, and S. Xu, "Feature fusion based image retrieval using deep learning," Journal of Information & Computational Science, vol. 12, no. 6, pp. 2361-2373, 2015. https://doi.org/10.12733/jics20105681
  14. D. G. Lowe, "Object recognition from local scale-invariant features," in Proceedings of the 7th IEEE International Conference on Computer Vision, Kerkyra, Greece, 1999, pp. 1150-1157.
  15. K. Mikolajczyk and C. Schmid, "A performance evaluation of local descriptors," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 27, no. 10, pp. 1615-1630, 2005. https://doi.org/10.1109/TPAMI.2005.188
  16. S. A. J. Winder and M. Brown, "Learning local image descriptors," in Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, Minneapolis, MN, 2007, pp. 1-8.
  17. E. Tola, V. Lepetit, and P. Fua, "DAISY: an efficient dense descriptor applied to wide-baseline stereo," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 32, no. 5, pp. 815-830, 2010. https://doi.org/10.1109/TPAMI.2009.77
  18. S. Bougueroua and B. Boucheham, "Ellipse based local binary pattern for color image retrieval," in Proceedings of the 4th International Symposium on ISKO-Maghreb: Concepts and Tools for Knowledge Management, Algiers, Algeria, 2014, pp. 1-8.
  19. S. Murala, R. P. Maheshwari, and R. Balasubramanian, "Directional local extrema patterns: a new descriptor for content based image retrieval," International Journal of Multimedia Information Retrieval, vol. 1, no. 3, pp. 191-203, 2012. https://doi.org/10.1007/s13735-012-0008-2
  20. R. M. Haralick, K. Shanmugam, and I. Dinstein, "Textural features for image classification," IEEE Transactions on Systems, Man, and Cybernetics, vol. 3, no. 6, pp. 610-621, 1973. https://doi.org/10.1109/TSMC.1973.4309314
  21. F. Zhou, J. F. Feng, and Q. Y. Shi, "Texture feature based on local Fourier transform," in Proceedings of the International Conference on Image Processing, Thessaloniki, Greece, 2001, pp. 610-613.
  22. H. B. Kekre and D. Mishra, "CBIR using upper six FFT sectors of color images for feature vector generation," International Journal of Engineering and Technology, vol. 2, no. 2, pp. 49-54, 2010.
  23. F. Malik and B. Baharudin, "The statistical quantized histogram texture features analysis for image retrieval based on median and Laplacian filters in the DCT domain," The International Arab Journal of Information Technology, vol. 10, no. 6, pp. 1-9, 2013.
  24. H. B. Kekre and D. Mishra, "Content based image retrieval using full Haar sectorization," International Journal of Image Processing, vol. 5, no. 1, pp. 1-12, 2011. https://doi.org/10.1049/iet-ipr.2010.0135
  25. J. Z. Wang, G. Wiederhold, O. Firschein, and S. X. Wei, "Content-based image indexing and searching using Daubechies' wavelets," International Journal on Digital Libraries, vol. 1, no. 4, pp. 311-328, 1998. https://doi.org/10.1007/s007990050026
  26. B. S. Manjunath and W. Y. Ma, "Texture features for browsing and retrieval of image data," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 18, no. 8, pp. 837-842, 1996. https://doi.org/10.1109/34.531803
  27. T. Ojala, M. Pietikainen, and T. Maenpaa, "Multiresolution gray-scale and rotation invariant texture classification with local binary patterns," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 24, no. 7, pp. 971-987, 2002. https://doi.org/10.1109/TPAMI.2002.1017623
  28. H. Jin, Q. Liu, H. Lu, and X. Tong, "Face detection using improved LBP under Bayesian framework," in Proceedings of the 3rd International Conference on Image and Graphics, Hong Kong, China, 2004, pp. 306-309.
  29. X. Tan and B. Triggs, "Enhanced local texture feature sets for face recognition under difficult lighting conditions," in Analysis and Modeling of Faces and Gestures. Heidelberg: Springer, 2007, pp. 168-182.
  30. B. Zhang, Y. Gao, S. Zhao, and J. Liu, "Local derivative pattern versus local binary pattern: face recognition with high-order local pattern descriptor," IEEE Transactions on Image Processing, vol. 19, no. 2, pp. 533-544, 2010. https://doi.org/10.1109/TIP.2009.2035882
  31. P. V. N. Reddy and K. S. Prasad, "Content based image retrieval using local derivative patterns," Journal of Theoretical and Applied Information Technology, vol. 28, no. 2, pp. 95-103, 2011.
  32. Y. Xia, S. Wan, and L. Yue, "Local spatial binary pattern: a new feature descriptor for content-based image retrieval," in Proceedings of the 5th International Conference on Graphic and Image Processing, Hong Kong , China, 2013.
  33. V. Takala, T. Ahonen, and M. Pietikainen, "Block-based methods for image retrieval using local binary patterns," in Image Analysis. Heidelberg: Springer, 2005, pp. 882-891.
  34. J. Z. Wang, "Corel 1k (Wang)," [Online]. Available: http://wang.ist.psu.edu/docs/related/.
  35. J. Z. Wang, J. Li, and G. Wiederhold, "SIMPLIcity: semantics-sensitive integrated matching for picture libraries," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 23, no. 9, pp. 947-963, 2001. https://doi.org/10.1109/34.955109