Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Interactive Semantic Image Retrieval

  • Patil, Pushpa B. (Dept. of Computer Science and Engineering, BLDEA's V. P. Dr. P. G. H. College of Engineering and Technology) ;
  • Kokare, Manesh B. (Dept. of Electronics and Telecommunication Engineering, SGGS, Institute of Engineering and Technology)
  • Received : 2012.11.18
  • Accepted : 2013.06.30
  • Published : 2013.09.30
Download PDF
⟨ Previous Next ⟩

Abstract

The big challenge in current content-based image retrieval systems is to reduce the semantic gap between the low level-features and high-level concepts. In this paper, we have proposed a novel framework for efficient image retrieval to improve the retrieval results significantly as a means to addressing this problem. In our proposed method, we first extracted a strong set of image features by using the dual-tree rotated complex wavelet filters (DT-RCWF) and dual tree-complex wavelet transform (DT-CWT) jointly, which obtains features in 12 different directions. Second, we presented a relevance feedback (RF) framework for efficient image retrieval by employing a support vector machine (SVM), which learns the semantic relationship among images using the knowledge, based on the user interaction. Extensive experiments show that there is a significant improvement in retrieval performance with the proposed method using SVMRF compared with the retrieval performance without RF. The proposed method improves retrieval performance from 78.5% to 92.29% on the texture database in terms of retrieval accuracy and from 57.20% to 94.2% on the Corel image database, in terms of precision in a much lower number of iterations.

Keywords

References

  1. R. Datta, D. Joshi, J. Li, and J. Z. Wang., "Image Retrieval: Ideas, Influences, and Trends of the New Age", ACM Computing Surveys, Vol. 40, No. 2 article 5, 2008, 5:1-5:60.
  2. Y. Rui, T. S. Hung, and S. F.Chang, "Image retrieval: Current Techniques, Promising Directions and Open Issues," J. Visual Comm. and Image Representation 10, (1999), pp. 39-62. https://doi.org/10.1006/jvci.1999.0413
  3. A. W. M Smeulders, M. Worring, S. Santini, A. Gupta, R. Jain, "Content-based Image Retrieval at the End of the Early Years," IEEE trans. Pattern Anal. Machine Intell. 22(12), 2000, pp.1349-1380. https://doi.org/10.1109/34.895972
  4. M. B. Kokare, P.K. Biswas, and B.N. Chatterji., "A Survey on Current Content-based Image Retrieval Methods," IETE J. Res. 48(3&4), 2002, pp. 261-271. https://doi.org/10.1080/03772063.2002.11416285
  5. Y. Rui, T. S. Huang, and S. Mehrotra,. "Relevance Feedback: A Power Tool in Interactive Content-Based Image Retrieval," IEEE Transactions on Circuits and Systems for Video Technology, Vol. 8(5), 1998, pp. 644-655. https://doi.org/10.1109/76.718510
  6. Y. Rui, T. S. Huang, and S. Mehrotra, "Content-based Image Retrieval with Relevance Feedback in MARS," in Proc. IEEE Int. Conf. on Image proc., 1997.
  7. S. D. MacArthur, C. E. Brodley, and C. R. Shyu, "Relevance Feedback Decision Trees in Content-based Image Retrieval," in Proc. IEEE Work-shop Content-based Access of Image and Video Libraries, 2000, pp.68-72.
  8. I. J. Cox, M.L. Miller, T.P. Minka, T.V.Papathomas, and P.N.Yianilos, "The Bayesian Image Retieval System, PicHunter: Theory, Implementation and Psychophysical Experiments," IEEE Tran. on Image Processing, vol. 9, Issue 1, (2000), pp.20-37. https://doi.org/10.1109/83.817596
  9. Z. Su H. Zhang, S. Li, and S. Ma, "Relevance Feedback in Content-based Image Retrieval: Bayesian framework, Feature Subspaces, and Progressive Learning," IEEE Trans. Image Process. vol. 12, no. 8, 2003, pp. 924-936. https://doi.org/10.1109/TIP.2003.815254
  10. S. Tong and E. Chang, "Support Vector Machines Active Learning for Image Retrieval," Proc. ACM Multimedia, 2001.
  11. K. Tieu and P. Viola, "Boosting image retrieval," in Proc. IEEE Conf. Computer Vision Pattern Recognition, 2003, pp. 228-235,
  12. Zhou, X. S. and Huang, T. S., "Relevance Feedback in image retrieval: A Comprehensive review," Multimedia systems, 8, 6, 2003, pp. 536-544. https://doi.org/10.1007/s00530-002-0070-3
  13. Zhi-Hua Zhou, Ke-Jia Chen, and Hong-Bin Dai, "Enhanced Relevance Feedback in Image Retrieval Using Unlabeled Data," ACM trans. on informations systems, vol.24, issue 2, 2006, pp. 219-244. https://doi.org/10.1145/1148020.1148023
  14. Marin Ferecatu, Nozha Boujemaa, Michel Crucianu, "Semantic interactive image retrieval combining visual and conceptual content description," ACM multimedia systems Journal, vol. 13, No. 5-6, 2008, pp. 309-322. https://doi.org/10.1007/s00530-007-0094-9
  15. C. H. Steven Hoi, R. L. Michael, and J. Rong ,"A Unified Log-Based Relevance Feedback Scheme for Image Retrieval," IEEE trans. on Knowledge and Data Engineering, vol. 18, no. 4, 2006.
  16. S. Tong and E. Chang, "Support vector machine active learning for image retrieval," In Proceedings of the 9th ACM international conference on Multimedia, 2001, pp. 107-118.
  17. S. Tong and D. Koller, "Support vector machine active learning with applications to text classification", 17th International Conference on Machine Learning, Morgan Kaufmann 2000, pp. 999-1006.
  18. M. B. Kokare, P.K. Biswas, and B.N. Chatterji, "Texture Image retrieval using New Rotated Complex Wavelet Filters," IEEE Trans. on systems, man, and Cybernetics-Part B: Cybernetics, vol. 35, no.6, 2005 , pp.1168-1178. https://doi.org/10.1109/TSMCB.2005.850176
  19. Chiou-Ting Husu and Chuech-Yu Li, "Relevance Feedback Using Generalized Bayesian Framework with Region Based optimization Learning", IEEE trans. on Image Processing, vol. 14, No.10, Oct. 2005.
  20. Anca Loredana Ion, Liana Stanescu, and Dan Burdescu, "Semantic Based Image Retrieval using Relevance Feedback", International Conference on Computer as a Tool, 2009, pp. 303-310.
  21. N.G. Kingsbury, "Image processing with complex wavelet", Phil. Trans. Roy. Soc. London A, vol. 357, 1999, pp. 2543-2560. https://doi.org/10.1098/rsta.1999.0447
  22. N. G. Kingsbury, "Complex wavelets for Shift Invariant Analysis and Filtering of Signals", J. App. Comput. Harmon. Anal., vol. 10, no.3, (2001), pp.234-253. https://doi.org/10.1006/acha.2000.0343
  23. I. Selesnick, R. Baraniuk, and N. Kingsbury, "The dual-tree complex wavelet transform," IEEE Signal Process. Mag., vol.22, no. 6, 2005, pp.123-151. https://doi.org/10.1109/MSP.2005.1550194
  24. V. N. vapnik. Statistical Learning Theory. 1998.
  25. Rongtao Ding, Xinhao Ji, and Linting Zhu, "Research on the relevance feedback-based image retrieval in Digital library", PWASET, vol. 25, ISSN 1307-6884, 2007, pp. 48-52.
  26. Pushpa B. Patil and M. B. Kokare, "Semantic Image Retrieval using Relevance Feedback", International Journal of Web & Semantic Technology (IJWesT), Vol.2, No.4, 2011, pp. 139-148. https://doi.org/10.5121/ijwest.2011.2411

Cited by

  1. Gaze behavior data profiling and analysis system platform based on visual content representation vol.75, pp.23, 2016, https://doi.org/10.1007/s11042-014-2285-7
  2. Design of Time–Frequency Optimal Three-Band Wavelet Filter Banks with Unit Sobolev Regularity Using Frequency Domain Sampling vol.35, pp.12, 2016, https://doi.org/10.1007/s00034-016-0286-7
  3. Time–frequency localized three-band biorthogonal wavelet filter bank using semidefinite relaxation and nonlinear least squares with epileptic seizure EEG signal classification vol.62, 2017, https://doi.org/10.1016/j.dsp.2016.12.004
  4. Nonuniform Video Size Reduction for Moving Objects vol.2014, 2014, https://doi.org/10.1155/2014/832871
  5. Automatic Image Tagging Model Based on Multigrid Image Segmentation and Object Recognition vol.2014, 2014, https://doi.org/10.1155/2014/857682
  6. Design and implementation of an automated monitoring system vol.72, pp.11, 2016, https://doi.org/10.1007/s11227-016-1723-x
  7. Fast multi-feature pedestrian detection algorithm based on histogram of oriented gradient using discrete wavelet transform vol.75, pp.23, 2016, https://doi.org/10.1007/s11042-015-2455-2
  8. Symmetric-Invariant Boundary Image Matching Based on Time-Series Data vol.4, pp.10, 2015, https://doi.org/10.3745/KTSDE.2015.4.10.431
  9. Image classification using label constrained sparse coding vol.75, pp.23, 2016, https://doi.org/10.1007/s11042-015-2626-1
  10. A time-series matching approach for symmetric-invariant boundary image matching vol.77, pp.16, 2018, https://doi.org/10.1007/s11042-017-5323-4