Content-based Image Retrieval using Spatial-Color and Gabor Texture on A Mobile Device

모바일 디바이스상에서 공간-칼라와 가버 질감을 이용한 내용-기반 영상 검색

  • 이용환 (극동대학교 스마트모바일학과) ;
  • 이준환 (극동대학교 스마트모바일학과) ;
  • 조한진 (극동대학교 스마트모바일학과) ;
  • 권오진 (세종대학교 전자공학과) ;
  • 김영섭 (단국대학교 전자공학과)
  • Received : 2014.12.05
  • Accepted : 2014.12.22
  • Published : 2014.12.31

Abstract

Mobile image retrieval is one of the most exciting and fastest growing research fields in the area of multimedia technology. As the amount of digital contents continues to grow users are experiencing increasing difficulty in finding specific images in their image libraries. This paper proposes a new efficient and effective mobile image retrieval method that applies a weighted combination of color and texture utilizing spatial-color and second order statistics. The system for mobile image searches runs in real-time on an iPhone and can easily be used to find a specific image. To evaluate the performance of the new method, we assessed the iPhone simulations performance in terms of average precision and recall using several image databases and compare the results with those obtained using existing methods. Experimental trials revealed that the proposed descriptor exhibited a significant improvement of over 13% in retrieval effectiveness, compared to the best of the other descriptors.

Keywords

References

  1. Mun-Kew Leong, Wo Chang, "ISO/IEC PDTR 24800 - 1: JPSearch - Part 1: Framework and System Components", ISO/IEC JTC1 SC29/WG1N4203, 2007.
  2. Ahmad, I., Gabbouj, M., "A generic content-based image retrieval framework for mobile devices", Multimedia Tools Applications, 2010.
  3. Arnold W.M. Smeulders, Marcel Worring, Simone Santini, Amarnath Gupta, Ramesh Jain, "Content-Based Image Retrieval at the End of the Early Years", IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.12, pp.1349-1380, 2000. https://doi.org/10.1109/34.895972
  4. Sam S. Tsai, David Chen, Gabriel Takacs, Vilay Chandrasekhar, Jatinder P. Singh, Bernd Girod, "Location Coding for Mobile Image Retrieval", Proceeding of International ICST Mobile Multimedia Communications Conference, 2009.
  5. Bin Li, Xiangwei Kong, Zhe Wang, Haiyan Fu, "SIFT-Based Image Retrieval Combining the Distance Measure of Global Image and Sub-Image", International Conference on Intelligent Information Hiding and Multimedia Signal Processing, 2009.
  6. Shih-Fu Chang, Thomas Sikora, Atul Puri, "Overview of the MPEG-7 Standard", IEEE Transactions on Circuits and Systems for Video Technology, vol.11, no.6, 2001.
  7. Akio Yamada, Robert O'challaghan, S.K. Kim, "MPEG-7 Visual Part of Experimentation Model ver. 27.0", ISO/IEC JTC1 SC29/WG11N7808, 2006.
  8. Herbert Bay, Andreas Ess, Tinne Tuytelaars, Luc Van Gool, "SURF: Speeded Up Robust Features", Computer Vision and Image Understanding, vol.110, no.3, pp.346-359, 2008. https://doi.org/10.1016/j.cviu.2007.09.014
  9. Ling-Yu Duan, Jie Chen, Chunyu Wang, Rongrong Ji, Tiejun Huang, Web Gao, "Key Technologies in Mobile Visual Search and MPEG Standardization Activities", ZTE Communications, vol.10, no.2, 2012.
  10. N. Singhai, S.K. Shandilya, "A Survey on Content Based Image Retrieval Systems", International Journal of Computer Application, vol.4, 2010.
  11. Gareth Loy, Jan-Olof Eklundh, "A Review of Benchmarking Content-based Image Retrieval", MUSCLE/ImageCLEF Workshop on Image and Video Retrieval Evaluation, 2005.
  12. Yong-Hwan Lee, Youngseop Kim, "Photo Image Retrieval using Geo-location Information", Journal of the Semiconductor & Display Technology, vol.7, no.4, pp.57-62, 2008.
  13. Yong-Hwan Lee, Heung-Jun Kim, "Photo Retrieval System using Combination of Smart Sensor and Visual Descriptor", Journal of the Semiconductor & Display Technology, vol.13, no.2, pp.45-52, 2014.
  14. Website, http://images.google.co.kr
  15. Mario Doeller, Ruben Tous, Frederik Temmermans, Kyoungro Yoon, Je-Ho Park, Youngseop Kim, Florian Stegmaier, Jaime Delgado, "JPEG's JPSearch Standard : Harmonizing Image Management and Search", IEEE Multimedia, 2012.
  16. Frederik Temmermans, Frederic Defaux, Peter Schelkens, "JPSearch: Metadata Interoperability during Image Exchange", ISO/IEC JTC1 SC29 WG1, 2013.
  17. AV&IT Standardization Committee, "Exchangeable image file format for digital still cameras: Exif version 2.3", Japan Electronics and Information Technology Industries Association, 2010.
  18. Moghaddam, H.A., Khajoie, T.T., Rouhi, A., "A new algorithm for image indexing and retrieval using wavelet correlogram", Proceedings of International Conference on Image Processing, pp.497-500, 2003.
  19. Manjunath, B., Ma, W., "Texture features for browsing and retrieval of large image data", IEEE Transactions on Pattern Analysis and Machine Intelligence (Special Issue on Digital Libraries), vol.18, no.8, pp.837-842, 1996. https://doi.org/10.1109/34.531803
  20. Vittorio Castelli, Lawrence D. Bergman, Image Databases - Search and Retrieval of Digital Imagery, Wiley Inter-Science, 2002.
  21. Yong-Hwan Lee, Bonam Kim, Shang-Burm Rhee, "Content-based Image Retrieval using Spatial-Color and Garbor Texture on a Mobile Device", Computer Science and Information Systems, vol.10, no.2, pp.807-823, 2013. https://doi.org/10.2298/CSIS120716035L