Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Similar Image Retrieval Technique based on Semantics through Automatic Labeling Extraction of Personalized Images

  • Jung-Hee, Seo (Department of Computer Engineering, Tongmyong University)
  • Received : 2023.05.10
  • Accepted : 2023.11.14
  • Published : 2024.03.31
Download PDF
⟨ Previous Next ⟩

Abstract

Despite the rapid strides in content-based image retrieval, a notable disparity persists between the visual features of images and the semantic features discerned by humans. Hence, image retrieval based on the association of semantic similarities recognized by humans with visual similarities is a difficult task for most image-retrieval systems. Our study endeavors to bridge this gap by refining image semantics, aligning them more closely with human perception. Deep learning techniques are used to semantically classify images and retrieve those that are semantically similar to personalized images. Moreover, we introduce a keyword-based image retrieval, enabling automatic labeling of images in mobile environments. The proposed approach can improve the performance of a mobile device with limited resources and bandwidth by performing retrieval based on the visual features and keywords of the image on the mobile device.

Keywords

References

  1. M. Sajid, N. Ali, S. H. Dar, B. Zafar, and M. K. Iqbal, "Short search space and synthesized-reference re-ranking for face image retrieval," Applied Soft Computing Journal, vol. 99, pp. 1-14, Feb. 2021. DOI: 10.1016/j.asoc.2020.106871.
  2. S. Khan, L. Chen, and H. Yan "Co-clustering to reveal salient facial features for expression recognition," IEEE Transactions on Affective Computing, vol. 11, no 2, pp. 348-360, Apr. 2020. DOI: 10.1109/TAFFC.2017.2780838.
  3. U. Jayaraman and P. Gupta, "Efficient similarity search on multidimensional space of biometric databases," Neurocomputing, vol. 452, pp. 623-652, Sep. 2021. DOI: 10.1016/j.neucom.2020.08.084.
  4. A. Barman and S. K. Shah, "A graph-based approach for making consensus-based decisions in image search and person reidentification," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 43, no. 3, pp. 753-765, Mar. 2021. DOI: 10.1109/TPAMI.2019.2944597.
  5. X. Li, J. Yang and J. Ma, "Recent developments of content-based image retrieval (CBIR)," Neurocomputing, vol. 452, pp. 675-689, Sep. 2021. DOI: 10.1016/j.neucom.2020.07.139.
  6. M. A. Subhi and S. M. Ali, "A deep convolutional neural network for food detection and recognition," in 2018 IEEE-EMBS Conference on Biomedical Engineering and Sciences (IECBES), Sarawak, Malaysia, pp. 284-287, 2018. DOI: 10.1109/iecbes.2018.8626720.
  7. N. Singla, M. Kaur, and S. Sofat, "Latent fingerprint database using reflected ultra violet imaging system," Procedia Computer Science, vol. 167, pp. 942-951, 2020. DOI: 10.1016/j.procs.2020.03.393.
  8. K. Cao, D. L. Nguyen, C. Tymoszek, and A. K. Jain, "End-to-end latent fingerprint search," IEEE Transactions on Information Forensics and Security, vol. 15, pp. 880-894, 2020. DOI: 10.1109/tifs.2019.2930487.
  9. S. Pandey, P. Khanna, and H. Yokota, "A semantics and image retrieval system for hierarchical image databases," Information Processing and Management, vol. 52, no. 4, pp. 57-591, Jul. 2016. DOI: 10.1016/j.ipm.2015.12.005.
  10. J. H. Seo, "Metadata processing technique for similar image search of mobile platform," Journal of Information and Communication Convergence Engineering, vol. 19, no. 1, pp. 36-41, Mar. 2021. DOI: 10.6109/jicce.2021.19.1.36.
  11. Z. Wang, Q. Zheng, and J. Sun, "An effective content-based web image searching engine algorithm," in 2010 IEEE International Conference on Management of Innovation &Technology, Singapore, pp. 1008-1012, 2010. DOI: 10.1109/ICMIT.2010.5492878.
  12. C. F. Tsai and W. C. Lin, "A Comparative Study of Global and Local Feature Representations in Image Database Categorization," in 2009 Fifth International Joint Conference on INC, IMS and IDC, Seoul, Korea, pp. 1563-1566, 2009. DOI: 10.1109/ncm.2009.83.
  13. L. Zhu, W. Yu, C. Zhanh, Z. Zhang F. Huang, and H. Yu, "SVSJOIN: Efficient Spatial Visual Similarity Join for Geo-Multimedia," IEEE Access, vol. 7, pp. 158389-158408, Oct. 2019. DOI: 10.1109/ACCESS.2019.2948388.
  14. W. Zhang, G. Liu, and G. Tian, "A Coarse to Fine Indoor Visual Localization Method Using Environmental Semantic Information," IEEE Access, vol. 7, pp. 21963-21970, 2019. DOI: 10.1109/access.2019.2899049.
  15. S. Pandey, P. Khanna, and H. Yokota, "An Effective Use of Adaptive Combination of Visual Features to Retrieve Image Semantics from a Hierarchical Image Database," Journal of Visual Communication and Image Representation, vol. 30, pp. 136-152, Jul. 2015. DOI: 10.1016/j.jvcir.2015.03.010.
  16. M. N. Munjal, and S. Bhatia, "A Novel Technique for Effective Image Gallery Search using Content Based Image Retrieval System," in 2019 International Conference on Machine Learning, Big Data, Cloud and Parallel Computing (Com-IT-Con), Faridabad, India, pp. 25-29, 2019. DOI: 10.1109/COMITCon.2019.8862206.
  17. A. Javeed, S. Zhou, L. Yongjian, I. Qasim, A. Noor, and R. Nour, "An Intelligent Learning System Based on Random Search Algorithm and Optimized Random Forest Model for Improved Heart Disease Detection," IEEE Access, vol. 7, pp. 180235-180243, Nov. 2019. DOI: 10.1109/ACCESS.2019.2952107.
  18. P. Punitha and D. S. Guru, "An Effective and Efficient Exact Match Retrieval Scheme for Symbolic Image Database Systems Based on Spatial Reasoning: A Logarithmic Search Time Approach," IEEE Transactions on Knowledge and Data Engineering, vol. 18, no. 10, pp. 1368-1381, Oct. 2006. DOI: 10.1109/tkde.2006.154.
  19. S. Cheg, L. Wang, and A. Du, "An Adaptive and Asymmetric Residual Hash for Fast Image Retrieval," IEEE Access, vol. 7, pp. 78942-78953, Jun. 2019. DOI: 10.1109/ACCESS.2019.2922738.
  20. P. Li, X. Zhu, X. Zhang, P. Ren, and L. Wan, "Hash Code Reconstruction for Fast Similarity Search," IEEE Signal Processing Letters, vol. 26, no. 5, pp. 695-699, May 2019. DOI: 10.1109/lsp.2019.2898772.
  21. Y. Weng, T. Zhou, L. Liu, and C. Xia, "Automatic Convolutional Neural Architecture Search for Image Classification Under Different Scenes," IEEE Access, vol. 7, pp. 38495-38506, Mar. 2019. DOI: 10.1109/ACCESS.2019.2906369.
  22. X. Wangming, W. Jin, L. Xinhai, Z. Lei, and S. Gang, "Application of Image SIFT Features to The Context of CBIR," in 2008 International Conference on Computer Science and Software Engineering, Wuhan, China, pp. 552-555, 2008. DOI: 10.1109/CSSE.2008.1230.
  23. S. Pandey, P. Khanna, and H. Yokota, "Clustering of Hierarchical Image Database to Reduce Inter-and Intra-semantic Gaps in Visual Space for Finding Specific Image Semantics," Journal of Visual Communication and Image Representation, vol. 38, pp. 704-720, Jul. 2016. DOI: 10.1016/j.jvcir.2016.04.013.
  24. S. Sugawara, K. Yamaoka, and Y. Sakai, "A Study on Image Searching Method in Super Distributed Database," in GLOBECOM 97. IEEE Global Telecommunications Conference. Conference Record, Phoenix, AZ, Vol. 2, pp. 736-740, 1997. DOI: 10.1109/glocom.1997.638427.