KSII Transactions on Internet and Information Systems (TIIS)

Korean Society for Internet Information (한국인터넷정보학회)
권호 표지
DOI QR코드

DOI QR Code

An Image Retrieving Scheme Using Salient Features and Annotation Watermarking

  • Wang, Jenq-Haur (Department of Computer Science and Information Engineering, National Taipei University of Technology) ;
  • Liu, Chuan-Ming (Department of Computer Science and Information Engineering, National Taipei University of Technology) ;
  • Syu, Jhih-Siang (Department of Computer Science and Information Engineering, National Taipei University of Technology) ;
  • Chen, Yen-Lin (Department of Computer Science and Information Engineering, National Taipei University of Technology)
  • Received : 2013.08.23
  • Accepted : 2013.12.16
  • Published : 2014.01.30
Download PDF
⟨ Previous Next ⟩

Abstract

Existing image search systems allow users to search images by keywords, or by example images through content-based image retrieval (CBIR). On the other hand, users might learn more relevant textual information about an image from its text captions or surrounding contexts within documents or Web pages. Without such contexts, it's difficult to extract semantic description directly from the image content. In this paper, we propose an annotation watermarking system for users to embed text descriptions, and retrieve more relevant textual information from similar images. First, tags associated with an image are converted by two-dimensional code and embedded into the image by discrete wavelet transform (DWT). Next, for images without annotations, similar images can be obtained by CBIR techniques and embedded annotations can be extracted. Specifically, we use global features such as color ratios and dominant sub-image colors for preliminary filtering. Then, local features such as Scale-Invariant Feature Transform (SIFT) descriptors are extracted for similarity matching. This design can achieve good effectiveness with reasonable processing time in practical systems. Our experimental results showed good accuracy in retrieving similar images and extracting relevant tags from similar images.

Keywords

References

  1. Christopher D. Manning, Prabhakar Raghavan and Hinrich Scheutze, Introduction to Information Retrieval, Cambridge University Press, 2008.
  2. M. Everingham, L. Van Gool, C. K. I. Williams, J. Winn and A. Zisserman, The PASCAL Visual Object Classes Challenge 2007 (VOC2007) Results, 2007.
  3. Arnold W. M. Smeulders, Marcel Worring, Simone Santini, Amarnath Gupta and Ramesh Jain, "Content-Based Image Retrieval at the End of the Early Years," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol.22, no.12, pp.1349-1380, December, 2000. https://doi.org/10.1109/34.895972
  4. Minxian Li, Jinhui Tang and Chunxia Zhao, "Active Learning on Sparse Graph for Image Annotation," KSII Transactions on Internet and Information Systems, vol.6, no.10, pp.2650-2662, Oct. 2012.
  5. V. M. Potdar, S. Han and E. Chang, "A Survey of Digital Image Watermarking Techniques," in Proc. of 3rd International IEEE Conference on Industrial Informatics, pp.709-716, 2005.
  6. J. Dittmann, M. Steinebach, T. Kunkelmann and L. Stoffels, "H204M - Watermarking for Media: Classification, Quality Evaluation, Design Improvements," in Proc. of 2000 ACM Workshops on Multimedia, pp. 107-110, 2000.
  7. P. D. Sheba Kezia Malarchelvi, "A Semi-Fragile Image Content Authentication Technique based on Secure Hash in Frequency Domain," International Journal of Network Security, vol. 15, no. 5, pp. 365-372, 2013.
  8. C. Qin, C. C. Chang, P. Y. Chen, "Self-Embedding Fragile Watermarking with Restoration Capability Based on Adaptive Bit Allocation Mechanism", Signal Processing, vol. 92, no. 4, pp. 1137-1150, 2012. https://doi.org/10.1016/j.sigpro.2011.11.013
  9. C. Qin, C. C. Chang, Y. C. Chen, "A Novel Reversible Data Hiding Scheme for VQ-Compressed Images Using Index Set Construction Strategy," KSII Transactions on Internet and Information Systems, vol. 7, no. 8, pp. 2027-2041, 2013. https://doi.org/10.3837/tiis.2013.08.016
  10. T. Vogel and J. Dittmann, "Illustration Watermarking: An Object based Approach for Digital Images," in Proc. of SPIE 2005, pp. 578-589, 2005.
  11. C. Vielhauer and M. Schott, "Image Annotation Watermarking: Nested Object Embedding using Hypergraph Model," in Proc. of MM&Sec 2006, pp. 182-189, 2006.
  12. M. Schott, J. Dittmann and C. Vielhauer, "AnnoWaNO: An Annotation Watermarking Framework," in Proc. of 6th International Symposium on Image and Signal Processing and Analysis, pp. 483-488, 2009.
  13. P. Korns, J. Bialas and A. Dziech, "A New Approach to High-Capacity Annotation Watermarking based on Digital Fountain Codes," Multimedia Tools and Applications, 2012.
  14. P. Dymarski and R. Markiewicz, "Informed Algorithms for Watermarking and Synchronization Signal Embedding in Audio Signal," in Proc. of 20th European Signal Processing Conference (EUSIPCO 2012), pp. 2699-2703, 2012.
  15. P. C. Su and C. Y. Wu, "A Join Watermarking and ROI Coding Scheme for Annotating Traffic Surveillance Videos," EURASIP Journal on Advances in Signal Processing, pp. 1-14, 2010.
  16. Gin-Der Wu and Pang-Hsuan Huang, "Image Watermarking Using Structure based Wavelet Tree Quantization," in Proc. of 6th IEEE International Conference on Computer and Information Science (ICIS 2007), pp. 315-319, 2007.
  17. P. Tay and J. P. Havlicek, "Image Watermarking using Wavelets," in Proc. of 45th Midwest Symposium on Circuits and Systems (MWSCAS 2002), pp.258-261, 2002.
  18. D. G. Lowe, "Distinctive Image Features from Scale-Invariant Keypoints," International Journal on Computer Vision, vol. 60, no. 2, pp. 91-110, 2004. https://doi.org/10.1023/B:VISI.0000029664.99615.94
  19. Congxin Liu, Jie Yang and Deying Feng, "PPD: A Robust Low-Computation Local Descriptor for Mobile Image Retrieval," KSII Transactions on Internet and Information Systems, vol.4, no.3, pp.305-323, Jun. 2010.
  20. D. Bhat and S. Nayar, "Ordinal Measures for Image Correspondence," IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 20, no. 4, pp. 415-423, 1998. https://doi.org/10.1109/34.677275
  21. Jenq-Haur Wang, Hung-Chi Chang and Jen-Hao Hsiao, "Protecting Digital Library Collections with Collaborative Web Image Copy Detection," in Proc. of 11th International Conference on Asian Digital Libraries (ICADL 2008), pp. 332-335, 2008.
  22. Denso-Wave, QR Code - About 2D Code.
  23. Y. Yuan, D. Huang and D. Liu, "An Integer Wavelet based Multiple Logo-Watermarking Scheme," in Proc. of 1st International Multi-Symposiums on Computer and Computational Sciences, pp. 175-179, 2006.
  24. M. Tsai, K. Yu and Y. Chen, "Joint Wavelet and Spatial Transformation for Digital Watermarking," IEEE Transactions on Consumer Electronics, vol. 46, no. 1, pp. 241-245, 2000.