Journal of Information Processing Systems

Korea Information Processing Society (한국정보처리학회)
권호 표지
DOI QR코드

DOI QR Code

Semantic Image Search: Case Study for Western Region Tourism in Thailand

  • Chantrapornchai, Chantana (Dept. of Computer Engineering, Faculty of Engineering, Kasetsart University) ;
  • Bunlaw, Netnapa (Dept. of Computing, Faculty of Science, Silpakorn University) ;
  • Choksuchat, Chidchanok (Information and Communication Technology Programme, Faculty of Science, Prince of Songkla University)
  • Received : 2017.11.29
  • Accepted : 2018.07.14
  • Published : 2018.10.31
Download PDF
⟨ Previous Next ⟩

Abstract

Typical search engines may not be the most efficient means of returning images in accordance with user requirements. With the help of semantic web technology, it is possible to search through images more precisely in any required domain, because the images are annotated according to a custom-built ontology. With appropriate annotations, a search can then, return images according to the context. This paper reports on the design of a tourism ontology relevant to touristic images. In particular, the image features and the meaning of the images are described using various properties, along with other types of information relevant to tourist attractions using the OWL language. The methodology used is described, commencing with building an image and tourism corpus, creating the ontology, and developing the search engine. The system was tested through a case study involving the western region of Thailand. The user can search specifying the specific class of image or they can use text-based searches. The results are ranked using weighted scores based on kinds of properties. The precision and recall of the prototype system was measured to show its efficiency. User satisfaction was also evaluated, was also performed and was found to be high.

Keywords

References

  1. W3C, "OWL web ontology language guide," 2004; https://www.w3.org/TR/owl-guide/.
  2. N. Guarino, Formal Ontology in Information Systems. Amsterdam: IOS Press, 1998.
  3. T. Berners-Lee, "Semantic web on XML," 2000; https://www.w3.org/2000/Talks/1206-xml2k-tbl/slide1-0.html.
  4. G. Klyne and J. J. Carrol, "Resource description framework (RDF): concepts and abstract syntax," 2004; http://www.w3.org/TR/rdf-concepts/.
  5. R. Cyganiak, "A relational algebra for SPARQL," 2005; http://www.hpl.hp.com/techreports/2005/HPL-2005-170.pdf.
  6. Swoogle: semantic web search [Online]. Available: http://swoogle.umbc.edu/.
  7. L. Ding, T. Finin, A. Joshi, R. Pan, R. S. Cost, Y. Peng, P. Reddivari, V. Doshi, and J. Sachs, "Swoogle: a search and metadata engine for the semantic web," in Proceedings of the 13th ACM International Conference on Information and Knowledge Management, Washington, DC, 2004, pp. 652-659.
  8. A. T. Schreiber, B. Dubbeldam, J. Wielemaker, and B. Wielinga, "Ontology-based photo annotation," IEEE Intelligent Systems, vol. 16, no. 3, pp. 66-74, 2001.
  9. E. Hyvonen, S. Saarela, A. Styrman, and K. Viljanen, "Ontology-based image retrieval," in Proceedings of the XML Finland 2002 Conference, Helsinki, Finland, 2002, pp. 15-27.
  10. M. d'Aquin and E. Motta, "Watson, more than a semantic web search engine," Semantic Web, vol. 2, no. 1, pp. 55-63, 2011. https://doi.org/10.5121/ijwest.2011.2404
  11. E. Thomas, H. Alani, D. Sleeman, and C. Brewster, "Searching and ranking ontologies on the semantic web," in Proceedings of the 3rd K-CAP Workshop on Ontology Management: Searching, Selection, Ranking, and Segmentation, Banff, Canada, 2005, pp. 57-60.
  12. F. Soualah-Alila, C. Faucher, F. Bertrand, M. Coustaty, and A. Doucet, "Applying semantic web technologies for improving the visibility of tourism data," in Proceedings of the 8th Workshop on Exploiting Semantic Annotations in Information Retrieval, Melbourne, Australia, 2015, pp. 5-10.
  13. M. Dell'erba, O. Fodor, W. Hopken, and H. Werthner, "Exploiting semantic web technologies for harmonizing e-markets," Information Technology & Tourism, vol. 7, no. 3-4, pp. 201-219, 2004. https://doi.org/10.3727/109830505774297210
  14. G. S. Sadasivam, C. Kavitha, and M. SaravanaPriya, "Ontology based information retrieval for e-tourism," International Journal of Computer Science and Information Security, vol. 8, no. 2, pp. 78-82, 2010.
  15. B. Abrahams, "Tourism information systems integration and utilization within the semantic web," Ph.D. dissertation, Victoria University, Melbourne, Australia, 2006.
  16. X. Wang, S. Qiu, K. Liu, and X. Tang, "Web image re-ranking using query-specific semantic signatures," IEEE Transactions on Pattern Analysis And Machine Intelligence, vol. 36, no. 4, pp. 810-823, 2014. https://doi.org/10.1109/TPAMI.2013.214
  17. N. Magesh and P. Thangaraj, "Semantic image retrieval based on ontology and SPARQL query," in Proceedings of International Conference on Advanced Computer Technology (ICACT), Pyeongchang, Korea, 2011, pp. 12-16.
  18. C. Town, "Ontological inference for image and video analysis," Machine Vision and Applications, vol. 17, no. 2, pp. 94-115, 2006. https://doi.org/10.1007/s00138-006-0017-3
  19. P. Buitelaar and T. Eigner, "Ontology search with the ontoselect ontology library," in Proceedings of the International Conference on Language Resources and Evaluation (LREC), Marrakech, Morrocco, 2008, pp. 1030-1033.
  20. H. Wang, L. T. Chia, and S. Liu, "Semantic retrieval with enhanced matchmaking and multi-modality ontology," in Proceedings of 2007 IEEE International Conference on Multimedia and Expo, Beijing, China, 2007, pp. 516-519.
  21. P. Koletsis and E. G. Petrakis, "SIA: Semantic Image Annotation using ontologies and image content analysis," in Image Analysis and Recognition. Heidelberg: Springer, 2010, pp. 374-383.
  22. A. Kallergi, Y. Bei, and F. J. Verbeek, "The ontology viewer: Facilitating image annotation with ontology terms in the CSIDx imaging database," in Proceedings of Workshop on Visual Interfaces to the Social and the Semantic Web (VISSW), Sanibel Island, FL, 2009, pp. 1-6.
  23. N. Boonsim and S. Arch-int, "A metadata model for semantic image retrieval based on RDF," Khon Kaen University Research Journal (Graduate Studies), vol. 6, no. 1, pp. 60-74, 2006.
  24. P. Pratumrat, "Semantic image storage and retrieval by ontology," M.S. thesis, Khon Kaen University, Thailand, 2007.
  25. V. W. Soo, C. Y. Lee, C. C. Li, S. L. Chen, and C. C. Chen, "Automated semantic annotation and retrieval based on sharable ontology and case-based learning techniques," in Proceedings of the 3rd ACM/IEEE-CS Joint Conference on Digital Libraries, Houston, TX, 2003, pp. 61-72.
  26. N. Boonsim, "Semantic image storage and retrieval based on RDF," M.S. thesis, Khon Kaen University, Thailand, 2005.