Journal of the Korean Society for information Management (정보관리학회지)

Korean Society for Information Management (한국정보관리학회)
권호 표지
DOI QR코드

DOI QR Code

Query by Colour : Investigating the Efficacy of Query Paradigms for Visual Information Retrieval

색에 의한 질의: 시각정보 검색을 위한 질의 패러다임의 유용성 측정

  • Venters, Colin C. (Department of Library and Information Science, Kyungpook National University)
  • Received : 2011.05.06
  • Accepted : 2011.06.03
  • Published : 2011.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

The ability of the searcher to express their information problem to an information retrieval system is fundamental to the retrieval process. Query by visual example is the principal query paradigm for expressing queries in a content-based image retrieval environment yet there is little empirical evidence to support its efficacy in facilitating query formulation. The aim of this research was to investigate the usability of the query by colour method in supporting a range of information problems in order to contribute to the gap in knowledge regarding the relationship between searchers' information problems and the query methods required to support efficient and effective visual query formulation. The results strongly suggest that the query method does not support visual query formulation and that there is a significant mismatch between the searchers information problems and the expressive power of the retrieval paradigm.

탐색자가 정보 요구를 정보검색시스템에 표현하는 능력은 검색과정의 기본이다. 시각적 예시에 의한 질의는 내용기반 이미지 검색환경에서 질의 표현을 위한 중요한 패러다임이다. 하지만, 이 방법이 질의 구성의 편의성에 있어 얼마나 효과가 있는지에 대한 실험적 입증은 아직 미미하다. 이 연구의 목적은 다양한 정보요구와 효율적이고도 효과적인 시각적 질의 구성을 지원하기 위해 탐색자의 정보요구와 질의 방법 사이에 발생하는 지식 격차를 고려하여 색을 이용한 질의 방식의 사용성을 조사하기 위한 것이다. 본 연구결과를 통하여 색을 이용한 질의 방법이 시각적 질의 구성을 적절히 지원하지 못한다는 것과 탐색자의 정보요구와 검색 패러다임의 표현력 사이에 뚜렷한 불일치가 있다는 것을 알 수 있다.

Keywords

References

  1. Armitage, L. H. and P. G. B. Enser. 1997. "Analysis of user need in image archives." Journal of Information Science, 23(4): 287-299. https://doi.org/10.1177/016555159702300403
  2. Batley, S. 1988. "Visual information retrieval: browsing strategies in pictorial databases." In: Online Information '88: Proceedings of the 12th International Online Information Meeting, 6th-8th December 1988, London, England: 373-381.
  3. Berlin, B. and P. Kay. 1991. Basic Color Terms: Their Universality and Evolution. University of California Press.
  4. Bird, C., P. J. Elloitt, and P. M. Hayward. 1999. "Content-based retrieval for European image libraries." In: The Challenge of Image Retrieval: CIR99, The 2nd UK Conference on Image Retrieval, Forte Posthouse Hotel, Newcastle upon Tyne, United Kingdom, 25th-26th February 1999, edited by D. J. Harper and J. P. Eakins.
  5. Brady, M., D. Gavaghan, A. Simpson, R. Highnam, A. Knox, S. Lloyd, A. Simpson, and D. Watson. 2004. "Grid computing for digital mammography." In: AHM'2003: Proceedings of UK e-Science All Hands Meeting 2003, Nottingham, UK, 2-4th September 2003, edited by Simon Cox: 723-730.
  6. Castelli, V. and L. D. Bergman. 2002. Image Databases: Search and Retrieval of Digital Imagery. John Wiley & Sons, 1-10.
  7. Chan, H. C. and Y. Wang. 2006. "Human factors in color-based image retrieval: an emprical study on size estimate accuracies." Journal of Visual Communication & Image Representation, 15(2): 113-131.
  8. Chin, J., V. Diehl, and L. Norman. 1988. "Development of an instrument measuring user satisfaction of the human-computer interface." In: CHI '88: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, Washington, D.C. USA, 15-19 May 1988, edited by J. J. O'Hare, ACM Press: 213-218.
  9. Conniss, L. R., A. J. Ashford, and M. E. Graham, 2001. "Information seeking behaviour in image retrieval: VISOR I." Institute for Image Data Research, 1-147, (Library and Information Commission Research Report 95).
  10. Datta, R., D. Joshi, J. Li, and J. Z. Wang. 2008. "Image retrieval: ideas, influences, and trends of the new age." ACM Computing Surveys, 40(2).
  11. Del Bimbo, A. 1999. Visual Information Retrieval. Morgan Kaufmann.
  12. Dunlop, M. 1991. "Multimedia information retrieval." PhD Thesis, University of Glasgow.
  13. Eidenberger, H. and C. Breiteneder. 2003. "VizIR: a framework for visual information retrieval." Journal of Visual Languages and Computing, 14(5): 443-469. https://doi.org/10.1016/S1045-926X(03)00035-1
  14. Enser, P. G. B. 1995. "Progress in documentation pictorial information retrieval." Journal of Documentation, 51(2): 126-170. https://doi.org/10.1108/eb026946
  15. Enser, P. G. B. and C. G. McGregor. 1992. "Analysis of visual information retrieval queries." London: British Library, (British Library Research & Development Report, No. 6104).
  16. Feng, D., W. C. Siu, and H. J. Zhang. 2003. "Multimedia information retrieval and management: technological fundamentals and applications." Springer-Verlag. Multimedia Signal Processing Book Series: 1-26.
  17. Fidel, R. 1997. "The image retrieval task: implications for the design and evaluation of image databases." The New Review of Hypermedia and Multimedia, 3: 181-199. https://doi.org/10.1080/13614569708914689
  18. Frokjaer, E., M. Hertzum, and K. Hornbaek. 2000. "Measuring usability: are effectiveness, efficiency, and satisfaction really correlated?" In: CHI'00: Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, The Hague, The Netherlands, 01-06, April, 2000, ACM Press: 345-352.
  19. Flickner, M., H. Sawhney, W. Niblack, J. Ashley, Q. Huang, B. Dom, M. Gorkani, J. Hafner, D. Lee, D. Petkovic, D. Steele, and P. Yanker. 1995. "Query by image and video content: the QBIC system." IEEE Computer, 28(9): 23-32. https://doi.org/10.1109/2.410146
  20. Gudivada, V. N. and V. V. Raghaven. 1995. "Content-based image retrieval systems." IEEE Computer, 28(9): 20.
  21. Hanjalic, A., N. Sebe, and E. Y. Chang. 2006. "Multimedia content analysis, management and retrieval: trends and challenges." In: Electronic Imaging 2006, Multimedia Content Analysis, Management and Retrieval 2006, IS&T/SPIE International Symposium, SPIE Vol. 6073, San Jose Marriott and San Jose Convention Centre, San Jose, California, USA, 15-19 January 2006, edited by Edward Y. Chang, Alan Hanjalic and Nicu Sebe, SPIE.
  22. Hirata, K. and T. Kato. 1992. "Query by visual example." In: EDBT'92: Advances in Database Technology: Proceedings of the 3rd International Conference on Extending Database Technology, Vienna, Austria, 23rd-27th March 1992, edited by A. Pirotte, C. Delobel and G. Gottlob, Springer-Verlag, 56-71.
  23. Hix, D. and H. R. Hartson. 1993. Developing User Interfaces: Ensuring Usability Through Product and Process. John Wiley.
  24. Hua, X-S. 2010. "How to realize content analysis in web-scale multimedia search." In: CIVR 2010: ACM International Conference on Image and Video Retrieval, Xi'an, China 5-7 July, 2010.
  25. Huang, J., S. Kumar, M. Mitra, W-J. Zhu, and R. Zabih. 1997. "Image indexing using color correlogram." In: CVPR '97: Proceedings of IEEE Conference on Computer Vision and Pattern Recognition, San Juan, Puerto Rico, 17-19 June, 1997, IEEE Computer Society, 762-768.
  26. Idris, F. and S. Panchanathan. 1997. "Review of image and video indexing techniques." Journal of Visual Communication and Image Representation, 8(2): 146-166. https://doi.org/10.1006/jvci.1997.0355
  27. Jaimes, A., and S-F. Chang. 2002. "Concepts and techniques for indexing visual concepts." In: Castelli, V. and Bergman, L. D. (ed). Image Databases: Search and Retrieval of Digital Imagery, John Wiley & Sons Inc, 497.
  28. Johnson, F. C., J. R. Griffiths, and R. J. Hartley. 2001. "DEVISE: a framework for the evaluation of internet search engines." The Council for Museums Archives and Libraries (Library and Information Commission Research Report No. 100).
  29. Jorgensen, C. 1995. "Image attributes: an investigation." PhD thesis, Syracuse University.
  30. Jose, J. M., J. Furner, and D. J. Harper. 1998. "Spatial querying for image retrieval: a user-oriented evaluation." In: SIGIR: Proceedings of the 21st Annual International Conference On Research And Development in Information Retrieval, University of Melbourne, 24-28 August 1998, ACM Press, 232-240.
  31. Kato, T. 1991. "Intelligent visual interaction with image database systems: toward the multimedia personal interface." Journal of Information Processing, 14(2): 134-143.
  32. Kato, T., T. Kurita, and H. Shimogaki. 1989. "Multimedia interaction with image database Systems." In: Advanced Database System Symposium '89, Kyoto, Japan, 1989, 271-278.
  33. Korfhage, R. R. 1997. Information Storage and Retrieval. New York: John Wiley & Sons.
  34. Lai, T-S. 2000. "CHROMA: a photographic image retrieval system." Ph.D. Thesis. University of Sunderland, UK. January 2000.
  35. Lai, T-S., J. Tait, and S. McDonald. 2000. "A user-centred evaluation of visual search methods for CBIR." In: CIR2000: The Challenge for Image Retrieval, Third UK Conference on Image Retrieval, Old Ship Hotel, Brighton, UK, 4th-5th May 2000, edited by J. P. Eakins and P. G. B. Enser.
  36. Lancaster, F. W. and A. J. Warner. 1993. Information Retrieval Today. Arlington: Information Resources Press.
  37. Lew, M. S. and T. S. Huang. 2001. "Visual information retrieval: paradigms, applications, and research issues." In: Lew, M. S. (ed.) Principles of Visual Information Retrieval. Springer-Verlag, Advances in Pattern Recognition, 3-9.
  38. Lu, H., B-C. Ooi, and K-L. Tan. 1994. "Efficient image retrieval by color contents." In: ADB-94: 1st International Conference on Applications of Databases, Vadstena, Sweden, 21-23 June, 1994, edited by Witold Litwin and Tore Rischor, Springer, 95-108.
  39. McDonald, S., T-S. Lai, and J. Tait. 2001. "Evaluating a content-based image retrieval system." In: SIGIR'01: Proceedings of the 24th Annual International ACM Special Interest Group on Information Retrieval Conference on Research and Development in Information Retrieval, New Orleans, Louisiana, US, ACM Press, 232-240.
  40. Markkula, M. and E. Sormunen. 1998. "Searching for photos: journalist practices in pictorial IR." In: CIR98: The Challenge of Image Retrieval Workshop, University of Northumbria at Newcastle, Newcastle upon Tyne, United Kingdom, 5th February 1998, edited by J. P. Eakins, D. J. Harper and Joemon Jose.
  41. Mintzer, F., G. W. Braudway, F. P. Giordano, J. C. Lee, K. A. Magerlein, S. D'Auria, A. Ribak, G. Shapir, F. Schiattarella, and A. Zelenkov. 2001. "Populating the hermitage museums new web site." Communications of the ACM, 44(8): 52-60. https://doi.org/10.1145/381641.381657
  42. Muller, W., H. Muller, S. Marchand-Maillet, T. Pun, D. M. Squire, Z. Pecenovic, C. Giess, and A. P. de Vries. 2000. "MRML: an extensible communication protocol for interoperability and benchmarking of multimedia information retrieval systems." Visual Information and Information Systems, 300-311.
  43. Niblack, C. W., R. Barber, W. Equitz, M. D. Flickner, E. H. Glasman, D. Petkovic, P. Yanker, C. Faloutsos, and G. Taubin. 1993. "The QBIC project: querying images by content using color, texture and shape." In: Storage and Retrieval for Image and Video Databases, Proceedings of the Society of the Photo-Optical Instrumentation Engineers Vol. 1908, San Jose, CA, USA, 31 January-5 February 1993, edited by Carlton W. Niblack, 173-187.
  44. Norman, D. A. 1981. "Categorisation of action slips." Psychological Review, 88(1): 1-15. https://doi.org/10.1037/0033-295X.88.1.1
  45. Purves, D. and R. B. Lotto. 2011. Why we see what we do redux: a wholly empirical theory of vision. Sinauer Associates.
  46. C. J. van Rijsbergen. 1979. Information Retrieval. London: Butterworths.
  47. Rickman, R. M. and T. J. Stonham. 1996. "Content-based image retrieval using colour tuple histograms." In: Storage and Retrieval for Still Image and Video Databases IV, Proceedings of the Society of the Photo-Optical Instrumentation Engineers Vol. 2670, San Diego/La Jolla, CA, USA, March 1996, edited by Ishwar K. Sethi and Ramesh C. Jain, 2-7.
  48. Rui, Y. and T. S. Huang. 2001. "Relevance feedback techniques." In: Lew, M. S. (ed.) Principles of Visual Information Retrieval. Springer-Verlag, Advances in Pattern Recognition, 219-258.
  49. Rui, Y., T. S. Huang, and S-F. Chang. 1999. "Image retrieval: current techniques, promising directions, and open issues." Journal of Visual Communication and Image Representation, 10(1): 51.
  50. Smeulders, A. W. M., M. Worring, S. Santini, A. Gupta, and R. Jain. 2000. "Content-based image retrieval at the end of the early years." IEEE Transaction on Pattern Analysis and Machine Intelligence, 22(12): 1349-1380. https://doi.org/10.1109/34.895972
  51. Smith, J. R. 2002. "Color for image retrieval." In: Lew, M. S. (ed.) Principles of visual information retrieval. Springer-Verlag, Advances in Pattern Recognition, 219-258.
  52. Smith, J. R. and S-F. Chang. 1996. "Tools and techniques for color image retrieval." In: Proceedings of IS&T/SPIE Symposium on Electronic Imaging: Science and Technology (EI'96)-Storage and Retrieval for Image and Video Databases IV, vol.2670: 426-437.
  53. Stricker, M. A. and M. Orengo. 1995. "Similarity of color images." In: Storage and Retrieval for Image and Video Databases III, Proceedings of the Society of the Photo-Optical Instrumentation Engineers, Vol. 2420, San Diego/La Jolla, CA, USA, March 1995, edited by Wayne Niblack and Ramesh C. Jain, 381-392.
  54. Swain, M. and D. Ballard. 1991. "Color indexing." International Journal of Computer Vision, 7(1): 11-32. https://doi.org/10.1007/BF00130487
  55. Taylor, R. S. 1968. "Question-negotiation and information seeking in libraries." College and Research Libraries, 29: 178-194. https://doi.org/10.5860/crl_29_03_178
  56. Veltkamp, R. C. and M. Tanase. 2002. "A survey of content-based image retrieval systems." In: Marques, O. and Furht, B. (ed), Content-Based Image and Video Retrieval, Kluwer, 47-101.
  57. Venters, C. C. and M. D. Cooper. 2000. "A review of content-based image retrieval systems." JISC Technology Applications Programme, JTAP Report, University of Manchester.
  58. Venters, C. C., R. J. Hartley, and W. T. Hewitt, 2003. "Mind the gap: users interfaces and content-based image retrieval." In: Deb, S. (ed.) Multimedia Systems and Content-Based Image Retrieval. Idea Publishing, 322-355.
  59. Yu, F.-X., H. Luo, and Z.-M. Lu. 2011. "Colour image retrieval using pattern co-occurrence matrices based on BTC and VQ." Electronics Letters, 47(2): 100-101. https://doi.org/10.1049/el.2010.3232