An Investigation on Non-Relevance Criteria for Image in Failed Image Search

이미지 검색 실패에 나타난 비적합성 평가요소 규명에 관한 연구

  • 정은경 (이화여자대학교 사회과학대학 문헌정보학전공)
  • Received : 2016.01.26
  • Accepted : 2016.02.11
  • Published : 2016.02.29


Relevance judgment is important in terms of improving the effectiveness of information retrieval systems, and it has been dominant for users to search and use images utilizing internet and digital technologies. However, in the field of image retrieval, there have been only a few studies in terms of identifying relevance criteria. The purpose of this study aims to identify and characterize the non-relevance criteria from the failed image searches. In order to achieve the purpose of this study, a total of 135 participants were recruited and a total of 1,452 criteria items were collected for this study. Analyses and identification on the data set found thirteen criteria such as 'topicality', 'visual content', 'accuracy', 'visual feature', 'completeness', 'appeal to user', 'focal point', 'bibliographic information', 'impression', 'posture', 'face feature', 'novelty', and 'time frame'. Among these criteria, 'visual content' and 'focal point' were introduced in this current study, while 'action' criterion identified in previous studies was not shown in this current study. When image needs and image uses are analyzed with these criteria, there are distinctive differences depending on different image needs and uses.


  1. 박정아. 2012. 통합 검색 환경에서 이용자 적합성 판단 기준에 관한 탐색적 연구. 정보관리학회지, 29(2): 113-133.(Park, Jung Ah. 2012. "Users' Relevance Criteria in Universal Search in Korea: An ExploratoryStudy." Journal of the Korean Society for Information Management, 29(2): 113-133.)
  2. 배경재. 2014. 대학생의 과제해결과정 중 정보적합성 판단에 관한 연구. 정보관리학회지, 31(1): 189-206.(Bae, Kyung-Jae. 2014. "A Study on the Relevance Judgment of College Students in ProblemSolving Process." Journal of the Korean Society for Information Management, 31(1): 189-206.)
  3. 정은경. 2015. 이미지 검색 실패에 나타난 이미지 요구와 맥락에 관한 분석. 한국비블리아학회지, 26(1): 199-215.(Chung, EunKyung. 2015. "An Investigation on Image Needs and Contexts in Image SearchFailure." Journal of the Korean Biblia Society for Library and Information Science, 26(1):199-215.)
  4. Albertson, D. 2015. "Visual Information Seeking." Journal of the American Society for Information Science, 66(6): 1091-1105.
  5. Barry, C. L. 1994. "User-Defined Relevance Criteria: An Exploratory Study." Journal of the American Society for Information Science, 45(3): 149-159.<149::AID-ASI5>3.0.CO;2-J
  6. Barry, C. L. and Schamber, L. 1998. "Users' Criteria for Relevance Evaluation: A Cross-Situational Comparison." Information Processing and Management, 34(2-3): 219-236.
  7. Bateman, J. 1999. "Modeling the Importance of End-User Relevance Criteria." In Proceedings of the 62nd Annual Meeting of the American Society for Information Science, October 31-November 4, 1999, Washington, D.C.: 396-406.
  8. Batley, S. 1988. "Visual Information Retrieval: Browsing Strategies in Pictorial Database." In Proceedings of 12th International Online Information meeting, December 6-8, 1988, London: 373-381.
  9. Choi, Y. and Rasmussen, E. M. 2002. "User's Relevance Criteria in Image Retrieval in American History." Information Processing and Management: an International Journal, 38(5): 695-726.
  10. Choi, Y. and Rasmussen, E. M. 2003. "Searching for Images: The Analysis of Users' Queries for Image Retrieval in American History." Journal of the American Society for Information Science and Technology, 54(6): 498-511.
  11. Chung, E. K. and Yoon, J. W. 2011. "Image Needs in the Context of Image Use: An Exploratory Study." Journal of Information Science, 37(2): 163-177.
  12. Sedghi, S., Sanderson, M. and Clough, P. 2008. "A Study on the Relevance Criteria for Medical Images." Pattern Recognition Letters, 29(15): 2046-2057. [online]
  13. Conniss, L. R., Ashford, A. J. and Graham, M. E. 2000. Information Seeking Behavior in Image Retrieval: VISOR I Final Report. Library and Information Commission Research Report, 95. Newcastle upon Tyne: Institute for Image Data Research, University of Northumbria at Newcastle.
  14. Cunningham, S. J. and M. Masoodian. 2006. "Looking for a Picture: An Analysis of Everyday Image Information Searching." In Proceedings of the 6th ACM/IEEE-CS Joint Conference, June 11-15, 2006, Chapel Hill, NC: 198-199.
  15. Holscher, C. and Strube, G. 2000. "Web Search Behavior of Internet Experts and Newbies." Computer networks, 33(1): 337-346.
  16. Hung, T. Y., Zoeller, C. and Lyon, S. 2005. "Relevance Judgments for Image Retrieval in the Field of Journalism: A Pilot Study." Lecture Notes in Computer Science, 3815: 72-80.
  17. Jansen, B. J., Spink, A. and Saracevic, T. 2000. "Real Life, Real Users, and Real Needs: A Study and Analysis of User Queries on the Web." Information Processing & Management, 36(2): 207-227.
  18. Markkula, M. and Sormunen, E. 2000. "End-User Searching Challenges Indexing Practices in the Digital Newspaper Photo Archive." Journal Information Retrieval, 1(4): 259-285.
  19. Mizzaro, S. 1997. "Relevance: The Whole History." Journal of the American Society for Information Science, 48(9): 810-832.<810::AID-ASI6>3.0.CO;2-U
  20. Pu, H. 2008. "An Analysis of Failed Queries for Web Image Retrieval." Journal of Information Science, 34(3): 275-289.
  21. Saracevic, T. 1996. "Relevance Reconsidered." In Proceedings of the 2nd Conference on Conceptions of Library and Information Science, October 13-16, 1996, Copenhagen: Royal School of Librarianship: 201-218.
  22. Schamber, L. 1994. "Relevance and Information Behaviour." Annual Review of Information Science and Technology, 29: 3-48.
  23. Silverstein, C. et al. 1999. "Analysis of a Very Large Web Search Engine Query Log." ACM SIGIR Forum, 33(1): 6-12.
  24. Xu, Y. and Chen, Z. 2006. "Relevance Judgment: What Do Information Users Consider Beyond Topicality?" Journal of the American Society for information Science and Technology, 57(7): 961-973.