International Journal of Contents

The Korea Contents Association (한국콘텐츠학회)
권호 표지
DOI QR코드

DOI QR Code

User Perceptions of Uncertainty in the Selection of Information Retrieval System: Implications for System and Service Improvement

  • Kim, Yang-Woo (Division of Knowledge & Information, Hansung University)
  • Published : 2009.09.28
Download PDF
⟨ Previous Next ⟩

Abstract

While numerous studies have suggested the significance of uncertainty during the process of information-seeking, less research has investigated user uncertainty in the actual search process using a real system. This study investigated user perceptions of uncertainty in the process of the selection of information retrieval system in the real information-seeking process. Considering the role of commercial Web search engines as supplementary tools for traditional bibliographic databases in academic research environments, this study analyzed the selection behavior of scholarly researchers, who use such search tools for their academic study. The researchers were limited to the discipline of science in order to understand user perceptions in this field. The findings revealed various dimensions, types, and incidents of uncertainty. Variations appeared in different incidents of uncertainty relating to the unique characteristics of the subjects' information-seeking context. The identification of three principal origins of uncertainty based on the different types of uncertainty generated implications to improve information systems and services.

Keywords

References

  1. S. Artandi, "Information concepts and their utility," Journal of the American Society for Information Science, vol. 24, 1973, pp. 242-245. https://doi.org/10.1002/asi.4630240403
  2. C.E. Shannon and W. Weaver, The mathematical theory of communication, University of Illinois Press, Urbana, IL, 1949.
  3. B. Whittemore and M.C. Yovits, "A generalized conceptual development for the analysis and flow of information," Journal of the American Society for Information Science, vol. 24, 1973, pp. 221-231. https://doi.org/10.1002/asi.4630240308
  4. S. Taylor, "Questions-negotiation and information seeking in libraries," College and Research Libraries, vol. 29, 1968, pp. 178-194. https://doi.org/10.5860/crl_29_03_178
  5. N.J. Belkin, "Anomalous states of knowledge as the basis for information retrieval," Canadian Journal of Information Science, vol. 5, 1980, pp. 133-143.
  6. B. Dervin, An overview of sense making research: Concepts, methods, and results to date, School of Communication, University of Washington, Seattle, WA, 1983.
  7. P. Ingwersen, Information retrieval interaction, Taylor Graham, London, 1992.
  8. P. Ingwersen, "Cognitive perspective of information retrieval interaction: Elements of a cognitive IR theory," Journal of Documentation, vol. 52, no. 1, 1996, pp. 3-50. https://doi.org/10.1108/eb026960
  9. D. Gerhan, "When quantitative analysis lies behind a reference question," Reference and User Services Quarterly, vol. 39, no. 2, 1999, pp. 166-185.
  10. P. Ingwersen, "Search procedures in the library analyzed for the cognitive point of view," Journal of Documentation. vol. 38, no. 3, 1982, pp. 165-191. https://doi.org/10.1108/eb026727
  11. G. Michell and P. Dewdney, "Mental models theory: Applications for library and information science," Journal of Education for Library and Information Science, vol. 39, 1998, pp. 275-281. https://doi.org/10.2307/40324303
  12. N.D. Stevens, "The importance of the verb in the reference questions," The Reference Librarian, vol. 22, 1988, pp. 241-244.
  13. M. Bates, "Subject access to online catalogs: A design model," Journal of the American Society for Information Science, vol. 37, 1986, pp. 357-376. https://doi.org/10.1002/(SICI)1097-4571(198611)37:6<357::AID-ASI1>3.0.CO;2-H
  14. C.J. van Rijsbergen, "Information, logic, and uncertainty in information science," Proc. CoLIS 2 - Second International Conference on Conceptions of Library and Information Science: Integration in Perspective, 1996, p. 1-10.
  15. C.C. Kuhlthau, "Accommodating the user's information search process: Challenges for information retrieval system designers," Bulletin of the American Society for Information Science, Feb/Mar. 1999, pp. 12-15.
  16. L. Rodriguez, "Uncertain relevance judgments: A quantitative and qualitative study," Proc. Great Lakes Conference, 2000, p.17-25.
  17. A. Spink, "Partial relevance judgments during interactive information retrieval: An exploratory study," Proc. The 60th ASIS Annual Meeting, 1997, pp. 111-122.
  18. A. Spink and H. Greisdorf, "Users' partial relevance judgments during online searching," Online and CD-ROM Review, vol. 21, 1997, pp. 271-279. https://doi.org/10.1108/eb024631
  19. A. Spink, H. Greisdorf and J. Bateman, "From highly relevant to not relevant: Examining different regions of relevance," Information Processing and Management, vol. 34, 1998, pp. 599-621. https://doi.org/10.1016/S0306-4573(98)00025-9
  20. C. C. Kuhlthau, "A principle of uncertainty for information seeking," Journal of Documentation, vol. 49, no. 4, 1993, pp. 339-355. https://doi.org/10.1108/eb026918
  21. C. C. Kuhlthau, Seeking meaning: A process approach to library and information services, Ablex Publishing Corporation, Norwood, NJ, 1993.
  22. T. D. Wilson, D. Ellis and N. Ford, Uncertainty in information seeking: A research project in the Department of Information Studies, University of Sheffield, Sheffield, UK, 2000, Available at: http://www.shef.ac.uk/-is/research/imrg/uncerty.html, accessed 28 Nov. 2008.
  23. T. D. Wilson, D. Ellis, N. Ford and A. Foster, "Uncertainty in information seeking. Final report to the British Library Research and Innovation Centre/Library and Information Commission on a research project carried out at the Department of Information Studies," Library and Information Commission Research Report vol. 59, 1999, Available at: http://www.shef.ac.uk/-is/publications/unis/, accessed 28 Nov. 2008.
  24. T. D. Wilson, N. Ford, D. Ellis, A. Foster and A. Spink, "Information seeking and mediated searching. Part 2. Uncertainty and its correlates," Journal of the American Society for Information Science and Technology, vol. 53, no. 9, 2002, pp. 704-715. https://doi.org/10.1002/asi.10082
  25. A. Pollock & A. Hockley, "What's wrong with Internet searching," D-Lib Magazine, vol. 3, 1996, 1-5, Available at: http://www.dlib.org/march97/bt/03pollock.html, accessed 28 Mar. 2009.
  26. B. J. Jansen, A . Spink and T. Saracevic, "Real life, real users, and real needs: A study and analysis of user queries on the web," Information Processing and Management, vol. 36, no. 2, 2000, pp. 207-227. https://doi.org/10.1016/S0306-4573(99)00056-4
  27. W. Lucas and H. Topi, "Form and function: The impact of query term and operator usage on Web search results," Journal of the American Society for Information Science and Technology, vol. 53, no. 2, 2002, pp. 95-108. https://doi.org/10.1002/asi.10013
  28. M. Gordon and P. Pathak, "Finding information on the World Wide Web: The retrieval effectiveness of search engines," Information Processing and Management, vol. 35, 1999, pp. 141-180. https://doi.org/10.1016/S0306-4573(98)00041-7
  29. P. Wang, M. W. Berry and Y. Yang, "Mining longitudinal Web queries: Trends and Patterns," Journal of the American Society for Information Science and Technology, vol. 54, no. 8, 2003, pp. 743-758. https://doi.org/10.1002/asi.10262
  30. N. Ford, D. Miller and N. Moss, "Web search strategies and approaches to studying," Journal of the American Society for Information Science, vol. 54, no. 6, 2003, pp. 473-489. https://doi.org/10.1002/asi.10233
  31. L. T. Su, "A comprehensive and systematic model of user evaluation of Web search engines: II. An evaluation by undergraduates," Journal of the American Society for Information Science and Technology, vol. 54, no. 13, 2003, pp. 1193-1223. https://doi.org/10.1002/asi.10334
  32. M. A. Fitzgerald and C. Galloway, "Relevance judging, evaluation, and decision making in virtual libraries: A descriptive study," Journal of the American Society for Information Science and Technology, vol. 52, no. 12, 2001, pp. 989-1010. https://doi.org/10.1002/asi.1152
  33. G. K. Rousseau, B.A. Jamieson, W. A. Rogers, S. E. Mead and R. A. Sit, "Assessing the usability of on-line library systems," Behavior and Information Technology, vol. 17, 1998, pp. 274-281. https://doi.org/10.1080/014492998119346
  34. R. Fidel, R. K. Davies, M. H. Douglass, J. K. Holder, C. J. Hopkins and E.J. Kushner, "A visit to the information mall: Web searching behavior of high school students," Journal of the American Society for Information Science, vol. 50, no. 1, 1999, pp. 24-37. https://doi.org/10.1002/(SICI)1097-4571(1999)50:1<24::AID-ASI5>3.0.CO;2-W
  35. P. Wang, W. B. Hawk and C. Tenopir, "Users' interaction with World Wide Web resources: An exploratory study using a holistic approach," Information Processing & Management, vol. 36, no. 2, 2000, pp. 229-251. https://doi.org/10.1016/S0306-4573(99)00059-X
  36. A. Strauss and J. Corbin, Basics of qualitative research: Grounded theory procedures and techniques, SAGE Publications, Newbury Park, CA, 1990.
  37. A. Strauss and J. Corbin, Basics of qualitative research: Techniques and procedures for developing grounded theory (2nd ed.), SAGE Publications, Newbury Park, CA, 1998.