The Impact of an Ontological Knowledge Representation on Information Retrieval: An Evaluation Study of OCLC's FRBR-Based FictionFinder

정보검색에 온톨로지 지식 표현이 미치는 영향에 대한 연구: OCLC의 FRBR기반 FictionFinder의 평가를 중심으로

  • Published : 2008.06.30


With the purpose of enriching existing catalogues with FRBR, which is the Functional Requirements for Bibliographic Records, in mind, this paper aims to evaluate the impact of bibliographic ontology on the overall system's performance in the field of literature. In doing this, OCLC's FictionFinder( was selected and qualitatively evaluated. In this study 40 university seniors evaluated the following three aspects using the 'transferring thoughts onto paper method': 1) In which ways is this FRBR-aware bibliographical ontology helpful? 2) Are the things which are initially attempted to be helped being helped? 3) Would users seeking one work in particular also see all other related works? In conclusion, this study revealed that, as Cutter claimed in his $2^{nd}$ rule of the library, collocations give added-value to the users and overall ontology provides better interface and usefulness. It also revealed that a system's evaluation with qualitative methodology helped to build full pictures of the system and to grip the information needs of the users when the system is developed. Qualitative evaluations, therefore, could be used as indicators for the evaluation of any information retrieval systems.

이 연구의 목적은 문학 분야의 서지적 온톨로지인 OCLC의 FictionFinder(http://fictionfinder.oclc.erg)를 질적으로 평가하려는 것이다. FictionFinder는 FRBR모델을 기반으로 기존 목록의 질을 향상시켜 더 많은 가치를 부가하기 위해서 만든 모델인데, 이에 이것이 실제로 전반적인 검색 시스템 성능에 어떻게 영향을 끼치는 가를 평가한 것이다. 이를 위하여 40명의 대학교 4학년 학생이 '생각을 종이에 적기 방법'을 이용하여 다음과 같은 세가지면을 평가하였다 어떻게 이 온톨로지가 도움이 되었는가? 처음에 도움이 되리라고 생각되었던 것들이 실제로 도움이 되던가? 어떤 한 군데를 보던 이용자들이 실제로 관련이 되는 다른 곳으로 이동해서 보던가? 그 결과 온톨로지 기반의 정보검색은 Cutter의 두 번째 원칙대로 의미 있게 묶어서 보여주니 이용자에게 부가가치를 주었으며 인터페이스의 유용성과 사용성을 높여주는 것으로 밝혀졌다. 또한 질적인 방법에 의한 시스템 평가는 시스템 개발 시 전체적인 그림 구축과 이용자의 요구 파악하는데 유용함을 알 수 있었다. 따라서 질적 평가도 정보검색시스템의 평가지표로서 활용될 수도 있을 것으로 본다.


  1. Bates, M. 1985. "An Exploratoty Paradigm for Online Information Retrieval, IN B.C. Brookes, ed, Intelligent Information Systems for the Information Society." Proceedings of the Sixth International Research fornm in Information Science (IRFIS 6), Frascati, Italy, September 16-18, 1985, Amsterdam: North-Holland, 1986, 91-99
  2. Belkin, N. J., Oddy, RN., Brooks, H.M 1982. "ASK for Information Retrieval. Part I. Background and Theory." Journal of Documentation, 38(2): 61-71
  3. Dervin, B. 1983. "An overview of Sense-Making research: Concepts, methods, and results to date." Paper presented at the annual meeting of the International Communication Association, Dallas, TX
  4. Doll, W. J. 2008. "Using Davis's perceived usefulness and ease-of-use instruments for desision making: A confinnatory and multi group invariance analysis." Decision Sciences. Fall 1998. 24 May. 2008.
  5. Ericsson, K. & Simon, H. 1987 . "Verbal reports on thinking," in C. Faerch & G. Kasper (eds.): Introspection in Second Language Research. Clevedon, Avon: Multilingual Matters, 24-54
  6. Fiction Finder. Online Computer Libraty Center (DCLC).
  7. Jeng, Judy 2007. "Metadata Usefulness Evaluation." $26^{th}$ Annual ALA Poster Sessions, June 21-27, 2007.
  8. Hegna, K. 2004. "Using FRBR" HEP Libraries Webzine Issue 10 / December 2004
  9. Kaplan, B. and Maxwell, J. A. 1994. "Qualitative Research Methods for Evaluating Computer Information Systems," in Evaluating Health Care Information Systems: Methods and Applications, J.G. Anderson, C.E. Aydin and S.J. Jay (eds.), Sage, Thousand Oaks, CA, 1994, 45-68
  10. Lee, S. and Jacob, E. 2007. Construction of a Conceptual Structure as a Mediator between MARC and FRBR:
  11. Library of Congress. 2004. A Conceptual Model for the Bibliographic Universe (Washington, DC: Libnuy of Congress, Cataloging Distribution Service, 2004). Available at:
  12. Pisanski, J. & Zurner, M. 2007. "Functional requirements for bibliographic records: an investigation of two prototypes" in Program: electronic library and information systems. 2007 41(4): 400-417
  13. Poli, R 1996. Ontology for knowledge organization. In R Green (Ed.), Knowledge organization and change (Proceedings of the 4m International ISKO Conference, 15-18 July 1996, Washington, D.C.). Advances in Knowledge Organization,S: 313-319
  14. Siemens, G. 2004. Connectivism: A Learning Theory for the Digital Age,
  15. Soergel, D. 2000. "Classification for User Support and Learning." ASIS&T SIG/CR 2000
  16. Taylor, R. S. 1968. "Question-negotiation and Information seeking in libraries." College and Research Libraries, 29: 178-194
  17. Taylor, R. S. 1986. Value-Added Processes in Infonnation Systems (Norwood, NJ: Ablex, 1986)
  18. Vizine-Goetz, D. 2007. "Fictionfinder: Imagining What a "Next Generation" Catalog Might Look Like." Presentation given at the OCLC Members Council Research and New Technologies Interest Group meeting, 6 February 2007, Quebec, QC (Canada) and Dublin, Ohio (USA). Two versions of this presentation are available: PowerPoint (1.4MB/23 slides) and PDF (1.5MB/14)