Journal of the Korean Society for information Management (정보관리학회지)

Korean Society for Information Management (한국정보관리학회)
권호 표지
DOI QR코드

DOI QR Code

Developing an Assessment Model of Library Open Data Quality

도서관의 오픈 데이터 품질측정모델 개발

  • 박진호 (주식회사 리스트 사업개발본부)
  • Received : 2018.02.13
  • Accepted : 2018.03.11
  • Published : 2018.03.30
Download PDF
⟨ Previous Next ⟩

Abstract

This study draws on the current momentum to diversify open government data research through multidimensional scaling and model development. It formulates a quality assessment model applicable to library open data, taking into consideration the paucity of such research in the field. The model was developed using the Delphi method and verified for validity and reliability on the basis of a survey administered to library open data users. The results of the fourth round exhibited an average of 4.00 for all measured elements and a minimum validity of .75, rendering the model appropriate for use in quality assessments of library open data. The convergence and stability results provided by the expert panel fell below .50, confirming that there was no need to conduct further surveys in order to establish the validity of the Delphi method. The model's reliability likewise garnered results of .60 and above in all three dimensions. This Model completed with the input of the Delphi panel was put through a verification process in which library open data users such as domestic and international librarians, developers, and open data activists reviewed the model for validity and reliability. The model scored low on validity on account of its failure to load all measure factors and elements pertaining to the three dimensions. Reliability results, on the other hand, were at 0.6 and above for all dimensions and measured elements.

본 연구는 최근 열린 정부 데이터에 대한 다차원 척도, 모델 개발 연구가 시작되고 있으나, 도서관에서는 관련 연구가 부족하다는 점을 고려하여 도서관에 적용할 수 있는 오픈 데이터 품질측정 모델개발을 목적으로 하였다. 본 연구는 모델개발과 모델평가 두 단계로 수행하였다. 모델개발은 델파이 기법을 적용하였으며, 모델평가는 도서관 오픈 데이터 이용자를 대상으로 설문조사를 실시하여 모델의 타당도와 신뢰도를 측정하였다. 모델개발은 델파이 기법을 적용하여 총 4차례 수행하여 3개 차원, 18개 요인, 133개 측정요소로 구성된 모델을 도출하였다. 모델평가는 델파이 기법으로 완성한 모델을 도서관 오픈 데이터 이용자인 국내 외 사서, 개발자, 오픈 데이터 활동가를 대상으로 적합성 설문조사를 실시하여 모델의 타당도와 신뢰도를 검증하였다. 그 결과 당초 18개 요인, 133개 측정요소는 15개 요인, 54개 측정요소가 타당성을 확보한 것으로 나타났다. 신뢰도는 차원별, 측정요인별로 모두 기준치인 0.6 이상의 결과를 보여주고 있어 높은 신뢰도를 확보한 것으로 나타났다. 모델평가를 통한 이용자 타당도, 신뢰도 분석으로 전문가가 구성한 평가모델은 현장에서 즉시 활용될 수 있을 정도로 정제되었다.

Keywords

References

  1. 강병서, 김계수 (2009). (SPSS 17.0)사회과학 통계분석. 서울: 한나래. Kang, Byoung Seo, & Kim, Kye Su (2009). (SPSS 17.0) Social science statistical analysis. Seoul: Hannarae.
  2. 강용주 (2008). 델파이 기법의 이해와 적용사례(수시 08-20). 서울: 한국장애인고용공단 고용개발원. Kang, Yong Joo (2008). Understanding and application of delphi technique. Seoul: Employment Development Institute.
  3. 김선애, 이수상 (2006). KOLIS - NET 종합목록 DB의 품질평가. 한국문헌정보학회지, 40(1), 95-117. Kim, Sun Ae, & Lee, Soo Sang (2006). Quality evaluation of a shared cataloging DB: The case of KOLIS-NET. Journal of the Korean Society for Library and Information Science, 40(1), 95-117. https://doi.org/10.4275/KSLIS.2006.40.1.095
  4. 노승용 (2006). 델파이 기법(Delphi Technique): 전문적 통찰로 미래예측하기. 국토, 53-62. Rho, Seung Yong (2006). Delphi technique: Expert insight into the future. Ministry of Land, Infrastructure and Transport, 53-62.
  5. 노지현 (2015). 주제명 데이터를 통해 본 현행 목록의 품질과 과제. 한국도서관․정보학회지, 46(4), 379-402. https://doi.org/10.16981/kliss.46.4.201512.379 Rho, Jee Hyun (2015). A study on the quality of subject data in library catalogs. Journal of Korean Library and Information Science Society, 46(4), 379-402. https://doi.org/10.16981/kliss.46.4.201512.379
  6. 박미영, 김민정, 승현우 (2008). 데이터베이스 시스템 품질 평가 모듈 개발에 관한 연구. 한국도서관․정보학회지, 39(4), 305-329. Park, Mi Young, Kim, Min Jung, & Seung, Hyon Woo (2008). A study on the development of the quality assessment modules of database system. Journal of Korean Library and Information Science Society, 39(4), 305-329.
  7. 박치동 (2010). 델파이와 AHP 기법을 활용한 이러닝 기반 교원연수 프로그램 평가 모형 개발 연구. 박사학위논문, 숭실대학교 대학원, 평생교육학과. Park, Chi Dong (2010). Development of an evaluation model for e-learning based teacher training programs using the Delphi and AHP method. Unpublished master's thesis, Soongsil University, Seoul, KOREA.
  8. 백지원, 정연경 (2014). 국립중앙도서관 주제명표목표 검색 시스템 개선 방안에 관한 연구. 정보관리학회지, 31(1), 31-51. http://dx.doi.org/10.3743/KOSIM.2014.31.1.031 Baek, Ji Won, & Chung, Yeon Kyoung (2014). A study on improving access & retrieval system of the National Library of Korea subject headings. Journal of the Korean Society for Information Management, 31(1), 31-51. http://dx.doi.org/10.3743/KOSIM.2014.31.1.031
  9. 송지준 (2008). 논문작성에 필요한 SPSS/AMOS통계분석방법. 서울: 21세기사. Song, Ji Jun (2008). SPSS/Amos statistical analysis method for writing paper. Seoul: 21CBook.
  10. 유인호, 조명환, 이응호, 류희룡, 김영철 (2012). 델파이 설문조사를 통한 토마토 재배시설 평가지표개발. 생물환경조절학회지, 21(4), 466-477. Yu, In Ho, Cho, Myeong Whan, Lee, Eung Ho, Ryu, Hee Ryong, & Kim, Young Chul (2012). Development of evaluation indicators of greenhouse for tomato cultivation using delphi survey method. Journal of Bio-Environment Control, 21(4), 466-477.
  11. 윤정옥 (2003). 연속간행물 종합목록 데이터베이스의 레코드 품질 평가. 한국문헌정보학회지, 37(1), 27-42. Yoon, Cheong Ok (2003). Evaluation of the quality of records of the serials union catalog database. Journal of the Korean Society for Library and Information Science, 37(1), 27-42. https://doi.org/10.4275/KSLIS.2003.37.1.027
  12. 이유정 (2006). 공동목록시스템(UNICAT) 품질평가에 관한 연구. 한국도서관․정보학회지, 37(3), 289-307. Lee, You Jeong (2006). A study on quality evaluation of the UNICAT. Journal of Korean Library and Information Science Society, 37(3), 289-307.
  13. 이응봉 (1996). 전문데이터베이스의 탐색특성에 관한 연구- 주제전문가와 탐색전문가-. 한국문헌정보학회지, 30(2), 51-86. Lee, Eung-Bong (1996). A study of the behaviours in searching full-text databases: Subject specialist vs. professional searchers. Journal of the Korean Society for Library and Information Science, 30(2), 51-86.
  14. 이응봉, 조현양, 류범종, 최재황 (2001). 과학기술분야 데이터베이스의 품질향상을 위한 품질평가 연구. 한국문헌정보학회지, 35(2), 109-132. Lee, Eung Bong, Cho, Hyun yang, You, Beom Jong, & Choi, Jae Hwang (2001). A study of the quality evaluation for improving the database quality in scientific and technical fields. Journal of the Korean Society for Library and Information Science, 35(2), 109-132.
  15. 이제환 (1997). 과학기술분야 서지 DB의 품질관리 및 평가 방안: KORDIC의 KRISTAL DB를 중심으로. 한국문헌정보학회지, 31(3), 109-134. Lee, Jae Whoan (1997). Methods for quality control and evaluation in the scientific and technical bibliographic databases. Journal of the Korean Society for Library and Information Science, 31(3), 109-134.
  16. 이제환 (2002). 공동목록 DB의 품질평가와 품질관리: KERIS의 종합목록 DB를 중심으로. 한국문헌정보학회지, 36(1), 61-89. Lee, Jae Whoan (2002). Quality evaluation and management of a shared cataloging DB: The case of KERIS Unicat Db. Journal of the Korean Society for Library and Information Science, 36(1), 61-89. https://doi.org/10.4275/KSLIS.2002.36.1.061
  17. 이종성 (2001). 연구방법 21: 델파이 방법. 서울: 교육과학사. Lee, Jong Sung (2001). Research methodology 21: Delphi technique. Seoul: Kyoyookbook.
  18. 이춘열, 박현지 (2004). 데이터베이스 품질 평가에 관한 사례 연구. 한국데이타베이스학회, 11(4), 209-225. Lee, Choon Yeul, & Park, Hyun Jee (2004). A case study on database quality and quality factors. Journal of Information Technology Applications & Management, 11(4), 209-225.
  19. 임은애, 손기철, 감정기 (2012). 전문가 델파이 조사를 통한 원예치료 평가지표 구성요소 개발. 원예과학기술지, 30(3), 308-324. http://dx.doi.org/10.7235/hort.2012.12037 Im, Eun Ae, Son, Ki Cheol, & Kam, Jeong Ki (2012). Development of elements of horticultural therapy evaluation indices (HTEI) through delphi method. Horticultural Science and Technology, 30(3), 308-324. http://dx.doi.org/10.7235/hort.2012.12037
  20. 임재필 (2014). 델파이기법을 활용한 한국취항 외국항공사의 기업영업전략 요인 도출에 관한 연구. 관광레저연구, 26(6), 379-396. Lim, Jae Pil (2014). A study on factors of corporate sales strategy of foreign carriers operating in korea using delphi method. Journal of Tourism & Leisure Research, 26(6), 379-396.
  21. 임정주, 노지현 (2015). 도서관목록의 주제 접근성 향상을 위한 주제명 데이터의 품질 비교. 한국도서관․정보학회 하계 학술발표회, 193-202. Yim, Jung Ju, & Rho, Jee Hyun (2015). A comparative study on quality of subject data in library catalogs, bookstore, social tagging site. KLISS 2015 Proceedings of the Summer International Conference, 193-202.
  22. 최윤경, 정연경 (2014). 국립중앙도서관 주제명표목표의 고품질화 방안에 관한 연구. 한국문헌정보학회지, 48(1), 75-95. http://dx.doi.org/10.4275/K8LI8.2014.48.l.075 Choi, Yoon Kyung, & Chung, Yeon Kyoung (2014). A study on improvements for high quality in National Library of Korea subject headings list. Journal of the Korean Society for Library and Information Science, 48(1), 75-95. http://dx.doi.org/10.4275/K8LI8.2014.48.l.075
  23. 최인숙 (2004). 디지털자료실지원센터 종합목록 데이터 품질평가 및 관리 방안. 한국문헌정보학회지, 38(3), 119-139. Choe, In Sook (2004). Evaluation and quality control of data in the digital library system. Journal of the Korean Society for Library and Information Science, 38(3), 119-139. https://doi.org/10.4275/KSLIS.2004.38.3.119
  24. 한국데이터베이스진흥센터 (2000). 데이터베이스 품질평가 항목. 서울: 한국데이터베이스진흥센터. Korea Database Promotion Center (2000). Database quality evaluation index. Seoul: Korea Database Promotion Center.
  25. 홍석수, 서재현 (2013). 델파이 기법을 활용한 절충교역 기술가치평가 분석지표 개발. 기술혁신학회지, 16(1), 252-278. Hong, Seok Soo, & Seo, Jae Hyun (2013). Development of the technology valuation analysis indicators using the delphi method in the offset program. Journal of Korea Technology Innovation Society, 16(1), 252-278.
  26. 홍현진 (2005). 웹 기반 데이터베이스의 품질평가 기준 개발에 관한 연구. 한국문헌정보학회지, 39(2), 211-235. Hong, Hyun Jin (2005). A study on the development of the quality evaluation standard of web-based databases. Journal of the Korean Society for Library and Information Science, 39(2), 211-235. https://doi.org/10.4275/KSLIS.2005.39.2.211
  27. 황재영 (2010). 디지털도서관의 서비스 품질 측정모형 개발과 적용에 관한 연구. 박사학위논문, 충남대학교 대학원, 문헌정보학과. Hwang, Jae Young (2010). A study on the development and application of service quality measurement model for digital libraries. Unpublished master's thesis, University of Chungnam National University, Daejeon, KOREA.
  28. Armstrong, C. J. (1995). Database information quality. Library & Information Briefings, no. 62. London: South Bank University.
  29. Brodie, M. L. (1980). Data quality in information systems. Information & Management, 3(6), 245-258. https://doi.org/10.1016/0378-7206(80)90035-X
  30. Debreceny, R., Farewell, S., Piechocki, M., Felden, C., & Graning, A. (2010). Does it add up? Early evidence on the data quality of XBRL filings to the SEC. Journal of Accounting and Public Policy, 29(3), 296-306. https://doi.org/10.1016/j.jaccpubpol.2010.04.001
  31. Fox, C., Levitin, A., & Redman, T. (1994). The notion of data and its quality dimensions. Information Processing & Management, 30(1), 9-19. https://doi.org/10.1016/0306-4573(94)90020-5
  32. Granick, L. (1991). Assuring the quality of information dissemination: Responsibilities of database producers. Information Services & Use, 11(3), 117-136. https://doi.org/10.3233/ISU-1991-11304
  33. Howard, P. (2004). Data Quality Products: an evaluation and comparison. UK: Bloor Research.
  34. Jacso, P. (1995). Testing the quality of CD-ROM databases. Eletronic Information Delivery: Ensuring Quality and Value, Etats-Unis, Hampshire: Grower, 141-168.
  35. Jacso, P. (1997). Content evaluation of databases. Annual Review of Information Science and Technology, 32, 231-267.
  36. Janssen, M., Charalabidis, Y., & Zuiderwijk, A. (2012). Benefits, adoption barriers and myths of open data and open government. Information Systems Management, 29(4), 258-268. https://doi.org/10.1080/10580530.2012.716740
  37. Lawshe, C. H. (1975). A quantitative approach to content validity. Personnel Psychology, 28(4), 563-575. https://doi.org/10.1111/j.1744-6570.1975.tb01393.x
  38. Lee, S., Shin, B., & Lee, H. G. (2009). Understanding post-adoption usage of mobile data services: The role of supplier-side variables. Journal of the Association for Information Systems, 10(12), 2. https://doi.org/10.17705/1jais.00217
  39. Lee, Y. W., Pipino, L. L., Funk, J. D., & Wang, R. Y. (2009). Journey to data quality. The MIT Press.
  40. Miller, H. (1996). The multiple dimensions of information quality. Information Systems Management, 13(2), 79-82. https://doi.org/10.1080/10580539608906992
  41. Nelson, R. R., Todd, P. A., & Wixom, B. H. (2005). Antecedents of information and system quality: an empirical examination within the context of data warehousing. Journal of Management Information Systems, 21(4), 199-235. https://doi.org/10.1080/07421222.2005.11045823
  42. Palmer, M. (2006). Data is the new oil. Retrieved from http://ana.blogs.com/maestros/2006/11/data_is_the_new.html
  43. Piattini, M., & Diaz, O. (2000). Advanced database technology and design. Artech House, Inc.
  44. Vetro, A., Canova, L., Torchiano, M., Minotas, C. O., Iemma, R., & Morando, F. (2016). Open data quality measurement framework: Definition and application to open government data. Government Information Quarterly, 33(2), 325-337. https://doi.org/10.1016/j.giq.2016.02.001