A Review of Hospital Information System Quality Evaluation from the Viewpoint of Software Usability

병원정보시스템 품질 평가에 대한 소프트웨어 사용성 관점에서의 고찰

  • Published : 2007.08.31

Abstract

This study is to propose the characteristics that a desirable quality, especially usability, evaluation method of hospital information systems(HIS) should possess. This study reviews the literature recently published in the academic journals which are in the Science Citation Index or registered by the Korean Research Foundation. Especially, the International Journal of Medical Informatics was the valuable source, providing almost 20 literature. The results reveal the need to develop a domain-specific usability evaluation method that reflects the uniqueness of hospital industry. The results show user-centeredness and context-orientedness are the indispensible characteristics of a HIS quality evaluation method too.

본 연구는 병원정보시스템 품질 평가에 대한 문헌들을 고찰하고, 소프트웨어 품질 속성과 측정 내용들을 분석하여 병원산업의 특성을 반영한 바람직한 정보시스템 평가 방법의 제안에 있다. 병원정보시스템 품질 평가의 척도와 내용들은 주관적이며 일관성이 결여된 내용들이 주를 이루고 있었고, 가장 많이 채택된 척도는 만족도이었다. 또한 ISO9241-11에서 제시된 사용성 측정 내용들과 병원정보시스템에서 사용된 품질 측정항목들을 비교해 보면, 같은 품질척도에서도 전혀 다른 품질 측정 내용을 사용하고 있는 것으로 조사되었고, 병원 산업의 특수성을 나타내기에도 매우 단편적이며 구체성이 결여되어 있었다. 결국 병원산업의 특수성과 품질 평가의 활용도를 증진시키는 방법은 ISO9241-11과 같은 표준 품질 모델과 업무 맥락의 관점에서 사용자 중심의 품질평가 항목 개발이 필요하다.

Keywords

References

  1. 간협신문, '2004 국감자료 통해 본 보건의료 현 주소', 2004
  2. 고석하, 비즈니스시스템 분석 및 설계, 대영사, 2003
  3. 고석하, 소프트웨어 프로젝트 관리, 생능출판사, 2007
  4. 김성언, 강동진, '경쟁우위 전략에 따른 병원정보시스템 구조가 시스템 수행성과에 미치는 영향', Journal of Business Research Korea Association, 제14권, 제2호, 1999, pp. 197-216
  5. 김창엽, 강길원, 이진석, 김병익, 김용익, 신영수, '국내 병원정보시스템의 도입 현황', 대한의료정보학회지, 제5권, 제1호, 1999a, pp. 27-34
  6. 김창엽, 강길원, 황지인, 하범만, 김병익, 김용익, 신영수, '처방 전달체계 도입에 따른 사용 자의 업무형태변화와 만족도 및 적응도 조사', 대한의료정보학회지, 제5권, 제1호, 1999b, pp. 51-66
  7. 동아일보, '진료비 과다청구 병원 많다', 1998
  8. 동아일보, '전염병, 건보관리 구멍', 2001
  9. 동아일보, '병원, 약국 5곳 중 1곳 진료비 부풀려 청구', 2004
  10. 동아일보, '환자도 알권리 의료정보 더 공개해야', 2006a
  11. 동아일보, '중복처방 피해 노인, 한해 65만 명', 2006b
  12. 동아일보, '보험급여 부당 허위 청구시 의료기관 설명공개', 2007a
  13. 동아일보, '허위진료기록 산재진료비 청구의료기관 무더기 적발', 2007b
  14. 대전일보, '의사들이 억대 보험사기', 2005a
  15. 대전일보, '진료비 허위청구', 2005b
  16. 메디팜뉴스, '심사비 청구 오류', 2004
  17. 메디팜뉴스, '진료정보 유출, 정보인권침해 우려 크다', 2006
  18. 박찬석, 고석하, '종합병원 구성원의 정보욕구에 의한 분류', Journal of Information Technology Applications & Management, 제10권, 제2호, 2003, pp. 44-57
  19. 박찬석, 경원현, 고석하, '종합병원정보시스템 사용자들의 정보결핍에 관한 연구', 대한의료정보학회지, 제10권, 제3호, 2004, pp. 223-233
  20. 박창례, 최성녀, '병원정보시스템의 최종사용자 만족에 대한 사례연구', 강릉대학교 산경론집, 1998, pp. 124-136
  21. 서울대학교병원, 서울대학교 업무분장규정, 서울대학교병원 규정집, 2006, pp. 284-366
  22. 유승흠, 병원경영 이론과 실제, 수문사, 1998
  23. 임배만, 류규수, '병원정보시스템의 유효성 평가와 영향요인에 관한 실증적 연구', 병원경영학회지, 제6권, 제2호, 1996, pp. 116-138
  24. 정영철, 송현종, 이견직, '보건의료부문 정보화사업 전략적 평가모형개발', Korea Institute for Health and Social Affairs, 2003, pp. 69-173
  25. 정호원, 양해술, ISO 시리즈와 소프트웨어 품질 시스템, 하이테크정보사, 1993
  26. 조선일보, '동네병원에서 받은 검사 왜 또 받아야 해?', 2006
  27. 조현, 양진선, 이인희, 이현경, 이용철, 한창훈, 임정도, '병원정보시스템 도입후 업무만족도에 영향을 미치는 요인에 관한 연구', 대한의료정보학회지, 제5권, 제1호, 1999, pp. 37-49
  28. 중앙일보, '대형병원, 기준위반 진료 최다', 2006
  29. 충남대학교병원, 충남대학교병원 업무분장규정, 충남대학교병원 규정집, 2006, pp. 302-335
  30. Aarts, J., J. Ash, and M. Berg, 'Extending the Understanding of Computerized Physician Order Entry: Implications for Professional Collaboration Workflow and Quality of Care', International journal of Medical Informatics article in press, 2006, pp. 23-36
  31. Abran, A., A. Khelifi, and W. Suryn, 'Usability Meanings and Interpretation in ISO Stanards', Software Quality Journal, Vol.11, No.4, 2003, pp. 325-338 https://doi.org/10.1023/A:1025869312943
  32. Abraham, J., R. Feldman, and C. Carlin, 'Understanding Employee Awareness of Health Care Quality Information: How Can Employers Benefit?', Health Services Research, Vol.36, No.6, 2004, pp. 1799-1817
  33. Ammenwerth, E., F. Ehlersa, B. Hirsch and G. Grad, 'HIS-Monitor: An Approach to Assess the Quality of Information Processing in Hospitals', International journal of Medical Informatics article in press, 2006, pp. 13-28
  34. Ammenwerth, E., S. Graber, G. Herrman, T. Burkle, and J. Honig, 'Evaluation of Health Information Systems-Problems and Challenges', International Journal of Medical Informatics, Vol.71, No.2, 2003, pp. 125-135 https://doi.org/10.1016/S1386-5056(03)00131-X
  35. Bevan, N. and M. Macleod, 'Usability Measurement in Context', Behavior and Information Technology, Vol.13, No.1, 1994, pp. 132-145 https://doi.org/10.1080/01449299408914592
  36. Beyer, H. and K. Holtzblatt, Contexual Design: Defining Customer Centered Systems, Morgan Kaufmann Press, San Francisco, CA, 1998
  37. Boehm, B. W., Software Engineering Economics, Prentice Hall, 2001
  38. Borst, F., R. Appel, R. Baud, Y. Ligier, and J. R. Scherrer, 'Happy Birthday DIOGENE: A Hospital Information System Born 20 Years Ago', International Journal of Medical Informatics, Vol.54, No.2, 1999, pp. 157-167 https://doi.org/10.1016/S1386-5056(99)00004-0
  39. Carroll, C., P. Marsden, P. Soden, E. Naylor, J. New, and T. Dornan, 'Involving Users in the Design and Usability Evaluation of a Clinical Decision Support System', Journal of Computer Methods and Programs in Biomedicine, No.32, No.1, 2002, pp. 123-135
  40. Cooper, D. and Schindler P. S., Business Research Methods, Published by McGraw-Hill Higher Education Companies Inc, New York, NY, 2003
  41. Dix, A., J. Finlay, G. Abowd, and R. Beale, Human-Computer Interaction, Englewood Cliffs, NJ: Prentice-Hall, 1989
  42. Folmer, E. and J. Bosch, 'Architecting for Usability: A Survey', The Journal of Systems and Software, Vol.70, No.2, 2004, pp. 61-78 https://doi.org/10.1016/S0164-1212(02)00159-0
  43. Forsstrom, J. J. and M. Rigby, 'Considerations on the Quality of Medical Software and Information Services', International Journal of Medical Informatics, Vol.56, No.1, 1999, pp. 169-176 https://doi.org/10.1016/S1386-5056(99)00044-1
  44. Glass, R. L., 'Defining Quality Intuitively', IEEE Software, Vol.5, No.6, 1998, pp. 103-106
  45. Gremy, F., J. M. Fessler and M. Bonnin, 'Information Systems Evaluation and Subjectivity', International Journal of Medical Informatics, Vol.56, No.1, 1999, pp. 13-23 https://doi.org/10.1016/S1386-5056(99)00034-9
  46. Hanmer, L., 'Criteria for Evaluation of District Health Information Systems', International Journal of Medical Informatics, Vol.56, No.1, 1996, pp. 161-168 https://doi.org/10.1016/S1386-5056(99)00046-5
  47. Haux, H., 'Health Information Systems-Past, Present, Future', International Journal of Medical Informatics, Vol.75, No.2, 2006, pp. 268-281 https://doi.org/10.1016/j.ijmedinf.2005.08.002
  48. Hellens, L. A., 'Information Systems Quality versus Software Quality a Discussion from a Managerial, an Organisational and an Engineering Viewpoint', Information and Software Technology, Vol.39, No.2, 1997, pp. 801-808 https://doi.org/10.1016/S0950-5849(97)00038-4
  49. Hyatt, L. E. and L. H. Rosenberg, 'Software Metrics Program for Risk Assessment', Acta Astronautica, Vol.40, No.2-8. 1997, pp. 223-233 https://doi.org/10.1016/S0094-5765(97)00148-3
  50. ISO/IEC 9126, Information Technology-Software Quality Characteristics and Metrics part 1-part 3, 1997
  51. ISO9241-11, 'Guidance on Usability', 2005(http:// www.iso.org/iso/en.cataloguedetail?csnumber=16883)
  52. Jaana, M, M. M. Ward, G. Pare, and D. S. Wakefield, 'Clinical Information Technology in Hospitals: A Comparison between the State of Iowa and two Provinces in Canada', International Journal of Medical Informatics, Vol.74, No.3, 2005, pp. 719-731 https://doi.org/10.1016/j.ijmedinf.2005.05.009
  53. Johnson, C. M., T. R. Johnson, and J. Zhang, 'A User-Centered Framework for Redesigning Health Care Interfaces', Journal of BioMedical Informatics, Vol.38, No.1, 2005, pp. 75-87 https://doi.org/10.1016/j.jbi.2004.11.005
  54. Kushniruk, A., 'Evaluation in the Design of Health Information Systems: Application of Approaches Emerging from Usability Engineering', Computers in Biology and Medicine, Vol.32, No.2, 2002, pp. 141-149 https://doi.org/10.1016/S0010-4825(02)00011-2
  55. Losavio, F., L. Chirinos, A. Matteo, N. Levy, and A. R. Cherif, 'ISO Quality Standards for Measuring Architectures', The Journal of Systems and Software, Vol. 72 , No.1, 2004, pp. 209-223 https://doi.org/10.1016/S0164-1212(03)00114-6
  56. McCall, J. A., A Framework for the Measurement of Software Quality, The Proceeding of the ACM Software Quality Assurance Proceeding Report, 1978
  57. Nielsen, J., Usability Inspection Methods and Heuristic Evaluation, John Wiley & Sons Inc, New York, NY, 1994
  58. Nielsen, J., Usability Testing. Handbook of Human Factors and Ergonomics 2nd ed, John Wiley & Sons Inc, New York, NY, 1997
  59. Pitt, F. L. and T. R. Watson, and C. B. Kavan, 'Service Quality: A Measure of Information System Effectiveness', MIS Quarterly, Vol.19, No.2, 1995, pp. 173-187 https://doi.org/10.2307/249687
  60. Rakch, J. S. and K. Darr, Managing Health Services Organizations, Saunders Company, Washington State, WS, 1985
  61. Rath. S., C. Heuer, W. Alle, A. Bach, B. Bischoff and M. M. Bonsanto, 'Integration of Generic Indicators for Quality Management in Hospital Information Systems', International Journal of Medical Informatics, Vol.55, No.1, 1999, pp. 79-188
  62. Salmela, H., 'From Information Systems Quality to Sustainable Business Quality', Information and Software Technology, Vol.39, No.3, 1997, pp. 819-825 https://doi.org/10.1016/S0950-5849(97)00040-2
  63. Schulmeyer, G. G. and J. I. Mcmanus, Handbook of software Quality Assurance, Van Nostrand Reinhold Press, New York, NY, 1987
  64. Shackel, B., Usability-Context, Framework, Design and Evaluation, Human Factors for Informatics usability, Cambridge Press, New York, NY, 1991
  65. Sittig, D. F. and W. W. Stead, 'Computer-Based Order Entry: The State of the Art', Journal Am Med Inform Assoc, Vol.1, No.2, 1994, pp. 108-123 https://doi.org/10.1136/jamia.1994.95236142
  66. Southon, G., 'IT, Change and Evaluation: An Overview of the Role of Evaluation in Health Services', International Journal of Medical Informatics, Vol.56, No.1, 1999, pp. 125-133 https://doi.org/10.1016/S1386-5056(99)00043-X
  67. Staccini, P., M. Joubert, J. F. Quaranta, D. Fieschi and M. Fieschi, 'Modelling Health Care Processes for Eliciting User Requirements: A Way to Link a Quality Paradigm and Clinical Information System Design', International Journal of Medical Informatics, Vol.64, No.1, 2001, pp. 129-142 https://doi.org/10.1016/S1386-5056(01)00203-9
  68. Stockman, S. G., A. R. Todd, and Robinson G. A., 'A Framework for Software Quality Measurement', IEEE Journal on Selected Areas In Communications, Vol.8, No.2, 1990, pp. 224-234 https://doi.org/10.1109/49.46876
  69. Terazzi, A., A. Giordano, and G. Minuco, 'How can Usability Measurement Affect the Reengineering Process of Clinical Software Procedures?', International Journal of Medical Informatics, Vol.28, No.1, 1998, pp. 229-234
  70. Whittaker, J. A. and J. M. Voas, '50 Years of Software: Key Principles for Quality', IT Pro IEEE Journal, November/December 2002, pp. 224-234
  71. Wyatt, J. C. and S. M. Wyatt, 'When and How to Evaluate Health Information Systems?', International Journal of Medical Informatics, Vol.69, No.2, 2003, pp. 251-259 https://doi.org/10.1016/S1386-5056(02)00108-9
  72. Zhang, J., T. J. Johnson, V. L. Patel, D. P. Paige, and T. Kubose, 'Using Usability Heuristics to Evaluate Patient Safety of Medical Devices', Journal of BioMedical Informatics, Vol.29, No.1, 2003, pp. 23-30