Journal of Korean Society of Transportation (대한교통학회지)

Korean Society of Transportation (대한교통학회)
권호 표지

Comparative Study of Subjective Mental Workload Assessment Techniques for the Evaluation of ITS-oriented Human-Machine Interface Systems

지능형 교통체계 기반 인간-기계 인터페이스 시스템 평가를 위한 정신적부하 측정방법의 비교 연구

  • Cha, Doo-Won (Industrial Engineering Department, Ajou University) ;
  • Park, Peom (Industrial Engineering Department. Ajou University)
  • Published : 2001.06.01
Download PDF
⟨ Previous Next ⟩

Abstract

Subjective mental workload assessment technique becomes a standard human factors and human-machine interface evaluation tool for the evaluation of ITS(Intelligent Transport Systems)-oriented information systems as well as the drivers visual activity analysis, physiological indices(GSR, EEG, ECG, etc.), secondary task performance, reaction time. vehicle control parameters(speed, steering behavior, accelerator control) that are widely applied for transportation and vehicle systems to evaluate the safety, to decide the system or design alternatives, and to establish the design guidelines. This paper reviewed and compared the most globally employed four mental workload assessment techniques that have been designed for the use of various human-machine systems and ITS-oriented in-vehicle information systems. NASA-TLX(National Aeronautics and Space Administration-Task Load Index). SWAT(Subjective Workload Assessment Technique), MCH(Modified Cooper-Harper) scale, and recently developed RNASA-TLX(Revision of NASA-TH) were compared in terms of sensitivity and subjective evaluations to derive the human-machine interface evaluation guidelines for the application of ITS-oriented in-vehicle information systems. Then, experiment results supported that RNASA-TLX is the prospective tool for the mental workload assessment of ITS-oriented in-vehicle information systems.

교통시스템 및 차량의 인간-기계 상호작용 및 인간공학적 평가에 널리 사용되는 운전자의 시각행위분석, 생체신호측정(심박수, 호흡수, 뇌파, 피부전기반사 등), 부가작업의 수행도분석, 반응시간 분석, 차량조작변수 분석(속도, 핸들조작, 가속페달조작) 등의 방법들과 함께 운전자 판단에 의한 주관적평가(Subjective Mental Workload Assessment)는 기존 시스템의 평가뿐만 아니라, ITS(Intelligent Transport Systems) 기반 인간-기계 시스템(항법장치, Head-UP Display, AHS Flat Panel Display, Changeable Message Sign, Cellular Phone, 등)의 인간-기계 상호작용 평가, 안전도 평가, 경쟁시스템 및 디자인 대안의 의사결정, 설계가이드라인 제작 등을 위한 하나의 표준화된 평가도구로 자리 잡고 있다. 이에 본 연구에서는 가장 많은 적용빈도와 효과 및 감도를 제시하는 주관적 평가방법인 NASA-TLX (National Aeronautics and Space Administration-Task Load Index), SWAT(Subjective Workload Assessment Technique), MCH(Modified Cooper-Harper) scale, RNASA-TLX(Revision of NASA-TLX)를 대상으로 항법 장치를 사용한 운전자 부하 비교평가 실험결과를 이용하여, 제시된 방법들의 감도 및 피 실험자의 주관적 판단을 통한 상호 비교분석을 실시하였으며, 결과로 위에 제시된 방법들의 사용가이드라인과 ITS 기반 인간-기계 시스템의 인간공학적 평가를 위한 주관적 평가방법의 비교평가결과를 제시하였다.

Keywords

References

  1. Working Paper An interface design for a teleoperation system for nuclear applications Alan, A. B.
  2. Human Factors v.26 no.6 Comparison of rating scale, secondary-task, physiological and primary-task workload estimation techniques in a simulated flight task emphasizing communication load Casali, J.G.;Wierwille, W. W.
  3. Ergonomics v.27 no.10 On the measurement of pilot perceptual workload : A comparison of assessment techniques addressing sensitivity and intrusion issues Casali, J.;Wierwille, W. A.
  4. Computers. ind. Engng v.33 no.3-4 User required information modality and structure of in-vehicle navigation system focused on the urban commuter Cha, D. W.;Park, P.
  5. IE-Interfaces v.10 no.11 Simulator-based mental workload assessment of the in-vehicle navigation system driver using Revision of NASA-TLX Cha, D. W.;Park, P.
  6. Journal of Korean Society of Trasportation v.15 no.2 Development of human-machine interface assessment system and derivation of design variables for vehicle navigation system Cha, D. W.;Park, P.
  7. Journal of Korean Society of Transportation v.16 no.1 Ergonomic research of the map-rotation and the text-rotation method of the navigation system digital map Cha, D. W.;Park, P.
  8. Journal of the Society of Korea Industrial and Systems Engineering v.21 no.48 Human sensitivity ergonomics evaluation for car navigation system digital map Cha, D. W.;Park, P.
  9. Journal of Traffic Safety Research v.17 Cognitive evaluation of car navigation system digital map prototypes using drawing method Cha, D. W.;Park, P.
  10. IE-Interfaces v.12 no.2 Development human factors evaluation system for car navigation system Cha, E. W.;Park, P.
  11. EEC Report no.275 Instrusiveness of on-line self-assessment in ATC simulation using keyboard and speech recognition David, H. S. P.
  12. Proceeding of 1st U.S.A/EUROPE Air Traffic Management Seminar Situation awareness, automation & free flight Endsley, M. R.
  13. SAE Paper no.891683 Influence of in car navigation map displays on drivers performance Guy, L.
  14. Ergonomics v.39 no.9 Effects of control order, augmented feedback, input device and practice on tracking performance and perceived workload Hancock, P. A.
  15. Proceeding of the Human Factors Society 34th Annual Meeting A validation of SWAT as a measure of workload induced by changes in operator capacity Hankey, J. M.;Dingues, T. A.
  16. Human metal workload Development of NASA-TLX(Task Load Index) : Result of empirical and theoretical research Hart, S. G.;Staveland, L.;P. A. Hancock(ed.);N. Meshtati(ed.)
  17. Human Factors v.34 no.4 Comparison of four subjective workload rating scales Hill, S. G.;Iavecchia, H. P.;Byers, J. C.;Bittner, A. C.;Zaklad, A. L.;Christ, R. E.
  18. Encyclopedia of statistical science v.4 Jackknife method Hinkely, D. V.;S. Konz(ed.);N. L. Johnson(ed.);C. B. Read(ed.)
  19. Proceeding of Society for Academic Emergency Medicine 1998 Annual Meeting ED staff workload-subjective and objective measures Jay, G. D.;Morey, J.
  20. Human Factors v.28 no.2 A profile of drivers' map-reading abilities Lynn A. S.
  21. Proceeding of IEEE-IEE Vehicle & Imformation Systems Conference The processing of complex guidance symbols by elderly drivers : A simulator-based study and an European Community DRIVE-EDDIT project Marin, L. C.;Dejeamme, M.
  22. Generic intelligent driver support Michon, J. A.
  23. Applied Psychological Measurement v.9 An examination of conditional violations of axioms for addictive conjoint measurement Nygren, T. E.
  24. Psychometrika v.51 A two-stage algorithm for assessing violations of additivity via axiomatic and numerical conjoint measurement Nygren, T. E.
  25. Human Factors v.31 no.1 Phychometric properties of subjective workload measurement techniques : Implications for their use in the assessment of perceived mental workload Nygren, T. E.
  26. Technical Report Study on the guideline and development of Human Sensibility Engineering model for car interior design Park, P.
  27. Technical Report, Industrial Engineering Department of Ajou University A development of the model and the prototyping interface for human-machine system interactions Park, P.
  28. Proceeding of IEEE-IEE Vehicle & Information Systems Conference An evaluation of medium range advance information in route-guidance displays for use in vehicle Parkes, A. M.;Burnett, G. E.
  29. Proceeding of IEEE-IEE Vehicle Navigation & Information Systems Conference Ergonomic evaluation of a prototype guideline system in an urban area : Discussion about methodologies and data collection tools Pauze, A.;Shrpedon, A.;Samulnier, G.
  30. Proceeding of 3rd Annual World Congress on Intelligent Transport Systems(CD-ROM Version) Evaluation of an adaptive cruise control(ACC) system used by drivers with lower limb impairments Peter, B.
  31. ACM Multimedia 97-Electronic Proceedings An improved auditory interface for the exploration of lists Pitt, L. J.;Edwards, A. D. N.
  32. Human factors in simple and complex systems Proctor, R. W.;Zandt, T. V.
  33. Human Mental Workload The subjective workload assessment technique : A scaling procedure for measuring mental workload Reid, G. B.;Nygren, T. E.;P. A. Hancock(ed.);N. Meshtati(ed.)
  34. Proceeding from Vision in Vehicle Ⅲ Conference Spare visual capacity in driving-revisitied Rockwell, T. H.
  35. The analytic hierarchy process Saaty, T. L.
  36. Ergonomics v.40 no.3 Information complexity-mental work-load and performance, Combat Aircraft Svensson, E.;Thanderz, M. A.;Sjoberg, L.;Olsson, S.
  37. Proceeding of the 24th Annual Meeting of the Human Factors Society Enhancing operator acceptance and noninterference in secondary task measures of workload Shingledecker, C. A.
  38. Aerospace Medical Association Annual Scientific Meeting Performance evaluation of the embedded secondary task technique Shingledecker, C.
  39. Ergonomics v.29 Evaluation of decision-tree rating scales for mental workload estimation Skipper, J. H.;Rieger, C. A.;Wierwiller, W. W.
  40. Proceedings of Assets 96 An approach to the evaluation of assistive technology Stevens, R. D.;Edwards, A. D. N.
  41. Proceeding of 5th World Congress on Intelligent Transport Systems(CD-ROM Version) Effects of cellular telephone use on driver's reaction time and subjective mental workland Tokunaga, R.;Hagiwara, T.;Takagi, H.;Shimojo, A.
  42. Proceedings of 1st World Congress of ITS A Human factors investigation of an RDS-TMC system Vaughan, G.
  43. Human Factors v.33 no.6 Using the subjective workload dominance technique for projective workload assessment Vidulich, M. A.
  44. Attention and Performance The structure of attentional resources Wickens, C. D.;R. Nickerson(ed.);R. Pews(ed.)
  45. Proceedings of the Human Factors Society 27th Annual Meeting A validated rating scaling for global mental workload measurement applications Wirewille, W. W.;Casali, J. G.
  46. Human Factors v.35 no.2 Recommendations for mental workload measurement in a test and evaluation environment Wierwille, W. W.;Eggemeier, F. T.
  47. Master Dissertation A study of the relationship between the time to implement of driving secondary task and mental workload to standardness of cockpit Yu, S. D.