Journal of information and communication convergence engineering

The Korea Institute of Information and Commucation Engineering (한국정보통신학회)
권호 표지
DOI QR코드

DOI QR Code

Development of a Quality Evaluation Standard for Educational Serious Games

  • Received : 2013.01.07
  • Accepted : 2013.02.28
  • Published : 2013.06.30
Download PDF
⟨ Previous Next ⟩

Abstract

Given the lack of suitable quality evaluation standards for educational serious games (designed for both entertainment and instruction), we designed a development framework for evaluation standards of educational serious games and proceeded to develop standards in accordance with our proposed procedure. Our standards were designed to evaluate the quality of both technical and non-technical elements of educational serious game software products. We conducted a survey on the need for individual elements of the standard. Participants rated the need for each element on a five-point Likert scale. We then performed a reliability analysis of the survey results. Based on the survey results, we established a final standard for quality evaluation composed of 9 main elements and 31 sub-elements. The results of our research will contribute useful information to users as well as to the developers of educational serious games.

Keywords

References

  1. D. Michael and S. Chen, Serious Games: Games That Educate, Train and Inform. Boston, MA: Thomson Course Technology, 2006.
  2. Korea Creative Contents Agency, Serious game statues and demand survey [Internet], Available: http://seriousgame.kocca.kr/info/report/1200861_3212.html.
  3. X. Chen, "Influence from the serious game on mobile game developers' commercial strategies," in Proceedings of the International Seminar on Business and Information Management, Wuhan, China, pp. 207-209, 2008.
  4. M. Zyda, "From visual simulation to virtual reality to games," IEEE Computer, vol. 38, no. 9, pp. 25-32, 2005.
  5. IEEE, IEEE Standard for software quality assurance plans [Internet], Available: http://ieeexplore.ieee.org/xpl/articleDetails.jsp?arnumber=1040117.
  6. D. E. Lowe and G. M. Cox, "Implementing the capability maturity model for software development," Hewlett-Packard Journal, vol. 47, no. 4, pp. 1-6, 1996.
  7. Information Technology - Process Assessment. Part 1: Concept and vocabulary, ISO/IEC 15504-1:2004.
  8. Information technology - Learning, Education and Training-Quality Management, Assurance and Metrics. Part 1: General approach, ISO/IEC 19796-1:2005.
  9. Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE). System and software quality models, ISO/IEC 25010:2011.
  10. Software engineering - Product quality. Part 2: External metrics, ISO/IEC TR 9126-2:2003.
  11. Software engineering - Product quality. Part 3: Internal metrics, ISO/IEC TR 9126-3:2003.
  12. Software engineering - Software product Quality Requirements and Evaluation (SQuaRE). Requirements for quality of Commercial Off-The-Shelf (COTS) software product and instructions for testing, ISO/IEC 25051:2006.
  13. Systems and software engineering - Systems and software Quality Requirements and Evaluation (SQuaRE). Evaluation process, ISO/IEC 25040:2011.
  14. Software Engineering - Software product Quality Requirements and Evaluation (SQuaRE). Guide to SQuaRE, ISO/IEC 25000: 2005.
  15. Telecommunications Technology Association, TTAS.KO-11.0078: the quality model for mobile game software [Internet], Available: http://www.tta.or.kr/data/ttas_view.jsp?rn=1&pk_num=TTAS.KO-11.0078.
  16. Telecommunications Technology Association, TTAS.KO-11.0059: quality evaluation guideline for Web-based software [Internet], Available: http://www.tta.or.kr/data/ttas_view.jsp?rn=1&pk_num=TTAS.KO-11.0059.
  17. G. A. Churchill and J. P. Peter, "Research design effects on the reliability of rating scales: a meta-analysis," Journal of Marketing Research, vol. 21, no. 4, pp. 360-375, 1984. https://doi.org/10.2307/3151463
  18. J. C. Nunnaly, Psychometric Theory, 2nd ed. New York, NY: McGraw-Hill, 1978.
  19. A. H. Van de Ven and D. L. Ferry, Measuring and Assessing Organization. New York, NY: John Wiley & Sons Inc., 1980.