Usability Test of Serious Game Robot App for Hospitalized Children

입원 아동 환자를 위한 로봇용 기능성 게임 앱 사용성 평가

Jin, Mei-Ling;Kim, Jeong-Eun

  • Received : 2018.11.19
  • Accepted : 2019.02.01
  • Published : 2019.02.28


This study was conducted to evaluate the usability of serious-game apps for robots that are being developed for hospitals to add familiarity to hospital life for hospitalized patients. We conducted a usability test of 10 experts and 12 elementary school students with inpatient experience. The usability evaluation of the developed apps was based on the professional (MARS) evaluation tool and the user (uMARS) evaluation tool. The results of the usability test of the serious game robot app were $3.67{\pm}0.342$ for professionals and $3.68{\pm}0.592$ for children. The expert group obtained the highest score in the aesthetics category, and the user group obtained the highest score in the functionality category. In the subjective comments, the experts pointed out the game layout and the consistency of the style. According to the children, the methods were easy to learn, and the screen movement was mainly described. Both groups received low ratings in terms of engagement through participation. This study will provide useful reference material when the functional game app is actually installed in the robot and the usability test is conducted again after the results obtained in this study are considered.


Usability test;Serious game;Robot;App;Hospitalized children


  1. M. G. Kang, H. J. Lee, Y. T. Kim, "The Current Status of the Use of Robots for Children with Disabilities", special education, vol. 12, no.3, pp. 127-152, Oct. 2013. DOI :10.18541/ser.2013.
  2. G. M. R. Jung, "Current Status and Prospects of the Game Industry", Journal of Game Industry, vol. 1, no. 4, pp. 1-8, 2010.
  3. H. J. Lee, "Change to Useful Game: Trends of Serious Game", Electronics and telecommunications trends, vol. 27, no. 3, pp. 43-50, Jun. 2012. DOI: 10.22648/ETRI.2012.J.270305
  4. S. Dehem, G. Stoquart, T. Lejeune, I. Brouwers, V. Montedoro, M. Edwards, S. Heins, D. Galinski, B. Dehez, "Assessment of upper limb motor impairments in children with cerebral palsy using a rehabilitation robot and serious game exercise", Paper presented at the the 5th IEEE Conference on Serious Games and Applications for Health, 2017.
  5. KISDI STAT Researcher. "2017 KISDI STAT Report", [cited 2017 December 15], Available From: &selectPage= (accessed Oct. 10, 2018)
  6. H. W. Baek, Y. M. Shin, K. M. Shin, "Emotional and Behavioral Problems Related to Smartphone Overuse in Elementary School Children". J Korean Neuropsychiatr Assoc, vol. 53, no. 5, pp. 320-326, Sep. 2014. DOI:
  7. LV. Calderita, P. Bustos, C. Suarez-Mejias, B. Ferrer-Gonzalez, A. Bandera, "Rehabilitation for Children while Playing with a Robotic Assistant in a Serious Game". Paper presented at the Neurotechnix. 2013. DOI: 10.5220/0004646700890096
  8. R. Labruyere, C. N. Gerber, K. Birrer-Brutsch, A. Meyer-Heim, H. J. van Hedel, "Requirements for and impact of a serious game for neuro-pediatric robot-assisted gait training", Res Dev Disabil, vol. 34, no. 11, pp. 3906-3915, Nov. 2013. DOI: 10.1016/j.ridd.2013.07.031
  9. J. G. Jo, W. H. Heo, "Usability Evaluation Frameworks of Mobile Apps on SmartPhone", Asia-pacific journal of multimedia services convergent with art, humanities, and sociology, vol. 7, no. 12, pp. 841-848, Dec. 2017. DOI:
  10. J. H. Park, S. H. Han, J. H. Park, W. G. Park, H. G. Kim, & S. W. Hong, "Comparison of Usability Evaluation Methods for Mobile Application", Ergonomics Society of Korea Conference Proceedings, pp.154-157, 2012.
  11. J. C. Bastien, "Usability testing: a review of some methodological and technical aspects of the method", International journal of medical informatics, vol.79, no. 4, pp. e18-e23, 2010. DOI:
  12. W. Hwang, G. Salvendy, "Number of people required for usability evaluation: the $10{\pm}2$ rule", Communications of the ACM, vol. 53, no. 5, pp. 130-133, May 2010. DOI: 10.1145/1735223.1735255
  13. S. R. Stoyanov, L. Hides, D. J. Kavanagh, O. Zelenko, D. Tjondronegoro, M. Mani, "Mobile app rating scale: a new tool for assessing the quality of health mobile apps", JMIR mHealth and uHealth, vol. 3, no. 1, 2015. DOI: 10.2196/mhealth.3422
  14. S. R. Stoyanov, L. Hides, D. J. Kavanagh, H. Wilson, "Development and validation of the user version of the Mobile Application Rating Scale(uMARS)", JMIR mHealth and uHealth, vol. 4, no. 2, pp. e72, Jun. 2016. DOI: 10.2196/mhealth.5849
  15. J. Y. Lee, "Development and evaluation of hyperlipidemia management mobile application based on transtheoretical model", Doctoral thesis. [cited 2017 August], Available From: (accessed Oct. 10, 2018)
  16. A. J. Byun, "Development and Evaluation of Smartphone App Healthy Kids for Children's Weight Control with Their Parents", Master Thesis, [cited 2018 February], Available From: (accessed Oct. 10, 2018)
  17. J. G. Jo, "Usability Evaluation using Heuristic Evaluation Method in Mobile Apps", Asia-pacific journal of multimedia services convergent with art, humanities, and sociology, vol. 8, no. 6, pp. 919-926, Jun. 2018.
  18. S. Schoeppe, S. Alley, A. L. Rebar, M. Hayman, N. A. Bray, W. V. Lippevelde, J. P. Gnam, P. Bachert, A. Direito, C. Vandelanotte, "Apps to improve diet, physical activity and sedentary behaviour in children and adolescents: a review of quality, features and behaviour change techniques", International Journal of Behavioral Nutrition and Physical Activity, vol. 14, no. 1 pp.83, Jun. 2017. DOI:


Supported by : 한국 연구재단