The Journal of Korea Robotics Society (로봇학회논문지)

Korea Robotics Society (한국로봇학회)
권호 표지
DOI QR코드

DOI QR Code

A Usability Evaluation Method Based on the Lostness of Unit Action for Coding Education Software

코딩 교육용 소프트웨어에 대한 단위 행동 손실률 기반의 사용성 평가 방법

  • Received : 2015.04.13
  • Accepted : 2015.04.29
  • Published : 2015.05.31
Download PDF
⟨ Previous Next ⟩

Abstract

In this paper, we first point out the limitation of the existing methods in usability evaluation, and propose a new method to find tasks and users that can cause problems in the use of software applications. To deal with object-based applications, we define unit actions and divide a given task into the sequence of unit actions. Then, we propose a new measure to calculate the degree of lostness for the unit actions. In several experiments, we show the proposed method can represent the usability well while the previous method has a problem in object-based applications. We also find that the user's evaluation is more related to the proposed method than the previous method based on execution time through correlation analysis.

Keywords

References

  1. P.W. Jordan, Designing Pleasurable Products, Taylor & Francis, London and New York, 2000, pp. 1-10.
  2. S.-H. Cho, "The effect of robots in education based on STEAM," Journal of Korea Robotics Society, vol. 8, no. 1, pp. 58-65, March 2013. https://doi.org/10.7746/jkros.2013.8.1.058
  3. Y.A. Kim, K.H. Chae, Y.-J. Sohn, J.-M. Yang, and C.D. Koo, "Teachers and students' recognition about learning with a humanoid robot in elementary school," Journal of Korea Robotics Society, vol. 9, no. 3, pp. 185-195, September 2014. https://doi.org/10.7746/jkros.2014.9.3.185
  4. J. Nielsen, Usability Engineering, Morgan Kaufmann, 1933, pp. 24-40.
  5. A. Holzinger, "Usability engineering methods for software developers," Communications of the ACM, vol. 48, no. 1, pp. 71-74, January 2005. https://doi.org/10.1145/1039539.1039541
  6. J. Nielsen, "Finding usability problems through heurisitc evaluation," in CHI '92 Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1982, pp. 373-380.
  7. J. Hom, The Usability Methods Toolbox Handbook, 1988, pp. 21-44, http://jthom.best.vwh.net/usability/usable.htm
  8. T. Tullis and B. Alvert, Measuring the User Experience, Morgan Kaufmann, 2009, pp. 97-106.
  9. DataLogger webpage, http://www.userfocus.co.uk/resources/datalogger.html
  10. P.A. Smith, "Toward a practical measure of hypertext usability," Interacting with Computers, vol 8, no. 4, pp. 365-381, December 1996. https://doi.org/10.1016/S0953-5438(97)83779-4
  11. M. Resnick, J. Maloney, A. Monroy-Hernandez, N. Rusk, E. Eastmond, K. Brennan, A. Millner, E. Rosenbaum, J. Silver, B. Silverman, and Y. Kafai, "Scratch: programming for All," Communications of the ACM, vol. 52, no. 11, pp. 60-67, November 2009. https://doi.org/10.1145/1592761.1592779
  12. C. Villamor, D. Willis, and L. Wroblewski, Touch gesture reference guide webpage, http://www.lukew.com/touch
  13. D.A. Kenny, Statistics for Social and Behavioral Sciences, Little, Brown, 1987, pp. 270-288.
  14. J.H. Steiger, "Tests for comparing elements of a correlation matrix," Psychological Bulletin, vol. 87, no. 2, pp. 245-251, March 1980. https://doi.org/10.1037/0033-2909.87.2.245
  15. J.F. Ehlers, Cybernetic Analysis for Stocks and Futures: Cutting-Edge DSP Technology to Improve Your Trading, Wiley, 2004, pp. 1-10.