• Title/Summary/Keyword: Usability score

Search Result 76, Processing Time 0.026 seconds

Usability Return On Investment Framework Based on Balanced ScoreCard (균형성과지표를 활용한 Usability 투자 성과관리 Framework 개발)

  • 이주환;윤명환
    • Proceedings of the Korean Society for Emotion and Sensibility Conference
    • /
    • 2003.11a
    • /
    • pp.1241-1242
    • /
    • 2003
  • 본 연구는 Usability의 투자 성과관리(ROI: Return On Investment)를 위한 균형성과지표(BSC: Balanced ScoreCard) 관점에서의 Framework 개발을 목표로 한다. 2000년 이후 Usability에 대한 투자 규모는 높은 증가세를 유지해 왔으나 대규모 투자가 진전되는 가운데 Usability투자의 수익성을 어떻게 확보하고, 그 효과(Effectiveness)는 어떻게 측정할 것인가 하는 문제는 상대적으로 관심을 끌지 못하고 있다. Usability 투자에 대한 시스템적 성과관리를 위해 개발된 Usability BSC Framework은 BSC의 4가지 관점에서 Usability 투자성과관리에 대한 변형된 관점의 모델을 제안한다.

  • PDF

Developing and Applying Usability Testing Instrument to Improve the VR-based Mobile Application for Maker Education (VR 기반 메이커 교육용 모바일 앱 개선을 위한 사용성 평가 도구 개발 및 적용)

  • Park, Taejung;Cha, Hyunjin
    • Journal of Information Technology Services
    • /
    • v.21 no.2
    • /
    • pp.127-143
    • /
    • 2022
  • In this study, a usability evaluation tool was developed for "ICANDUINO", a VR-based mobile application for maker education, and usability evaluation was conducted with a heuristic survey method for experts. The usability evaluation tool was derived through literature review and validated by two experts. It consisted of seven domains (effectiveness, efficiency, satisfaction, learnability, memorability, error, and cognitive load) and twenty-five sub-items. As a result of the usability evaluation conducted for six experts, it received the highest score in the domain of efficiency and the lowest score in the domain of error. The improvements of ICANDUINO were derived by analyzing the qualitative opinions of experts in each of the four stages (training, coding, tinkering, and testing) of making. the results of this study can be used as a guideline when evaluating the usability of a mobile app for education.

Method for Measuring Usability of Smart Television (스마트TV의 사용성 측정방법)

  • Byun, Dae-Ho
    • Journal of Digital Convergence
    • /
    • v.11 no.5
    • /
    • pp.31-39
    • /
    • 2013
  • Smart TV is a television set with internet capabilities, computing ability, and broadcasting service that increases user interactions. Usability has been regarded as one of the most important criteria for measuring and evaluating smart TV. To evaluate smart TV from the perspective of usability, we first need to develop a measurement model by determining the major factors affecting usability, which become a measurement the evaluation criteria of the model. The objective of this paper is to suggest an AHP(Analytic Hierarchy Process) model for measuring usability of smart TV. Factors affecting usability are described from the prior research. We show how the judgment data is acquired and the usability score is computed by an numerical example.

User evaluation of the mobile application, CAMBRA-kids, for caries management in preschoolers (소아 치아우식관리 애플리케이션에 대한 사용자 평가)

  • Kang, Yu-Min;Lee, Su-Young
    • Journal of Korean society of Dental Hygiene
    • /
    • v.19 no.5
    • /
    • pp.859-871
    • /
    • 2019
  • Objectives: The present study aimed to evaluate the usability, quality, and usefulness of the mobile application, CAMBRA-kids, for caries management in preschoolers. Methods: Ninety-one caregivers and preschoolers participated in the user evaluation of CAMBRA-kids. The evaluators assessed the usability, quality, and usefulness of CAMBRA-kids. The collected data were analyzed using R studio 1.2.1335 for Windows (RStudio Inc. 2018, Boston, MA, USA). The evaluations for usability, quality, and usefulness were analyzed with descriptive statistics, Kruskal-Wallis rank sum test, and Wilcoxon rank sum test. Results: On user evaluation, the quality and usefulness of the application scored >3 points, and majority of the users rated the quality and usefulness of the application as high. The quality of the application's system was the highest at 3.68 points, and the actual usage of the application was the lowest at 3.10 points. The application had the highest technological aspect score of 3.20, whereas the content related to oral health information had the lowest score of 3.10/5. Although the application showed no statistically significant differences in the quality and usefulness according to general characteristics, there was a statistically significant difference (p<0.05) between the two when compared between the caries risk group. For all items, the protector of the high-risk group evaluated the quality and usefulness of the application highly. The moderate risk group gave the lowest evaluation score for the application's quality and usefulness. The usability score of the application, according to the user version of the mobile application rating scale (uMARS), was 3.25, and the average engagement score was 2.82 (56.31%). The highest subscale score was 3.63. Conclusions: In this study, we found suitable quality, usability, and usefulness of the mobile application, CAMBRA-kids. In future, the use of this application will contribute to the prevention of dental caries among preschoolers.

Usability test of pulling cable exercise machine in the spinal cord injury disabled: Focusing on deriving improvement (척수 손상 장애인 대상 장애인용 풀링 케이블 운동기구의 사용성 평가: 개선점 도출을 중심으로)

  • Sung Shin Kim;Myo Jung Choi;Hyosun Kweon;Kwang Ok An;Young-Hyeon Bae
    • Journal of Korean Physical Therapy Science
    • /
    • v.31 no.1
    • /
    • pp.16-32
    • /
    • 2024
  • Background: Exercise equipments and assistive devices for the disabled are being developed, but improvements for usability are still needed. The purpose of this study was to improve and utilize the developed exercise equipment and assistance devices by conducting usability test for people with spinal cord injury. Design: Cross-sectional Study. Methods: Scenarios and usability indicators were derived by conducting a preliminary usability test, 5 non-disabled men and women aged 19 or older. In the scenario, a total of 9 tasks were sequentially performed, including 2 tasks of entry and exit, 5 tasks of assistance devices and weight stack adjustment, and 2 tasks of pre exercise and exercise. The usability indicators were task success (success or fail), execution time (sec), safety, and convenience. For safety, 7 questions (Likert scale, 1~5 point) related to safety, stability and hazard were derived, and for convenience, the system usability scale (SUS score) was used (range: 0~100, 50 percentile rank is 68 point). Results: As a result of the usability test of people with spinal cord injury, there was a large variation among subjects in the task of adjusting the position of the pulley and support in the execution time (11.64~25.44 seconds), and one person failed to adjust the pulley. The safety level showed a lower score (score = 3 points) than other items in the item of entrapment or skin pressure, and in the case of SUS, the average score was 64.5 points, which was close to the acceptable level. Conclusion: Through the usability test, it was confirmed that exercise equipment for the disabled needs improvement in operability, pinching, and pressure, and that it is necessary to develop an assistive device that provides unrestrained posture information (biofeedback) to maintain correct posture during exercise.

A Usability Study On Museum Installations Emphasizing Interaction Design for User Experience (사용자 경험 증진을 위한 과학관 전시물의 사용성 평가)

  • Cho, Myung Eun;Choi, Han Hee;Kim, Mi Jeong
    • Korean Institute of Interior Design Journal
    • /
    • v.22 no.5
    • /
    • pp.302-310
    • /
    • 2013
  • Many museums have recently employed digital technologies in exhibition installations to provide visitors with interactive experiences with the installations, not just audiences. However, most of them have focused on the adoption of new prototypes or technologies, not considering user experiences of those systems carefully. This study developed an evaluation tool for usability of the tangible user interfaces and conducted a usability study on museum installations emphasizing user interaction and experience. The evaluation tool is composed of 5 features of tangible user interfaces such as tangible, interaction, convenience, representation, spatial interaction and social interaction, and 24 items. The museum we investigated is the Gwacheon National Science Museum, where 8 installations, classified 4 categories, were selected for the usability study. We recruited 6 undergraduate students, who were divided into 2 teams, each team having 3 students. Three students in a team manipulated and experience each installation together and reported their evaluation score through the questionnaire and interviews. The results showed that the score of the usability for the category 3, which requires students to move their bodies for the interaction, is the highest one because it features with spatial interaction. Students expressed much interest in the category 4, which utilizes users' other senses, however, the score of the usability is the lowest because the interaction is temporary and repetitive. Most installations are well designed in terms of control constraints, legibility, lower thresholds, participation encouragement, and open to the public, but pooly designed in terms of multiple access points, configurability, accurate movement, ambient media, and full-body interaction.

DetGas: A Carbon Monoxide Gas Leakage Detector Mobile Application

  • Kamaruddin, Farhan Fikri Mohd;Hadiana, Ana;Lokman, Anitawati Mohd
    • International Journal of Computer Science & Network Security
    • /
    • v.21 no.11
    • /
    • pp.59-66
    • /
    • 2021
  • Many incidents of Carbon Monoxide (CO) poisoning have occurred because of people being unaware of its presence. There are currently available systems on the market, but they are limited to measuring CO in a certain area and lack vital functions. Additionally, little to no evidence-based information on their quality was available. Thus, a mobile application for detecting CO gas leakage in a vehicle and critical features to assist victims was developed. A usability and functionality test were conducted to determine the product's quality utilizing nine usability and six functionality task scenarios (n=5). Then, a System Usability Scale test was performed to obtain system satisfaction, usability, and learnability (n=50). The usability and functionality test shows that all the tasks given for both tests were 100% successful. The overall score obtained for SUS was 71.4, which indicates good acceptance and usability. Around 20% of respondents claimed that they would need the support of a technical person to be able to use the application and that they needed to learn a lot of things before they could use the application, which indicates the overall high learnability of the application. The result provides empirical evidence that the CO gas leakage detection mobile application is successful and receives good usability, functionality, acceptability, learnability, and satisfaction assessments. DetGas could benefit automobile owners and other stakeholders by mitigating the risk and harm associated with gas leaking that exceeds the safe limit.

A Short-term and Long-term Usability Testing of the Speech Synthesizer for the People with Visual Impairments (시각장애인용 음성합성기에 대한 장/단기 사용성 평가)

  • Lee, H.Y.;Hong, K.H.
    • Journal of rehabilitation welfare engineering & assistive technology
    • /
    • v.9 no.1
    • /
    • pp.53-60
    • /
    • 2015
  • We conducted a long-term and short-term usability testing on the built-in speech synthesizer of a screen-reader for the people with visual impairments. A total of 20 persons with visual impairments participated in the short-term usability testing, and 10 of them participated in the long-term usability testing. Naturalness and clarity of the synthetic speech were evaluated by MOS scores, preference for various synthetic speeches was examined through a preference test, and the users' satisfaction level and other requirements for the synthetic speech were evaluated by open feedback. We also examined naturalness, clarity, preference, and user requirements for the synthetic speech through a long-term usability testing. Then, we compare and contrast the long-term and short-term usability testing results.

  • PDF

Development of Customized Exercise Service Program for Elderly and Evaluation of Usability (노인 대상 맞춤형 운동서비스 프로그램 개발 및 사용성 평가)

  • Yo-Han, Song;Il-Hyun, Bak;Seon-Yeong, Kwak;Hyun-Min, Lee
    • Journal of the Korean Society of Physical Medicine
    • /
    • v.17 no.4
    • /
    • pp.151-160
    • /
    • 2022
  • PURPOSE: To evaluate the usability of a kiosk-based healthcare service that provides a fitness evaluation and customized exercise program for elderly or chronic musculoskeletal system patients. METHODS: To evaluate the usability of the customized exercise service program, healthy adults (n=20) from Welfare B, located in Gwangju, were selected and studied. Subjective safety, operability, and satisfaction of individual users were obtained as data by distributing questionnaires to subjects who experienced this program and having them fill out the questionnaire. For descriptive statistics related to the survey, frequency analysis was used to determine the frequency and ratio of the variable values of the measurement items. RESULTS: As a result of the usability evaluation, the average score was 4.166, and the average score of each item was 4.025 for safety, 4.272 for operability, and 4.143 for satisfaction. Most users obtained high satisfaction and positive impressions. CONCLUSION: The HARUFIT service, a user-customized exercise program used in this study, can be developed into a device that can improve self-management ability and increase understanding of health care by providing customized exercise based on the results of physical fitness evaluation. It is possible to diversify health management methods and maximize the effect of exercise by making exercise a habit of chronic musculoskeletal disease patients or the elderly using these smart devices.

A Usability Evaluation on the Visualization Techniques of Web Retrieval Results (웹 검색 결과 시각화 기법의 사용성 평가에 관한 연구)

  • Kim, Seong-Hee;Kim, Moon-Jeong
    • Journal of the Korean Society for Library and Information Science
    • /
    • v.41 no.3
    • /
    • pp.181-199
    • /
    • 2007
  • This study is to suggest the usefulness of visualization techniques to display web retrieval results. We described the concept of visualization techniques and evaluated the usability for the SearchCrystal and KartOO search engines which provide visualization techniques for displaying the retrieval results. As a result, Searchcrystal search engine had higher score than KartOO system in terms of usability check lists.